-- Logs begin at Wed 2022-05-04 20:49:26 UTC, end at Wed 2022-05-04 22:32:47 UTC. -- May 04 21:31:50.539450 dv-cinder-839793-8-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 04 21:31:50.546886 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 04 21:31:50.548914 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 4 21:31:50 2022] *** May 04 21:31:50.548914 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 04 21:31:50.548914 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 04 21:31:50.548914 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: nodename: dv-cinder-839793-8-iscsi May 04 21:31:50.548914 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: machine: x86_64 May 04 21:31:50.548914 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: clock source: unix May 04 21:31:50.548914 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: pcre jit disabled May 04 21:31:50.548914 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: detected number of CPU cores: 4 May 04 21:31:50.548914 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: current working directory: / May 04 21:31:50.548914 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: detected binary path: /usr/bin/uwsgi-core May 04 21:31:50.548914 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: your processes number limit is 47680 May 04 21:31:50.548914 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: your memory page size is 4096 bytes May 04 21:31:50.548914 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: detected max file descriptor number: 2048 May 04 21:31:50.548914 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: lock engine: pthread robust mutexes May 04 21:31:50.549812 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: thunder lock: enabled May 04 21:31:50.549812 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 04 21:31:50.549812 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 04 21:31:50.596356 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: Python main interpreter initialized at 0x557aa84439c0 May 04 21:31:50.596356 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: python threads support enabled May 04 21:31:50.596356 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: your server socket listen backlog is limited to 100 connections May 04 21:31:50.596356 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: your mercy for graceful operations on workers is 90 seconds May 04 21:31:50.596704 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: mapped 403077 bytes (393 KB) for 2 cores May 04 21:31:50.596778 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: *** Operational MODE: preforking *** May 04 21:31:50.597098 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: *** uWSGI is running in multiple interpreter mode *** May 04 21:31:50.597098 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: spawned uWSGI master process (pid: 86602) May 04 21:31:50.597268 dv-cinder-839793-8-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 04 21:31:50.600258 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: spawned uWSGI worker 1 (pid: 86613, cores: 1) May 04 21:31:50.600258 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: spawned uWSGI worker 2 (pid: 86614, cores: 1) May 04 21:31:50.600258 dv-cinder-839793-8-iscsi devstack@keystone.service[86602]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 04 21:31:56.261563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 21:31:56.261563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: from cryptography.utils import int_from_bytes May 04 21:31:56.262384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 21:31:56.262384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: from cryptography.utils import int_from_bytes May 04 21:31:56.262384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 21:31:56.262384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: from cryptography.utils import int_from_bytes May 04 21:31:56.262895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 21:31:56.262895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: from cryptography.utils import int_from_bytes May 04 21:31:56.311699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 21:31:56.311891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 21:31:56.312099 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] command line args: [] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 21:31:56.312295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 21:31:56.312472 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ================================================================================ {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 21:31:56.312746 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] admin_token = **** {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.312870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 21:31:56.312947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] config_dir = [] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.313014 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 21:31:56.313205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.313297 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] command line args: [] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 21:31:56.313369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] config_source = [] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.313430 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 21:31:56.313487 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] debug = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.313551 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ================================================================================ {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 21:31:56.313723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.316027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] admin_token = **** {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.316098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.316158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] config_dir = [] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.316214 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.316271 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.316271 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] config_source = [] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.316384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.316460 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] debug = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.316526 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.316585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.316671 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] list_limit = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.316732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.316795 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] log_config_append = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.316858 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.316915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.316977 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.317046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] log_dir = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.317046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] log_file = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.317156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.317220 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.317284 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] list_limit = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.317284 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] log_config_append = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.317393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.317451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.317508 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.317564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] log_dir = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.317564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] log_file = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.317677 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.317677 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.317797 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.317853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.317912 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.317968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.318025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.318104 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.318176 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.318236 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.318292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.318292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.318394 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.318460 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.318525 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.318588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.318653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.318711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.318779 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.318837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.318893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.318963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.319034 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.319117 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.319117 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.319920 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.11/identity {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.320114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.320307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] publish_errors = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.320538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.320705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.320705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.320705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.321253 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.11/identity {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.321253 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] publish_errors = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.321628 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.321814 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.322000 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.322194 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.322476 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] standard_threads = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.322706 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.322914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.323128 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.323326 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.323552 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.323721 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.323721 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] use_journal = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.324081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] standard_threads = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.324262 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] use_json = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.324556 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.325285 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] use_stderr = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.325469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.325603 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] use_syslog = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.325732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.325903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.326033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] use_journal = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.326033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] use_json = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.326291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.326426 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] use_stderr = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.326590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.326756 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] use_syslog = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.326892 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.327028 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:31:56.327182 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.327309 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.327471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.327706 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.327873 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.328024 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.328153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.328280 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.328412 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.328539 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.328745 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.328876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.329003 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.329130 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.329256 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.329383 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.329521 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.329651 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.329651 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.329909 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.330037 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.330163 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.330302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.330440 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.330579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.330708 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.330836 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.330980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.331151 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.331282 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.331409 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.331537 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.331676 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.331811 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.331947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.332075 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.332207 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.332334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.332460 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.332586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.332721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.332856 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.332983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.333116 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.333251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.333394 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.333530 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.333658 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.333784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.333911 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.334045 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.334172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.334306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.334439 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.334565 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.334697 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.334824 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.334987 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.335234 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.335378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.335511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.335645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.335773 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.335937 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.336189 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.336383 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.336521 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.336650 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.336776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.336902 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.337039 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.337169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.337306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.337441 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.337567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.337701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.337835 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.337968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.338096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.338221 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.338347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.338481 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.338608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.338734 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.338859 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.338985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.340591 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.340803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.340974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.341170 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.341359 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.341548 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.341735 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.341958 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.342122 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.342310 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.342497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.342685 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.342871 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.343115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.343307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.343651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.343850 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.344014 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.344203 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.344427 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.344590 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.344779 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.344967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.345154 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.345343 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.345510 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.345649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.345826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.345954 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.346114 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.346246 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.346383 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.346521 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.346656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.346828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.346971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.347177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.347308 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.347448 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.347577 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.347723 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.347858 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.348004 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.348240 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.348396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.348396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.348656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.348784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.349218 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.349346 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.349472 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.349608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.349737 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.349881 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.350009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.350136 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.350263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.350436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.350576 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.350704 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.350862 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.351028 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.351188 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.351326 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.351454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.351581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.351709 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.351846 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.351846 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.351846 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.352279 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.352406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.352533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.352659 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.352795 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.352924 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.353057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.353186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.353312 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.353439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.353574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.353715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.353841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.353976 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.354112 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.354251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.354387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.354515 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.354641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.354768 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.354901 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.355028 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.355256 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.355414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.355568 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.355759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.356366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.356506 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.356636 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.356764 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.356903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.357033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.357161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.357289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.357423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.357560 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.357698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.357827 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.357968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.358096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.358223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.358350 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.358487 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.358615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.358615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.358855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.358990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.359176 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.359318 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] auth.external = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.359446 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.359574 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.359708 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] auth.external = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.359708 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.359965 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.359965 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.360253 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.360392 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] auth.password = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.360520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.360648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] auth.token = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.360785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] auth.password = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.360921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.361055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] auth.token = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.361193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.361332 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.361462 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.361600 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.361735 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.361876 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.362006 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.362136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.362271 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.362400 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.362528 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.362664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.362793 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] credential.caching = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.362920 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.363106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.363256 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] credential.caching = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.363388 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.363540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.363677 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.363806 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.363941 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.364069 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.364198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.364334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.364463 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.364591 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.364719 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.364846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.364974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.365110 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.365251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.365380 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.365517 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.365647 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.365775 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.365916 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.366046 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.366173 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.366302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.366439 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.366568 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.366704 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.366833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.366961 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.367126 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] federation.caching = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.367258 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.367387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.367527 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] federation.caching = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.367657 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.367786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.367914 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.368042 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.368170 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.368378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.368518 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.368648 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.368784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.368926 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.368926 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.369177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.369306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.369435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.369564 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.369691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.369819 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.369963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.370092 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.370092 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.370333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.370461 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] identity.caching = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.370589 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] identity.caching = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.370738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.370877 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.371006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.371214 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.371363 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.371998 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.372153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.372285 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.372414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.372543 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.372673 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.372801 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.372938 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.373080 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.373209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.373337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.373465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.373594 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.373732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.373862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.373989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.374117 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.374245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.374382 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.374511 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.374639 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.374769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.374912 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.375073 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.375220 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.375350 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.375480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.375611 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.375748 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.375879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.376017 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.376146 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.376275 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.376402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.376530 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.376668 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.376807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.376943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.377072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.377201 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.377328 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.377328 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.377578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.377707 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.377835 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.377835 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.378079 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.378208 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.378345 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.378345 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.378608 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.378608 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.378850 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.378980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.379143 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.379275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.379403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.379538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.379668 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.379796 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.379932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.380063 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.380191 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.380331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.380459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.380587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.380728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.380858 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.380987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.381116 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.381244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.381371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.381517 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.381648 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.381775 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.381903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.382044 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.382173 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.382309 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.382438 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.382567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.382694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.382831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.382960 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.383119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.383254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.383383 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.383511 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.383639 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.383768 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.383916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.384045 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.384175 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.384303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.384430 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.384558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.user = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.384694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.user = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.384823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.384951 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.385079 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.385208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.385336 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.385473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.385613 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.385740 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.385867 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.385995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.386121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.386259 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.386389 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.386517 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.386645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.386773 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.386936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.387543 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.387688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.387819 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.387961 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.388091 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.388233 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.388365 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.388500 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.388630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.388758 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.388885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.389022 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.389152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.389280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.389410 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.389538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.389538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.389798 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.389798 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.390042 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.390042 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.390283 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.390410 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.390548 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.390677 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.390805 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.390934 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.391081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.391081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.391341 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.391577 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.391745 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.391745 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.391992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.391992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.392242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.392242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.392483 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.392483 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.392725 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.392852 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.392988 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.392988 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.393230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.393368 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.393497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.393497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.393748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.393748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.394028 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.394170 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.394305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.394305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.394660 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.394793 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.394922 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] resource.caching = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.395103 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] resource.caching = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.395239 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.395379 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.395520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.395520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.395764 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.395764 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.396004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.396131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.396272 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.396401 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.396530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.396658 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.396786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.396914 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.397051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.397190 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.397318 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.397446 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.397573 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] role.caching = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.397700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] role.caching = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.397837 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] role.driver = sql {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.397966 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] role.driver = sql {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.398094 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.398221 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.398348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.398476 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.398612 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.398743 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.398882 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.399010 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.399162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.399292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.399431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.399562 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.399690 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.399819 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.399947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.400075 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.400212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.400342 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.400469 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.400607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.400735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.400862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.401000 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.401130 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.401258 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.401386 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.401530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.401674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.401804 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.401933 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.402062 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.402190 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.402318 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.402464 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.402624 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.403304 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.403473 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.403606 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.403735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.403878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.404009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.404139 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.404268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.404397 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.404529 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.404668 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.404817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.404947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.405077 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.405206 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.405335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.405473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.405604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.405732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.405860 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.405989 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.406117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.406254 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.406385 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.406530 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.406660 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.406788 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.406916 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.407071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.407208 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.407337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.407465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] token.caching = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.407594 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] token.caching = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.407733 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.407871 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.408000 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.408129 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.408258 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.408396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.408533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.408663 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.408792 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.408919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.409047 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.409175 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.409313 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.409443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.409571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.409700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.409829 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.409958 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.410105 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.410234 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.410364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.410492 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.410628 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.410758 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.410896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.411026 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.411226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.411356 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.411487 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.411615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.411765 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.411896 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.412036 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.412165 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.412293 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] database.connection = **** {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.412431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] database.connection = **** {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.412578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.412718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.412848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.412986 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.413117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.413246 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.413375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.413511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.413641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.413778 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.413918 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.414047 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.414177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.414305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.414434 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.414572 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.414702 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.414830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.414959 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.415148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.415283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.415423 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.415553 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.415683 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.415826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.415999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.416137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.416345 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.416478 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.416607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.416738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.416867 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.416996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.417134 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.417265 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.417265 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 21:31:56.417510 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:31:56.417510 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 21:31:56.426489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.426679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.426818 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.426949 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.427175 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.427318 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.435667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.435834 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.465227 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.465584 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.465730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.465892 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.519137 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.519412 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.571095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.571095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.571554 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.571554 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.635570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.635866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.636012 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.636241 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.636384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.636517 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.636648 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.636780 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.637048 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.637234 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.637377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.637377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.659551 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.659825 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.659974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.660110 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.660246 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.660378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.660509 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.660651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.660784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.660916 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.661062 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.661194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.661194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.661194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.672374 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.672593 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.686967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.687299 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.687447 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.687581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.687716 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.687866 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.687999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.688142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.688278 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.688409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.688540 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.688672 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.688672 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.688672 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:31:56.705509 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.705804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 21:31:56.705896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.705979 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 21:31:56.706045 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.706243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 21:31:56.706330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.706470 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 21:31:56.706552 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.706696 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.706778 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.706936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.707022 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.707228 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.707328 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.707482 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.718331 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.718423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.718603 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.718688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.718862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.718944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.719157 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.719244 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.727507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.727859 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.730779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.731086 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.731172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.731368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.731468 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.731671 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.731755 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.732015 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.732098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.732274 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.732366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.732532 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.732612 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.732798 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.732882 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.733059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.733142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.733327 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.733411 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.733589 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.733681 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.733865 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.759787 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.760108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.761381 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.761663 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.761801 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.761999 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.767074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.767194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.767409 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.767513 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.767683 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.767764 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.774868 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.774982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.775094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.775164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.779856 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.779974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.780181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.780266 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.780467 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.780549 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.780712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.780792 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.780958 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.781048 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.781217 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.781296 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.781457 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.781538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.781721 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.781802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.800174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.800427 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.804616 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.804907 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.805044 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.808496 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.808800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.809707 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.813738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.817283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.820984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.821279 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.821533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.821841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.822061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.822215 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.822357 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.822497 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.827430 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.831385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.835093 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.835427 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.835710 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.835996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.836234 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.836511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.841806 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.842206 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.842433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.842720 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.851070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.852800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.853047 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.856170 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.856424 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.856741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.857023 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.857270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.860893 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.861298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.861553 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.861844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.869704 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.870546 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.870796 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.871079 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.871493 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.871696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.871847 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.871990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.872158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.872300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.875009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.875397 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.875546 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.875863 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.876148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.889728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.889987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.890154 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.890328 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.890548 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.890795 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.891107 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.891405 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.893358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.896670 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.898254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.899889 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.900138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.900446 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.907867 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.909462 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.909747 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.912674 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.912959 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.913182 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.913335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.913477 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.916333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.917929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.919723 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.920010 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.920294 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.922791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.923061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.923376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.928894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.931819 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.932027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.932177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.932319 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.932617 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.932863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.933149 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.933432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.933680 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.934078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.934272 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.934576 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.934790 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.935078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.935366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.937434 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.937729 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.938014 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.938290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.952590 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.952851 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.953153 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.961369 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:31:56.961623 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.961937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.962183 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.962485 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.962730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.963034 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.963341 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.963598 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.963901 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.964142 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.964424 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.964664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.964957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:31:56.974988 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557aa84439c0 pid: 86613 (default app) May 04 21:31:56.978530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa1632-eb79-45f4-a10d-9aa5ee047ea9 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:56.978821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa1632-eb79-45f4-a10d-9aa5ee047ea9 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:56.979094 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa1632-eb79-45f4-a10d-9aa5ee047ea9 None None] PATH_INFO: `/v3` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:56.985260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1/1] 10.222.0.11 () {50 vars in 791 bytes} [Wed May 4 21:31:56 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:31:57.004541 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557aa84439c0 pid: 86614 (default app) May 04 21:32:04.935918 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c27c07-7ed2-47fd-b760-a969ea760a85 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:04.936464 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c27c07-7ed2-47fd-b760-a969ea760a85 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:04.936464 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c27c07-7ed2-47fd-b760-a969ea760a85 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:04.937832 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 2/2] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:04.945445 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c64c0-100b-4d49-8219-9722a689d8a7 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:04.945899 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c64c0-100b-4d49-8219-9722a689d8a7 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:04.946057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c64c0-100b-4d49-8219-9722a689d8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:04.977543 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG oslo_db.sqlalchemy.engines [None req-974c64c0-100b-4d49-8219-9722a689d8a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 21:32:05.175079 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG passlib.handlers.bcrypt [None req-974c64c0-100b-4d49-8219-9722a689d8a7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86614) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 21:32:05.175507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG passlib.handlers.bcrypt [None req-974c64c0-100b-4d49-8219-9722a689d8a7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86614) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 21:32:05.230713 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-974c64c0-100b-4d49-8219-9722a689d8a7 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:05.232277 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-974c64c0-100b-4d49-8219-9722a689d8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:05.356510 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1/3] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 04 21:32:05.493913 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c27c07-7ed2-47fd-b760-a969ea760a85 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:05.529952 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG oslo_db.sqlalchemy.engines [None req-97c27c07-7ed2-47fd-b760-a969ea760a85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86613) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 21:32:05.657308 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c27c07-7ed2-47fd-b760-a969ea760a85 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:05.662102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd171a70-2226-43c7-9812-7bed57d306d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:05.662778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd171a70-2226-43c7-9812-7bed57d306d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:05.663059 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd171a70-2226-43c7-9812-7bed57d306d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:05.663390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd171a70-2226-43c7-9812-7bed57d306d2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:05.671868 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd171a70-2226-43c7-9812-7bed57d306d2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:05.722739 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fd171a70-2226-43c7-9812-7bed57d306d2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 21:32:05.723085 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd171a70-2226-43c7-9812-7bed57d306d2 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:05.733423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 3/4] 10.222.0.11 () {58 vars in 1324 bytes} [Wed May 4 21:32:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:32:05.739869 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c64c0-100b-4d49-8219-9722a689d8a7 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:05.754684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c64c0-100b-4d49-8219-9722a689d8a7 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:05.759311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116ad6c-571e-47b9-b5e7-2f6013f55125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:05.760475 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116ad6c-571e-47b9-b5e7-2f6013f55125 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:05.760770 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116ad6c-571e-47b9-b5e7-2f6013f55125 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:05.761059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116ad6c-571e-47b9-b5e7-2f6013f55125 admin admin] PATH_INFO: `/v3/projects/cf7f12f74dbe44d39ddca7448ef132f4` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:05.762791 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116ad6c-571e-47b9-b5e7-2f6013f55125 admin admin] RBAC: Authorizing `identity:get_project(project_id=cf7f12f74dbe44d39ddca7448ef132f4)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:05.812663 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3116ad6c-571e-47b9-b5e7-2f6013f55125 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 21:32:05.813006 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116ad6c-571e-47b9-b5e7-2f6013f55125 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:05.817649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 2/5] 10.222.0.11 () {56 vars in 1207 bytes} [Wed May 4 21:32:05 2022] GET /identity/v3/projects/cf7f12f74dbe44d39ddca7448ef132f4 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:08.014930 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77688be1-cab6-42f8-950a-a28ffe8ee750 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:08.015501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77688be1-cab6-42f8-950a-a28ffe8ee750 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:08.015588 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77688be1-cab6-42f8-950a-a28ffe8ee750 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:08.022174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 4/6] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:08 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:08.030336 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6c57f-3541-4ebc-bb9f-d50409fe9c68 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:08.030702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6c57f-3541-4ebc-bb9f-d50409fe9c68 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:08.030929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6c57f-3541-4ebc-bb9f-d50409fe9c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:08.051999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-06b6c57f-3541-4ebc-bb9f-d50409fe9c68 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:08.053527 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-06b6c57f-3541-4ebc-bb9f-d50409fe9c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:08.063390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 3/7] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 04 21:32:08.086344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77688be1-cab6-42f8-950a-a28ffe8ee750 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:08.101432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77688be1-cab6-42f8-950a-a28ffe8ee750 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:08.106012 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d4f70-e5f7-462f-b516-dc7d51386a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:08.106650 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d4f70-e5f7-462f-b516-dc7d51386a49 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:08.106936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d4f70-e5f7-462f-b516-dc7d51386a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:08.107244 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d4f70-e5f7-462f-b516-dc7d51386a49 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:08.115830 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d4f70-e5f7-462f-b516-dc7d51386a49 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:08.117571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d4f70-e5f7-462f-b516-dc7d51386a49 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:08.126694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 5/8] 10.222.0.11 () {58 vars in 1324 bytes} [Wed May 4 21:32:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:32:08.135210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6c57f-3541-4ebc-bb9f-d50409fe9c68 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:08.153356 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6c57f-3541-4ebc-bb9f-d50409fe9c68 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:08.159951 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20487d2a-e932-4a80-bbd7-27c5089ba37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:08.161264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20487d2a-e932-4a80-bbd7-27c5089ba37e admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:08.161655 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20487d2a-e932-4a80-bbd7-27c5089ba37e admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:08.162056 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20487d2a-e932-4a80-bbd7-27c5089ba37e admin admin] PATH_INFO: `/v3/users/8799b046633442a48a4bc8f6f80a2cb9` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:08.164561 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20487d2a-e932-4a80-bbd7-27c5089ba37e admin admin] RBAC: Authorizing `identity:get_user(user_id=8799b046633442a48a4bc8f6f80a2cb9)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:08.167550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20487d2a-e932-4a80-bbd7-27c5089ba37e admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:08.170002 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 4/9] 10.222.0.11 () {56 vars in 1198 bytes} [Wed May 4 21:32:08 2022] GET /identity/v3/users/8799b046633442a48a4bc8f6f80a2cb9 => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:10.454510 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300e432-cf19-430b-ba4d-478a481ff4c4 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:10.455064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300e432-cf19-430b-ba4d-478a481ff4c4 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:10.455064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300e432-cf19-430b-ba4d-478a481ff4c4 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:10.456444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 6/10] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:10.461745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412279e9-f2bc-487f-a967-31b91ca63282 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:10.462118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412279e9-f2bc-487f-a967-31b91ca63282 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:10.462298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412279e9-f2bc-487f-a967-31b91ca63282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:10.518964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860364e7-1c69-48c6-ab51-13b8e8149bbd None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:10.519381 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860364e7-1c69-48c6-ab51-13b8e8149bbd None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:10.519663 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860364e7-1c69-48c6-ab51-13b8e8149bbd None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:10.521023 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 7/11] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:10.526901 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2f0f8-0b06-4a16-973d-bf644457e29e None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:10.527225 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2f0f8-0b06-4a16-973d-bf644457e29e None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:10.527963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2f0f8-0b06-4a16-973d-bf644457e29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:10.570161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG passlib.handlers.bcrypt [None req-eac2f0f8-0b06-4a16-973d-bf644457e29e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86613) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 21:32:10.570559 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG passlib.handlers.bcrypt [None req-eac2f0f8-0b06-4a16-973d-bf644457e29e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86613) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 21:32:10.590692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-412279e9-f2bc-487f-a967-31b91ca63282 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:10.591906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-412279e9-f2bc-487f-a967-31b91ca63282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:10.618883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-eac2f0f8-0b06-4a16-973d-bf644457e29e None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:10.620601 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-eac2f0f8-0b06-4a16-973d-bf644457e29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:10.671241 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 5/12] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:10.693994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412279e9-f2bc-487f-a967-31b91ca63282 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:10.719728 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 8/13] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:10.742044 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2f0f8-0b06-4a16-973d-bf644457e29e None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:10.792561 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412279e9-f2bc-487f-a967-31b91ca63282 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:10.825614 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85d1de-0a22-4a07-8c39-771197bbf3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:10.826420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85d1de-0a22-4a07-8c39-771197bbf3d8 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:10.826704 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85d1de-0a22-4a07-8c39-771197bbf3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:10.826977 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85d1de-0a22-4a07-8c39-771197bbf3d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:10.837843 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85d1de-0a22-4a07-8c39-771197bbf3d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:10.837965 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2f0f8-0b06-4a16-973d-bf644457e29e None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:10.849248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-ca85d1de-0a22-4a07-8c39-771197bbf3d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:32:10.849248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:10.849248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:10.849248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:10.849248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:10.849248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:10.849248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:10.849248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:10.849248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:10.849248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:10.849248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:10.849248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:10.849248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:10.849248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:10.849248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:10.849248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:10.850250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:10.850250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:10.850250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:10.850250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:10.850250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:10.850250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:10.850250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:10.850250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:10.850250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:10.850250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:10.850250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:10.850250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:32:10.850250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:10.850250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:10.850250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:10.850250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:10.851089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:10.851089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:10.851089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:10.851089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:10.851089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:10.851089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:10.851089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:10.851089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:10.851089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:10.851089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:10.851089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:32:10.851089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:32:10.851089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 6/14] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:32:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:32:10.856570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85d1de-0a22-4a07-8c39-771197bbf3d8 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:10.872896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a1029-9b29-47ec-8472-97911d94ef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:10.873789 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a1029-9b29-47ec-8472-97911d94ef35 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:10.874074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a1029-9b29-47ec-8472-97911d94ef35 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:10.874349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a1029-9b29-47ec-8472-97911d94ef35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:10.937549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a1029-9b29-47ec-8472-97911d94ef35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:10.939096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a1029-9b29-47ec-8472-97911d94ef35 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:10.952588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85d1de-0a22-4a07-8c39-771197bbf3d8 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:10.986625 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e1ca9-64f4-40f6-8e3a-0d48ff444ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:10.987251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e1ca9-64f4-40f6-8e3a-0d48ff444ef4 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:10.987534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e1ca9-64f4-40f6-8e3a-0d48ff444ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:10.987823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e1ca9-64f4-40f6-8e3a-0d48ff444ef4 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:10.988575 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e1ca9-64f4-40f6-8e3a-0d48ff444ef4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:10.988880 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e1ca9-64f4-40f6-8e3a-0d48ff444ef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:10.990265 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e1ca9-64f4-40f6-8e3a-0d48ff444ef4 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:11.001989 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 7/15] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:11.008325 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e1ca9-64f4-40f6-8e3a-0d48ff444ef4 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:11.034412 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 9/16] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:32:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 21:32:11.039917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a1029-9b29-47ec-8472-97911d94ef35 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:11.108708 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e1ca9-64f4-40f6-8e3a-0d48ff444ef4 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:11.142739 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f13ab0-22a7-4f64-b0d1-c29d795921d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:11.143215 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a1029-9b29-47ec-8472-97911d94ef35 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:11.143635 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f13ab0-22a7-4f64-b0d1-c29d795921d4 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:11.143900 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f13ab0-22a7-4f64-b0d1-c29d795921d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:11.144174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f13ab0-22a7-4f64-b0d1-c29d795921d4 None admin] PATH_INFO: `/v3/users/8799b046633442a48a4bc8f6f80a2cb9` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:11.145379 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f13ab0-22a7-4f64-b0d1-c29d795921d4 None admin] RBAC: Authorizing `identity:get_user(user_id=8799b046633442a48a4bc8f6f80a2cb9)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:11.146829 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f13ab0-22a7-4f64-b0d1-c29d795921d4 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:11.148475 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 8/17] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:11 2022] GET /identity/v3/users/8799b046633442a48a4bc8f6f80a2cb9 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:11.154242 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f13ab0-22a7-4f64-b0d1-c29d795921d4 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:11.175575 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda812e-446f-40b1-829f-9d19bc2b71e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:11.176382 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda812e-446f-40b1-829f-9d19bc2b71e0 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:11.176664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda812e-446f-40b1-829f-9d19bc2b71e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:11.176935 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda812e-446f-40b1-829f-9d19bc2b71e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:11.256070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f13ab0-22a7-4f64-b0d1-c29d795921d4 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:11.292810 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3a330-d07a-4e6c-89ad-4c307bb3f94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:11.293946 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3a330-d07a-4e6c-89ad-4c307bb3f94f None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:11.294231 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3a330-d07a-4e6c-89ad-4c307bb3f94f None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:11.294509 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3a330-d07a-4e6c-89ad-4c307bb3f94f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:11.295762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3a330-d07a-4e6c-89ad-4c307bb3f94f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:11.297231 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3a330-d07a-4e6c-89ad-4c307bb3f94f None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:11.298822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 9/18] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:32:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:11.304631 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3a330-d07a-4e6c-89ad-4c307bb3f94f None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:11.305561 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda812e-446f-40b1-829f-9d19bc2b71e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:11.307069 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda812e-446f-40b1-829f-9d19bc2b71e0 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:11.328106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-7dda812e-446f-40b1-829f-9d19bc2b71e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:32:11.328106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:11.328106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:11.328106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:11.328106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:11.328106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:11.328106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:11.328106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:11.328106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:11.328106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:11.328106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:11.328106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:11.328106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:32:11.328106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:32:11.328106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:32:11.329054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:32:11.329054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:11.329054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:11.329054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:11.329054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:11.329054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:11.329054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:11.329054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:11.329054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:32:11.329054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:11.329054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:11.329054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:11.329054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:11.329054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:11.329054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:11.329054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:11.329054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:11.329977 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:32:11.329977 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:32:11.329977 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:32:11.329977 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:32:11.329977 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 10/19] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:32:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:11.335342 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda812e-446f-40b1-829f-9d19bc2b71e0 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:11.403506 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3a330-d07a-4e6c-89ad-4c307bb3f94f None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:11.433500 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda812e-446f-40b1-829f-9d19bc2b71e0 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:11.436884 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121dc747-c443-4095-a05d-e6171f65b6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:11.437545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dc747-c443-4095-a05d-e6171f65b6c3 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:11.437828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dc747-c443-4095-a05d-e6171f65b6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:11.438103 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dc747-c443-4095-a05d-e6171f65b6c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:11.438938 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121dc747-c443-4095-a05d-e6171f65b6c3 None admin] RBAC: Adding query filter params (role.id=59778f07f0504e90a60212f460e8c774, scope.domain.id=default, user.id=8799b046633442a48a4bc8f6f80a2cb9) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:11.439279 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121dc747-c443-4095-a05d-e6171f65b6c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:11.440687 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121dc747-c443-4095-a05d-e6171f65b6c3 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:11.447195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 10/20] 10.222.0.11 () {56 vars in 1322 bytes} [Wed May 4 21:32:11 2022] GET /identity/v3/role_assignments?user.id=8799b046633442a48a4bc8f6f80a2cb9&scope.domain.id=default&role.id=59778f07f0504e90a60212f460e8c774 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:11.469278 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d68a80-a8c3-4402-a7be-61b3036a7305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:11.469960 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d68a80-a8c3-4402-a7be-61b3036a7305 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:11.470247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d68a80-a8c3-4402-a7be-61b3036a7305 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:11.470524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d68a80-a8c3-4402-a7be-61b3036a7305 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:11.471300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d68a80-a8c3-4402-a7be-61b3036a7305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:11.471605 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d68a80-a8c3-4402-a7be-61b3036a7305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:11.473043 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d68a80-a8c3-4402-a7be-61b3036a7305 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:11.492850 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 11/21] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:14.029124 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f5d08-da72-43c2-af54-867ccfdadb69 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:14.029660 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f5d08-da72-43c2-af54-867ccfdadb69 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:14.029660 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f5d08-da72-43c2-af54-867ccfdadb69 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:14.031348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 11/22] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:14.041189 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba3af5-16ad-4e87-bb5d-f3bf0bb600e2 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:14.041651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba3af5-16ad-4e87-bb5d-f3bf0bb600e2 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:14.041741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba3af5-16ad-4e87-bb5d-f3bf0bb600e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:14.064208 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-81ba3af5-16ad-4e87-bb5d-f3bf0bb600e2 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:14.065420 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-81ba3af5-16ad-4e87-bb5d-f3bf0bb600e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:14.086587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc766da-ad4f-497b-9089-cdf38df51fda None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:14.086875 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc766da-ad4f-497b-9089-cdf38df51fda None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:14.087174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc766da-ad4f-497b-9089-cdf38df51fda None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:14.088781 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 12/23] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:14.094434 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfa74e-7557-43eb-818e-0c1f3e4c3774 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:14.094714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfa74e-7557-43eb-818e-0c1f3e4c3774 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:14.094997 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfa74e-7557-43eb-818e-0c1f3e4c3774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:14.132839 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-83bfa74e-7557-43eb-818e-0c1f3e4c3774 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:14.134870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-83bfa74e-7557-43eb-818e-0c1f3e4c3774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:14.152659 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 12/24] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:14.225261 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba3af5-16ad-4e87-bb5d-f3bf0bb600e2 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:14.253433 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 13/25] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:32:14.291522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfa74e-7557-43eb-818e-0c1f3e4c3774 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:14.344783 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba3af5-16ad-4e87-bb5d-f3bf0bb600e2 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:14.382988 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902773f-abef-4dd8-a1ff-47fab4679014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:14.384148 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902773f-abef-4dd8-a1ff-47fab4679014 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:14.384603 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902773f-abef-4dd8-a1ff-47fab4679014 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:14.385042 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902773f-abef-4dd8-a1ff-47fab4679014 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:14.396924 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902773f-abef-4dd8-a1ff-47fab4679014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:14.406362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-a902773f-abef-4dd8-a1ff-47fab4679014 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:32:14.406362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:14.406362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:14.406362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:14.406362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:14.406362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:14.406362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:14.406362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:14.406362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:14.406362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:14.406362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:14.406362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:14.406362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:14.406362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:14.406362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:14.406362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:14.407249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:14.407249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:14.407249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:14.407249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:14.407249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:14.407249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:14.407249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:14.407249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:14.407249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:14.407249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:14.407249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:14.407249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:32:14.407249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:14.407249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:14.407249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:14.407249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:14.408006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:14.408006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:14.408006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:14.408006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:14.408006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:14.408006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:14.408006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:14.408006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:14.408006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:14.408006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:14.408006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:32:14.408006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:32:14.410679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 13/26] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:32:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:14.434959 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902773f-abef-4dd8-a1ff-47fab4679014 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:14.441624 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfa74e-7557-43eb-818e-0c1f3e4c3774 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:14.482555 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55275f-4cc1-414c-bee8-06b48f3d219d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:14.483399 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55275f-4cc1-414c-bee8-06b48f3d219d None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:14.483691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55275f-4cc1-414c-bee8-06b48f3d219d None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:14.483974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55275f-4cc1-414c-bee8-06b48f3d219d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:14.501368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55275f-4cc1-414c-bee8-06b48f3d219d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:14.502860 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55275f-4cc1-414c-bee8-06b48f3d219d None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:14.530742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-0d55275f-4cc1-414c-bee8-06b48f3d219d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:32:14.530742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:14.530742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:14.530742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:14.530742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:14.530742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:14.530742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:14.530742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:14.530742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:14.530742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:14.530742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:14.530742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:14.530742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:32:14.530742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:32:14.530742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:32:14.531649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:32:14.531649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:14.531649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:14.531649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:14.531649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:14.531649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:14.531649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:14.531649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:14.531649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:32:14.531649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:14.531649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:14.531649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:14.531649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:14.531649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:14.531649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:14.531649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:14.531649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:14.532443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:32:14.532443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:32:14.532443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:32:14.532443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:32:14.536184 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 14/27] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:32:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:14.537606 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11023cb0-5a19-48c2-811d-f41db711a475 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:14.537897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11023cb0-5a19-48c2-811d-f41db711a475 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:14.538185 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11023cb0-5a19-48c2-811d-f41db711a475 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:14.539488 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 15/28] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:14.543579 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902773f-abef-4dd8-a1ff-47fab4679014 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:14.544828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0469e7-5c3a-4bb5-a17a-684e78d2e13f None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:14.545189 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0469e7-5c3a-4bb5-a17a-684e78d2e13f None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:14.545481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0469e7-5c3a-4bb5-a17a-684e78d2e13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:14.578938 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cff8b6-5c8f-4b31-a6b4-d35c20e21a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:14.579974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cff8b6-5c8f-4b31-a6b4-d35c20e21a53 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:14.580476 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cff8b6-5c8f-4b31-a6b4-d35c20e21a53 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:14.580936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cff8b6-5c8f-4b31-a6b4-d35c20e21a53 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:14.581872 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cff8b6-5c8f-4b31-a6b4-d35c20e21a53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:14.582364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cff8b6-5c8f-4b31-a6b4-d35c20e21a53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:14.582524 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-2c0469e7-5c3a-4bb5-a17a-684e78d2e13f None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:14.583770 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-2c0469e7-5c3a-4bb5-a17a-684e78d2e13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:14.584359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cff8b6-5c8f-4b31-a6b4-d35c20e21a53 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:14.598196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 14/29] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:14.599710 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cff8b6-5c8f-4b31-a6b4-d35c20e21a53 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:14.695652 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cff8b6-5c8f-4b31-a6b4-d35c20e21a53 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:14.731285 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07c5bc-6a0e-45b5-b235-d643fdae7d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:14.732299 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07c5bc-6a0e-45b5-b235-d643fdae7d7b None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:14.732515 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 16/30] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:32:14.733183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07c5bc-6a0e-45b5-b235-d643fdae7d7b None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:14.733392 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0469e7-5c3a-4bb5-a17a-684e78d2e13f None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:14.733950 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07c5bc-6a0e-45b5-b235-d643fdae7d7b None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:14.734863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07c5bc-6a0e-45b5-b235-d643fdae7d7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:14.735380 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07c5bc-6a0e-45b5-b235-d643fdae7d7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:14.736963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07c5bc-6a0e-45b5-b235-d643fdae7d7b None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:14.748936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 15/31] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:14.760229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07c5bc-6a0e-45b5-b235-d643fdae7d7b None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:14.875425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07c5bc-6a0e-45b5-b235-d643fdae7d7b None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:14.915405 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0469e7-5c3a-4bb5-a17a-684e78d2e13f None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:14.917329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0ae52-10f5-4ee1-aedc-17bbff2d214f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:14.918170 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0ae52-10f5-4ee1-aedc-17bbff2d214f None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:14.918457 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0ae52-10f5-4ee1-aedc-17bbff2d214f None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:14.918738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0ae52-10f5-4ee1-aedc-17bbff2d214f None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:14.919769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0ae52-10f5-4ee1-aedc-17bbff2d214f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:14.921243 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0ae52-10f5-4ee1-aedc-17bbff2d214f None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:14.965161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e49c5-8544-4e37-9907-e6a44423be5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:14.966073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e49c5-8544-4e37-9907-e6a44423be5a None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:14.966357 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e49c5-8544-4e37-9907-e6a44423be5a None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:14.966631 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e49c5-8544-4e37-9907-e6a44423be5a None admin] PATH_INFO: `/v3/users/8799b046633442a48a4bc8f6f80a2cb9` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:14.971836 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e49c5-8544-4e37-9907-e6a44423be5a None admin] RBAC: Authorizing `identity:get_user(user_id=8799b046633442a48a4bc8f6f80a2cb9)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:14.973323 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e49c5-8544-4e37-9907-e6a44423be5a None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:14.975531 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 17/32] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:14 2022] GET /identity/v3/users/8799b046633442a48a4bc8f6f80a2cb9 => generated 247 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:14.976186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e49c5-8544-4e37-9907-e6a44423be5a None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:15.080420 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 16/33] 10.222.0.11 () {60 vars in 1141 bytes} [Wed May 4 21:32:14 2022] POST /identity/v3/projects => generated 301 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:32:15.081578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0ae52-10f5-4ee1-aedc-17bbff2d214f None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:15.096838 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e49c5-8544-4e37-9907-e6a44423be5a None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:15.133797 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf15de5-3321-442a-a41e-09bf30442e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:15.134652 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf15de5-3321-442a-a41e-09bf30442e5e None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:15.134933 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf15de5-3321-442a-a41e-09bf30442e5e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:15.135335 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf15de5-3321-442a-a41e-09bf30442e5e None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:15.136301 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf15de5-3321-442a-a41e-09bf30442e5e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:15.138569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf15de5-3321-442a-a41e-09bf30442e5e None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:15.200601 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0ae52-10f5-4ee1-aedc-17bbff2d214f None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:15.236050 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f886bd-8eb1-4406-b78b-a9b78d54f709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:15.237144 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f886bd-8eb1-4406-b78b-a9b78d54f709 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:15.237573 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f886bd-8eb1-4406-b78b-a9b78d54f709 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:15.237984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f886bd-8eb1-4406-b78b-a9b78d54f709 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:15.239541 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f886bd-8eb1-4406-b78b-a9b78d54f709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:15.241455 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f886bd-8eb1-4406-b78b-a9b78d54f709 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:15.243488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 17/34] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:32:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:15.245182 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cd9b2-d667-4d3f-8173-8648916763c9 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:15.245660 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cd9b2-d667-4d3f-8173-8648916763c9 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:15.246208 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cd9b2-d667-4d3f-8173-8648916763c9 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:15.247819 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 18/35] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:15.249119 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789cd9b2-d667-4d3f-8173-8648916763c9 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:15.305705 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 18/36] 10.222.0.11 () {60 vars in 1131 bytes} [Wed May 4 21:32:14 2022] POST /identity/v3/roles => generated 219 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:32:15.307292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a9532-9d2a-41ac-ae3d-b13b5bc39d8f None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:15.307580 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a9532-9d2a-41ac-ae3d-b13b5bc39d8f None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:15.307890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a9532-9d2a-41ac-ae3d-b13b5bc39d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:15.344056 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-f31a9532-9d2a-41ac-ae3d-b13b5bc39d8f None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:15.346301 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f31a9532-9d2a-41ac-ae3d-b13b5bc39d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:15.442518 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789cd9b2-d667-4d3f-8173-8648916763c9 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:15.495856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 19/37] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:15.511218 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2ba73-305f-4334-84ed-b5e498b522c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:15.512570 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2ba73-305f-4334-84ed-b5e498b522c6 None admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:15.513081 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2ba73-305f-4334-84ed-b5e498b522c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:15.513606 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2ba73-305f-4334-84ed-b5e498b522c6 None admin] PATH_INFO: `/v3/domains/default/users/8799b046633442a48a4bc8f6f80a2cb9/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:15.517281 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2ba73-305f-4334-84ed-b5e498b522c6 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8799b046633442a48a4bc8f6f80a2cb9, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:15.520955 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2ba73-305f-4334-84ed-b5e498b522c6 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:15.521892 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a9532-9d2a-41ac-ae3d-b13b5bc39d8f None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:15.553511 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 19/38] 10.222.0.11 () {58 vars in 1361 bytes} [Wed May 4 21:32:15 2022] PUT /identity/v3/domains/default/users/8799b046633442a48a4bc8f6f80a2cb9/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:32:15.594020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e419eb6-9cde-404c-8aa5-af81e61fd450 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:15.594328 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e419eb6-9cde-404c-8aa5-af81e61fd450 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:15.594589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e419eb6-9cde-404c-8aa5-af81e61fd450 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:15.596322 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 20/39] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:15.602301 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781bcb9-bb68-4b5a-af86-8f4783ad97cc None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:15.602583 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781bcb9-bb68-4b5a-af86-8f4783ad97cc None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:15.602865 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781bcb9-bb68-4b5a-af86-8f4783ad97cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:15.630107 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-2781bcb9-bb68-4b5a-af86-8f4783ad97cc None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:15.631723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-2781bcb9-bb68-4b5a-af86-8f4783ad97cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:15.643882 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a9532-9d2a-41ac-ae3d-b13b5bc39d8f None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:15.682925 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e64f3-c4c4-4ac8-be01-11998a40a027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:15.684104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e64f3-c4c4-4ac8-be01-11998a40a027 None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:15.684632 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e64f3-c4c4-4ac8-be01-11998a40a027 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:15.685112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e64f3-c4c4-4ac8-be01-11998a40a027 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:15.686080 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e64f3-c4c4-4ac8-be01-11998a40a027 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:15.687942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e64f3-c4c4-4ac8-be01-11998a40a027 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:15.706092 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 20/40] 10.222.0.11 () {60 vars in 1131 bytes} [Wed May 4 21:32:15 2022] POST /identity/v3/roles => generated 225 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:32:15.722234 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 21/41] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:32:15.748803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e64f3-c4c4-4ac8-be01-11998a40a027 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:15.866500 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e64f3-c4c4-4ac8-be01-11998a40a027 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:15.904437 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59564320-95c0-4132-a78b-b2b302fad82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:15.905660 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59564320-95c0-4132-a78b-b2b302fad82e None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:15.906141 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59564320-95c0-4132-a78b-b2b302fad82e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:15.906631 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59564320-95c0-4132-a78b-b2b302fad82e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:15.908205 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59564320-95c0-4132-a78b-b2b302fad82e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:15.909888 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59564320-95c0-4132-a78b-b2b302fad82e None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:15.911805 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 21/42] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:32:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:15.917643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781bcb9-bb68-4b5a-af86-8f4783ad97cc None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:16.015380 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781bcb9-bb68-4b5a-af86-8f4783ad97cc None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:16.044533 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dea8da-3417-4894-b145-813c5e34f9fc None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:16.045091 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dea8da-3417-4894-b145-813c5e34f9fc None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:16.045558 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dea8da-3417-4894-b145-813c5e34f9fc None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:16.047143 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 22/43] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:32:16.048608 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269b648-4a15-4077-ba2c-a7284849ab85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:16.049432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269b648-4a15-4077-ba2c-a7284849ab85 None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:16.049962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269b648-4a15-4077-ba2c-a7284849ab85 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:16.050379 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269b648-4a15-4077-ba2c-a7284849ab85 None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:16.051344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269b648-4a15-4077-ba2c-a7284849ab85 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:16.052515 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d118c1c-d980-46db-a7f1-a6af4c0db3d9 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:16.052810 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d118c1c-d980-46db-a7f1-a6af4c0db3d9 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:16.053130 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d118c1c-d980-46db-a7f1-a6af4c0db3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:16.053593 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269b648-4a15-4077-ba2c-a7284849ab85 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:16.071351 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-7d118c1c-d980-46db-a7f1-a6af4c0db3d9 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:16.072675 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-7d118c1c-d980-46db-a7f1-a6af4c0db3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:16.080365 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 22/44] 10.222.0.11 () {60 vars in 1141 bytes} [Wed May 4 21:32:15 2022] POST /identity/v3/projects => generated 312 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:32:16.142438 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 23/45] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:32:16.165115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269b648-4a15-4077-ba2c-a7284849ab85 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:16.268064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269b648-4a15-4077-ba2c-a7284849ab85 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:16.303234 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4208842-62bf-4f7b-bda8-660e962b5cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:16.303902 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4208842-62bf-4f7b-bda8-660e962b5cd3 None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:16.304190 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4208842-62bf-4f7b-bda8-660e962b5cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:16.304462 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4208842-62bf-4f7b-bda8-660e962b5cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:16.305202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4208842-62bf-4f7b-bda8-660e962b5cd3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:16.306596 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4208842-62bf-4f7b-bda8-660e962b5cd3 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:16.321443 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 23/46] 10.222.0.11 () {60 vars in 1131 bytes} [Wed May 4 21:32:16 2022] POST /identity/v3/roles => generated 223 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:32:18.055315 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6192eb-09f5-4270-99f6-ee63308ac351 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:18.055315 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6192eb-09f5-4270-99f6-ee63308ac351 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:18.056573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6192eb-09f5-4270-99f6-ee63308ac351 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:18.058021 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 24/47] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:18.063983 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71754529-00d7-4d76-b878-7ce499c58df5 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:18.064430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71754529-00d7-4d76-b878-7ce499c58df5 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:18.064583 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71754529-00d7-4d76-b878-7ce499c58df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:18.083374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-71754529-00d7-4d76-b878-7ce499c58df5 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:18.084579 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-71754529-00d7-4d76-b878-7ce499c58df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:18.153800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 24/48] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:18.177057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6192eb-09f5-4270-99f6-ee63308ac351 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:18.279244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6192eb-09f5-4270-99f6-ee63308ac351 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:18.315443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca2eb8-b7d1-4b53-85fe-79eab5ce8613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:18.316205 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca2eb8-b7d1-4b53-85fe-79eab5ce8613 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:18.316495 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca2eb8-b7d1-4b53-85fe-79eab5ce8613 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:18.316776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca2eb8-b7d1-4b53-85fe-79eab5ce8613 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:18.328872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca2eb8-b7d1-4b53-85fe-79eab5ce8613 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:18.336714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-48ca2eb8-b7d1-4b53-85fe-79eab5ce8613 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:32:18.336714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:18.336714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:18.336714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:18.336714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:18.336714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:18.336714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:18.336714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:18.336714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:18.336714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:18.336714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:18.336714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:18.336714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:18.336714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:18.336714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:18.336714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:18.337650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:18.337650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:18.337650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:18.337650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:18.337650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:18.337650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:18.337650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:18.337650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:18.337650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:18.337650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:18.337650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:18.337650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:32:18.337650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:18.337650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:18.337650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:18.337650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:18.338422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:18.338422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:18.338422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:18.338422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:18.338422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:18.338422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:18.338422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:18.338422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:18.338422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:18.338422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:18.338422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:32:18.338422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:32:18.338422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 25/49] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:32:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:18.345797 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71754529-00d7-4d76-b878-7ce499c58df5 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:18.440644 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71754529-00d7-4d76-b878-7ce499c58df5 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:18.474327 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392aa71-0fe9-4997-8973-b6c804e63fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:18.475015 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392aa71-0fe9-4997-8973-b6c804e63fee None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:18.475345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392aa71-0fe9-4997-8973-b6c804e63fee None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:18.475628 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392aa71-0fe9-4997-8973-b6c804e63fee None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:18.476390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392aa71-0fe9-4997-8973-b6c804e63fee None admin] RBAC: Adding query filter params (name=admin) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:18.476700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392aa71-0fe9-4997-8973-b6c804e63fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:18.478097 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392aa71-0fe9-4997-8973-b6c804e63fee None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:18.486918 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 25/50] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:18.492423 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca2eb8-b7d1-4b53-85fe-79eab5ce8613 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:18.494245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75618d99-4b00-4603-bc1e-2a8f63457b79 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:18.494538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75618d99-4b00-4603-bc1e-2a8f63457b79 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:18.494824 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75618d99-4b00-4603-bc1e-2a8f63457b79 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:18.496617 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 26/51] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:32:18.501496 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e15e22-6492-4644-9975-69c11028c383 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:18.501791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e15e22-6492-4644-9975-69c11028c383 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:18.502074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e15e22-6492-4644-9975-69c11028c383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:18.519197 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-f2e15e22-6492-4644-9975-69c11028c383 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:18.520468 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-f2e15e22-6492-4644-9975-69c11028c383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:18.592706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 27/52] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:32:18.603962 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca2eb8-b7d1-4b53-85fe-79eab5ce8613 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:18.616121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e15e22-6492-4644-9975-69c11028c383 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:18.637774 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91716a91-f7de-4a54-9275-661082871379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:18.638657 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91716a91-f7de-4a54-9275-661082871379 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:18.638946 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91716a91-f7de-4a54-9275-661082871379 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:18.639256 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91716a91-f7de-4a54-9275-661082871379 None admin] PATH_INFO: `/v3/users/8799b046633442a48a4bc8f6f80a2cb9` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:18.640474 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91716a91-f7de-4a54-9275-661082871379 None admin] RBAC: Authorizing `identity:get_user(user_id=8799b046633442a48a4bc8f6f80a2cb9)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:18.641931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91716a91-f7de-4a54-9275-661082871379 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:18.643615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 26/53] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:18 2022] GET /identity/v3/users/8799b046633442a48a4bc8f6f80a2cb9 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:18.649038 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91716a91-f7de-4a54-9275-661082871379 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:18.716946 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e15e22-6492-4644-9975-69c11028c383 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:18.752602 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91716a91-f7de-4a54-9275-661082871379 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:18.754178 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee0a3b-cc8e-4e77-9861-58f4772cd079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:18.755838 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee0a3b-cc8e-4e77-9861-58f4772cd079 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:18.756131 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee0a3b-cc8e-4e77-9861-58f4772cd079 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:18.756428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee0a3b-cc8e-4e77-9861-58f4772cd079 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:18.757626 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee0a3b-cc8e-4e77-9861-58f4772cd079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:18.759116 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee0a3b-cc8e-4e77-9861-58f4772cd079 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:18.763109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 28/54] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:32:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:18.766477 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee0a3b-cc8e-4e77-9861-58f4772cd079 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:18.787347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf5d5f-ac8b-43aa-88bd-07df652b8b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:18.788465 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf5d5f-ac8b-43aa-88bd-07df652b8b8a None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:18.788926 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf5d5f-ac8b-43aa-88bd-07df652b8b8a None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:18.789345 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf5d5f-ac8b-43aa-88bd-07df652b8b8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:18.791374 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf5d5f-ac8b-43aa-88bd-07df652b8b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:18.792937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf5d5f-ac8b-43aa-88bd-07df652b8b8a None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:18.794615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 27/55] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:32:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:18.800331 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf5d5f-ac8b-43aa-88bd-07df652b8b8a None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:18.867611 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee0a3b-cc8e-4e77-9861-58f4772cd079 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:18.902056 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf5d5f-ac8b-43aa-88bd-07df652b8b8a None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:18.902983 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac0ad2-69ad-488f-9424-7bd375662083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:18.903756 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac0ad2-69ad-488f-9424-7bd375662083 None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:18.903962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac0ad2-69ad-488f-9424-7bd375662083 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:18.904244 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac0ad2-69ad-488f-9424-7bd375662083 None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:18.904969 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac0ad2-69ad-488f-9424-7bd375662083 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:18.906499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac0ad2-69ad-488f-9424-7bd375662083 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:18.932256 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 29/56] 10.222.0.11 () {60 vars in 1140 bytes} [Wed May 4 21:32:18 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:32:18.938552 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d68290-3f4d-4404-be96-88d1e95b34d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:18.939354 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d68290-3f4d-4404-be96-88d1e95b34d4 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:18.939646 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d68290-3f4d-4404-be96-88d1e95b34d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:18.939943 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d68290-3f4d-4404-be96-88d1e95b34d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:18.940800 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d68290-3f4d-4404-be96-88d1e95b34d4 None admin] RBAC: Adding query filter params (role.id=59778f07f0504e90a60212f460e8c774, scope.domain.id=default, user.id=8799b046633442a48a4bc8f6f80a2cb9) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:18.941127 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d68290-3f4d-4404-be96-88d1e95b34d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:18.942647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d68290-3f4d-4404-be96-88d1e95b34d4 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:18.949789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 28/57] 10.222.0.11 () {56 vars in 1322 bytes} [Wed May 4 21:32:18 2022] GET /identity/v3/role_assignments?user.id=8799b046633442a48a4bc8f6f80a2cb9&scope.domain.id=default&role.id=59778f07f0504e90a60212f460e8c774 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:21.404240 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e389081-0c1a-4742-9cec-65afe57f63a5 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:21.404760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e389081-0c1a-4742-9cec-65afe57f63a5 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:21.404760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e389081-0c1a-4742-9cec-65afe57f63a5 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:21.406183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 30/58] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:21.411629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be6af6-768a-432b-a1c6-721565ee8973 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:21.412049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be6af6-768a-432b-a1c6-721565ee8973 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:21.412203 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be6af6-768a-432b-a1c6-721565ee8973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:21.437063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-20be6af6-768a-432b-a1c6-721565ee8973 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:21.438262 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-20be6af6-768a-432b-a1c6-721565ee8973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:21.504893 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 29/59] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:21.529966 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e389081-0c1a-4742-9cec-65afe57f63a5 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:21.639488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e389081-0c1a-4742-9cec-65afe57f63a5 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:21.673478 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57585b87-905c-4190-8804-59811e3704cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:21.674313 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57585b87-905c-4190-8804-59811e3704cc None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:21.674617 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57585b87-905c-4190-8804-59811e3704cc None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:21.674892 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57585b87-905c-4190-8804-59811e3704cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:21.676117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57585b87-905c-4190-8804-59811e3704cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:21.677585 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57585b87-905c-4190-8804-59811e3704cc None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:21.679253 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 31/60] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:32:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:21.685674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be6af6-768a-432b-a1c6-721565ee8973 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:21.784093 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be6af6-768a-432b-a1c6-721565ee8973 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:21.818441 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ddfd2-25a9-4d04-a9f0-2f62f6122833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:21.819157 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ddfd2-25a9-4d04-a9f0-2f62f6122833 None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:21.819440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ddfd2-25a9-4d04-a9f0-2f62f6122833 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:21.819717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ddfd2-25a9-4d04-a9f0-2f62f6122833 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:21.820445 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ddfd2-25a9-4d04-a9f0-2f62f6122833 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:21.821880 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ddfd2-25a9-4d04-a9f0-2f62f6122833 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:21.847903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 30/61] 10.222.0.11 () {60 vars in 1132 bytes} [Wed May 4 21:32:21 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:32:25.491820 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f6175-0f78-4341-92e1-299321f35caf None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:25.492367 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f6175-0f78-4341-92e1-299321f35caf None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:25.492367 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f6175-0f78-4341-92e1-299321f35caf None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:25.493758 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 32/62] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:25.503622 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bab4e-3898-495c-b198-dcfca00c4fc7 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:25.503622 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bab4e-3898-495c-b198-dcfca00c4fc7 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:25.503622 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bab4e-3898-495c-b198-dcfca00c4fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:25.528330 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-914bab4e-3898-495c-b198-dcfca00c4fc7 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:25.529842 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-914bab4e-3898-495c-b198-dcfca00c4fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:25.673627 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 31/63] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:25.716205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f6175-0f78-4341-92e1-299321f35caf None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:25.939999 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f6175-0f78-4341-92e1-299321f35caf None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:26.016970 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2df5b2-a4b9-4503-b891-90bd1ea4fde1 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:26.017591 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2df5b2-a4b9-4503-b891-90bd1ea4fde1 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:26.018062 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2df5b2-a4b9-4503-b891-90bd1ea4fde1 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:26.019897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 32/64] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:26.032626 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2e42e-f4fe-4b37-a92f-6c77eea09c1c None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:26.033200 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2e42e-f4fe-4b37-a92f-6c77eea09c1c None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:26.033678 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2e42e-f4fe-4b37-a92f-6c77eea09c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:26.039069 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaafff8-bb2a-4481-b758-a3c2e8321275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:26.039069 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaafff8-bb2a-4481-b758-a3c2e8321275 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:26.039069 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaafff8-bb2a-4481-b758-a3c2e8321275 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:26.039069 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaafff8-bb2a-4481-b758-a3c2e8321275 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:26.072370 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaafff8-bb2a-4481-b758-a3c2e8321275 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:26.083076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-66a2e42e-f4fe-4b37-a92f-6c77eea09c1c None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:26.083076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-66a2e42e-f4fe-4b37-a92f-6c77eea09c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:26.098064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-bdaafff8-bb2a-4481-b758-a3c2e8321275 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:32:26.098064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:26.098064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:26.098064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:26.098064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:26.098064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:26.098064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:26.098064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:26.098064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:26.098064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:26.098064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:26.098064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:26.098064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:26.098064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:26.098064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:26.098064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:26.099302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:26.099302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:26.099302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:26.099302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:26.099302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:26.099302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:26.099302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:26.099302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:26.099302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:26.099302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:26.099302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:26.099302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:32:26.099302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:26.099302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:26.099302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:26.099302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:26.100147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:26.100147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:26.100147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:26.100147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:26.100147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:26.100147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:26.100147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:26.100147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:26.100147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:26.100147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:26.100147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:32:26.100147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:32:26.100147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 33/65] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:32:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:26.116850 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaafff8-bb2a-4481-b758-a3c2e8321275 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:26.212091 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 33/66] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:26.214357 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d146b8-8457-4946-bf06-1d510e133613 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:26.215562 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d146b8-8457-4946-bf06-1d510e133613 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:26.217784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d146b8-8457-4946-bf06-1d510e133613 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:26.221006 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 34/67] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:26.232511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71b599-c344-4a0b-9362-47f1b09e422e None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:26.233011 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71b599-c344-4a0b-9362-47f1b09e422e None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:26.233433 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71b599-c344-4a0b-9362-47f1b09e422e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:26.266626 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaafff8-bb2a-4481-b758-a3c2e8321275 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:26.284112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-ca71b599-c344-4a0b-9362-47f1b09e422e None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:26.285327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ca71b599-c344-4a0b-9362-47f1b09e422e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:26.307260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc99fc-07b7-4382-a4f8-ed6aaa2ad42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:26.308780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc99fc-07b7-4382-a4f8-ed6aaa2ad42b None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:26.309390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc99fc-07b7-4382-a4f8-ed6aaa2ad42b None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:26.310174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc99fc-07b7-4382-a4f8-ed6aaa2ad42b None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:26.311162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc99fc-07b7-4382-a4f8-ed6aaa2ad42b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:26.311668 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc99fc-07b7-4382-a4f8-ed6aaa2ad42b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:26.313698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc99fc-07b7-4382-a4f8-ed6aaa2ad42b None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:26.325964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 34/68] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:26.328234 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc99fc-07b7-4382-a4f8-ed6aaa2ad42b None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:26.358873 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 35/69] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:26.360008 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71b599-c344-4a0b-9362-47f1b09e422e None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:26.441606 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc99fc-07b7-4382-a4f8-ed6aaa2ad42b None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:26.460664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71b599-c344-4a0b-9362-47f1b09e422e None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:26.476531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811a141-8822-4049-b868-f59bcd66dfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:26.477541 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811a141-8822-4049-b868-f59bcd66dfeb None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:26.477841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811a141-8822-4049-b868-f59bcd66dfeb None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:26.478125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811a141-8822-4049-b868-f59bcd66dfeb None admin] PATH_INFO: `/v3/roles/member` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:26.488553 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811a141-8822-4049-b868-f59bcd66dfeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:26.492844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf23b65-6598-4ad2-ac3b-f5285a8793f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:26.493812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf23b65-6598-4ad2-ac3b-f5285a8793f3 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:26.494096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf23b65-6598-4ad2-ac3b-f5285a8793f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:26.494370 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf23b65-6598-4ad2-ac3b-f5285a8793f3 None admin] PATH_INFO: `/v3/users/8799b046633442a48a4bc8f6f80a2cb9` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:26.495591 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf23b65-6598-4ad2-ac3b-f5285a8793f3 None admin] RBAC: Authorizing `identity:get_user(user_id=8799b046633442a48a4bc8f6f80a2cb9)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:26.496890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-7811a141-8822-4049-b868-f59bcd66dfeb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:26.496890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:26.496890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:26.496890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:26.496890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:26.496890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:26.496890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:26.496890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:26.496890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:26.496890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:26.496890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:26.496890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:26.496890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:26.496890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:26.496890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:26.496890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:26.498033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:26.498033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:26.498033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:26.498033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:26.498033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:26.498033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:26.498033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:26.498033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:26.498033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:26.498033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:26.498033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:26.498033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:32:26.498033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:26.498033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:26.498033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:26.498033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:26.498802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:26.498802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:26.498802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:26.498802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:26.498802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:26.498802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:26.498802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:26.498802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:26.498802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:26.498802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:26.498802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:26.498802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:32:26.499400 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf23b65-6598-4ad2-ac3b-f5285a8793f3 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:26.499467 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 35/70] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:26.499540 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 36/71] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:26 2022] GET /identity/v3/users/8799b046633442a48a4bc8f6f80a2cb9 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:26.503528 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893aa36-6a1f-4f5d-8015-a7d3cf63e5d3 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:26.504025 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893aa36-6a1f-4f5d-8015-a7d3cf63e5d3 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:26.504496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf23b65-6598-4ad2-ac3b-f5285a8793f3 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:26.504909 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893aa36-6a1f-4f5d-8015-a7d3cf63e5d3 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:26.508826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 36/72] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:26.508826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893aa36-6a1f-4f5d-8015-a7d3cf63e5d3 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:26.608701 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf23b65-6598-4ad2-ac3b-f5285a8793f3 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:26.616883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893aa36-6a1f-4f5d-8015-a7d3cf63e5d3 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:26.642145 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f168e-abdd-4739-83ad-dc3c544c5964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:26.643290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f168e-abdd-4739-83ad-dc3c544c5964 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:26.643730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f168e-abdd-4739-83ad-dc3c544c5964 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:26.644010 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f168e-abdd-4739-83ad-dc3c544c5964 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:26.651238 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e10fa-fad7-445f-9775-67c066789392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:26.652778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e10fa-fad7-445f-9775-67c066789392 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:26.653088 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e10fa-fad7-445f-9775-67c066789392 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:26.653375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e10fa-fad7-445f-9775-67c066789392 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:26.654344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f168e-abdd-4739-83ad-dc3c544c5964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:26.661973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-0f4f168e-abdd-4739-83ad-dc3c544c5964 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:26.661973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:26.661973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:26.661973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:26.661973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:26.661973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:26.661973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:26.661973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:26.661973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:26.661973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:26.661973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:26.661973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:26.661973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:26.661973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:26.661973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:26.661973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:26.662823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:26.662823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:26.662823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:26.662823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:26.662823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:26.662823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:26.662823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:26.662823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:26.662823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:26.662823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:26.662823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:26.662823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:32:26.662823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:26.662823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:26.662823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:26.662823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:26.663930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:26.663930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:26.663930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:26.663930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:26.663930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:26.663930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:26.663930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:26.663930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:26.663930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:26.663930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:26.663930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:26.663930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:32:26.663930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 37/73] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:26.664542 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f168e-abdd-4739-83ad-dc3c544c5964 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:26.721919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e10fa-fad7-445f-9775-67c066789392 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:26.723435 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e10fa-fad7-445f-9775-67c066789392 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:26.767590 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f168e-abdd-4739-83ad-dc3c544c5964 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:26.800236 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1883851-11f2-4f59-8f76-f73e9d34d3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:26.800915 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1883851-11f2-4f59-8f76-f73e9d34d3bc None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:26.801203 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1883851-11f2-4f59-8f76-f73e9d34d3bc None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:26.801484 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1883851-11f2-4f59-8f76-f73e9d34d3bc None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:26.802230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1883851-11f2-4f59-8f76-f73e9d34d3bc None admin] RBAC: Adding query filter params (name=member) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:26.802539 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1883851-11f2-4f59-8f76-f73e9d34d3bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:26.803951 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1883851-11f2-4f59-8f76-f73e9d34d3bc None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:26.812177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 38/74] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:32:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:26.812177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202b896-ac70-4bd2-b99a-962c1728608c None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:26.812177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202b896-ac70-4bd2-b99a-962c1728608c None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:26.812177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202b896-ac70-4bd2-b99a-962c1728608c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:26.817263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 37/75] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:32:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:32:26.817263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e10fa-fad7-445f-9775-67c066789392 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:26.833582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-1202b896-ac70-4bd2-b99a-962c1728608c None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:26.834772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-1202b896-ac70-4bd2-b99a-962c1728608c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:26.896200 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 39/76] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:26.897490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82930-3f67-4b05-8090-bf34be761a03 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:26.897780 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82930-3f67-4b05-8090-bf34be761a03 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:26.898060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82930-3f67-4b05-8090-bf34be761a03 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:26.899512 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 40/77] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:26.900033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d82930-3f67-4b05-8090-bf34be761a03 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:26.913265 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e10fa-fad7-445f-9775-67c066789392 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:26.946891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2258fa-aa40-44da-b27e-84d102f72951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:26.947599 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2258fa-aa40-44da-b27e-84d102f72951 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:26.947887 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2258fa-aa40-44da-b27e-84d102f72951 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:26.948149 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2258fa-aa40-44da-b27e-84d102f72951 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:26.948991 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2258fa-aa40-44da-b27e-84d102f72951 None admin] RBAC: Adding query filter params (name=member) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:26.949388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2258fa-aa40-44da-b27e-84d102f72951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:26.950715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2258fa-aa40-44da-b27e-84d102f72951 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:26.958676 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 38/78] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:32:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:26.959491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2258fa-aa40-44da-b27e-84d102f72951 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:27.017227 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d82930-3f67-4b05-8090-bf34be761a03 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:27.049309 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59dca74-190f-4559-998a-de6f4c7b9459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:27.050116 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59dca74-190f-4559-998a-de6f4c7b9459 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:27.050403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59dca74-190f-4559-998a-de6f4c7b9459 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:27.050675 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59dca74-190f-4559-998a-de6f4c7b9459 None admin] PATH_INFO: `/v3/users/ba8f59d247b54efd9168081ed348571f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:27.052308 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2258fa-aa40-44da-b27e-84d102f72951 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:27.063602 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59dca74-190f-4559-998a-de6f4c7b9459 None admin] RBAC: Authorizing `identity:get_user(user_id=ba8f59d247b54efd9168081ed348571f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:27.065063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59dca74-190f-4559-998a-de6f4c7b9459 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:27.066730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 41/79] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:26 2022] GET /identity/v3/users/ba8f59d247b54efd9168081ed348571f => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:27.069222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ef46e-d314-46cd-b7ff-af556fc526f3 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:27.069520 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ef46e-d314-46cd-b7ff-af556fc526f3 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:27.069806 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ef46e-d314-46cd-b7ff-af556fc526f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:27.084626 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded097f-3c64-4841-ab95-79f4ad48348e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:27.085499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded097f-3c64-4841-ab95-79f4ad48348e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:27.085604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-302ef46e-d314-46cd-b7ff-af556fc526f3 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:27.085788 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded097f-3c64-4841-ab95-79f4ad48348e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:27.086071 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded097f-3c64-4841-ab95-79f4ad48348e None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:27.086743 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-302ef46e-d314-46cd-b7ff-af556fc526f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:27.087307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded097f-3c64-4841-ab95-79f4ad48348e None admin] RBAC: Authorizing `identity:get_project(project_id=b8a06ae2ea914e91922edccf3b59d6dc)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:27.088755 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded097f-3c64-4841-ab95-79f4ad48348e None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:27.090639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 39/80] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:26 2022] GET /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc => generated 298 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:27.091430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded097f-3c64-4841-ab95-79f4ad48348e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:27.150355 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 42/81] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:27.163215 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ef46e-d314-46cd-b7ff-af556fc526f3 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:27.200886 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded097f-3c64-4841-ab95-79f4ad48348e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:27.235287 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caaaaa9-337e-4e39-b07e-39a25874610a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:27.236106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaaaa9-337e-4e39-b07e-39a25874610a None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:27.236393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaaaa9-337e-4e39-b07e-39a25874610a None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:27.236670 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaaaa9-337e-4e39-b07e-39a25874610a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:27.244678 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ef46e-d314-46cd-b7ff-af556fc526f3 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:27.247196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caaaaa9-337e-4e39-b07e-39a25874610a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:27.255431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-7caaaaa9-337e-4e39-b07e-39a25874610a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:32:27.255431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:27.255431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:27.255431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:27.255431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:27.255431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:27.255431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:27.255431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:27.255431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:27.255431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:27.255431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:27.255431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:27.255431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:27.255431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:27.255431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:27.255431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:27.256391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:27.256391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:27.256391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:27.256391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:27.256391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:27.256391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:27.256391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:27.256391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:27.256391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:27.256391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:27.256391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:27.256391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:32:27.256391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:27.256391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:27.256391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:27.256391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:27.257249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:27.257249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:27.257249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:27.257249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:27.257249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:27.257249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:27.257249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:27.257249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:27.257249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:27.257249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:27.257249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:32:27.257249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:32:27.257249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 40/82] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:32:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:27.258008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caaaaa9-337e-4e39-b07e-39a25874610a None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:27.281172 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467cf52-2a20-47e6-84d9-bfc42a007a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:27.282147 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467cf52-2a20-47e6-84d9-bfc42a007a6c None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:27.282431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467cf52-2a20-47e6-84d9-bfc42a007a6c None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:27.282703 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467cf52-2a20-47e6-84d9-bfc42a007a6c None admin] PATH_INFO: `/v3/users/ba8f59d247b54efd9168081ed348571f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:27.283949 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467cf52-2a20-47e6-84d9-bfc42a007a6c None admin] RBAC: Authorizing `identity:get_user(user_id=ba8f59d247b54efd9168081ed348571f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:27.285427 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467cf52-2a20-47e6-84d9-bfc42a007a6c None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:27.287333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 43/83] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:27 2022] GET /identity/v3/users/ba8f59d247b54efd9168081ed348571f => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:27.287826 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467cf52-2a20-47e6-84d9-bfc42a007a6c None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:27.364236 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caaaaa9-337e-4e39-b07e-39a25874610a None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:27.386134 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467cf52-2a20-47e6-84d9-bfc42a007a6c None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:27.396550 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19232d31-f3d7-4db7-beed-c72b60398bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:27.397295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19232d31-f3d7-4db7-beed-c72b60398bcd None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:27.397659 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19232d31-f3d7-4db7-beed-c72b60398bcd None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:27.398005 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19232d31-f3d7-4db7-beed-c72b60398bcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:27.420102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5a025-d0dc-41e1-8c81-a2ed27d75729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:27.420770 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5a025-d0dc-41e1-8c81-a2ed27d75729 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:27.421060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5a025-d0dc-41e1-8c81-a2ed27d75729 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:27.421341 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5a025-d0dc-41e1-8c81-a2ed27d75729 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:27.422181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5a025-d0dc-41e1-8c81-a2ed27d75729 None admin] RBAC: Adding query filter params (role.id=59778f07f0504e90a60212f460e8c774, scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc, user.id=8799b046633442a48a4bc8f6f80a2cb9) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:27.422499 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5a025-d0dc-41e1-8c81-a2ed27d75729 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:27.423983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5a025-d0dc-41e1-8c81-a2ed27d75729 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:27.435166 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 44/84] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:32:27 2022] GET /identity/v3/role_assignments?user.id=8799b046633442a48a4bc8f6f80a2cb9&scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc&role.id=59778f07f0504e90a60212f460e8c774 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:27.435166 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5a025-d0dc-41e1-8c81-a2ed27d75729 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:27.473455 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19232d31-f3d7-4db7-beed-c72b60398bcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:27.476039 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19232d31-f3d7-4db7-beed-c72b60398bcd None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:27.554402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5a025-d0dc-41e1-8c81-a2ed27d75729 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:27.587594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 41/85] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:32:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:32:27.589136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19232d31-f3d7-4db7-beed-c72b60398bcd None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:27.597674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c5441-e7c2-4eb9-be5b-b84e85102e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:27.599459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c5441-e7c2-4eb9-be5b-b84e85102e6a None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:27.599459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c5441-e7c2-4eb9-be5b-b84e85102e6a None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:27.599673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c5441-e7c2-4eb9-be5b-b84e85102e6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:27.600969 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c5441-e7c2-4eb9-be5b-b84e85102e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:27.602530 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c5441-e7c2-4eb9-be5b-b84e85102e6a None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:27.604482 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 45/86] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:32:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:27.605388 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c5441-e7c2-4eb9-be5b-b84e85102e6a None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:27.690167 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19232d31-f3d7-4db7-beed-c72b60398bcd None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:27.709475 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c5441-e7c2-4eb9-be5b-b84e85102e6a None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:27.722320 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78981e8d-ef70-4b23-8ec4-55501aceee1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:27.723006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78981e8d-ef70-4b23-8ec4-55501aceee1c None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:27.723335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78981e8d-ef70-4b23-8ec4-55501aceee1c None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:27.723613 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78981e8d-ef70-4b23-8ec4-55501aceee1c None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:27.724692 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78981e8d-ef70-4b23-8ec4-55501aceee1c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:27.725002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78981e8d-ef70-4b23-8ec4-55501aceee1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:27.726556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78981e8d-ef70-4b23-8ec4-55501aceee1c None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:27.735487 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 42/87] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:32:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:27.736320 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78981e8d-ef70-4b23-8ec4-55501aceee1c None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:27.748622 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641052f8-789c-45d3-8315-06e13c2f5eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:27.749494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641052f8-789c-45d3-8315-06e13c2f5eab None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:27.749915 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641052f8-789c-45d3-8315-06e13c2f5eab None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:27.750346 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641052f8-789c-45d3-8315-06e13c2f5eab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:27.820661 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641052f8-789c-45d3-8315-06e13c2f5eab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:27.822139 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641052f8-789c-45d3-8315-06e13c2f5eab None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:27.831479 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78981e8d-ef70-4b23-8ec4-55501aceee1c None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:27.863810 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38e95c-dd26-414a-8cbe-1ffce1d9965e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:27.864680 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38e95c-dd26-414a-8cbe-1ffce1d9965e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:27.864964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38e95c-dd26-414a-8cbe-1ffce1d9965e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:27.865242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38e95c-dd26-414a-8cbe-1ffce1d9965e None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:27.866426 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38e95c-dd26-414a-8cbe-1ffce1d9965e None admin] RBAC: Authorizing `identity:get_project(project_id=b8a06ae2ea914e91922edccf3b59d6dc)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:27.867908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38e95c-dd26-414a-8cbe-1ffce1d9965e None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:27.874360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 43/88] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:27 2022] GET /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:27.874360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38e95c-dd26-414a-8cbe-1ffce1d9965e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:27.919866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 46/89] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:32:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:32:27.919866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641052f8-789c-45d3-8315-06e13c2f5eab None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:27.972685 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38e95c-dd26-414a-8cbe-1ffce1d9965e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:28.005854 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece964e2-2d8a-44bb-8cc0-a82bc2809672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:28.006577 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece964e2-2d8a-44bb-8cc0-a82bc2809672 None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:28.006860 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece964e2-2d8a-44bb-8cc0-a82bc2809672 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:28.007211 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece964e2-2d8a-44bb-8cc0-a82bc2809672 None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:28.007924 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece964e2-2d8a-44bb-8cc0-a82bc2809672 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:28.008094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641052f8-789c-45d3-8315-06e13c2f5eab None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:28.009359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece964e2-2d8a-44bb-8cc0-a82bc2809672 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:28.037471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 44/90] 10.222.0.11 () {60 vars in 1132 bytes} [Wed May 4 21:32:27 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:32:28.038091 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece964e2-2d8a-44bb-8cc0-a82bc2809672 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:28.044851 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429daf89-0def-4e8a-a171-8e3bfbdc7f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:28.046144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429daf89-0def-4e8a-a171-8e3bfbdc7f0f None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:28.046625 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429daf89-0def-4e8a-a171-8e3bfbdc7f0f None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:28.047724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429daf89-0def-4e8a-a171-8e3bfbdc7f0f None admin] PATH_INFO: `/v3/users/ba8f59d247b54efd9168081ed348571f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:28.049777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429daf89-0def-4e8a-a171-8e3bfbdc7f0f None admin] RBAC: Authorizing `identity:get_user(user_id=ba8f59d247b54efd9168081ed348571f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:28.052090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429daf89-0def-4e8a-a171-8e3bfbdc7f0f None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:28.054518 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 47/91] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:27 2022] GET /identity/v3/users/ba8f59d247b54efd9168081ed348571f => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:28.056206 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429daf89-0def-4e8a-a171-8e3bfbdc7f0f None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:28.169322 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece964e2-2d8a-44bb-8cc0-a82bc2809672 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:28.178944 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429daf89-0def-4e8a-a171-8e3bfbdc7f0f None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:28.214938 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb154d-fc94-4ce4-bbfb-cfc005f160ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:28.215971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbe053-3c9d-4e95-89ca-7d77b6364373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:28.216089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb154d-fc94-4ce4-bbfb-cfc005f160ef None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:28.216527 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb154d-fc94-4ce4-bbfb-cfc005f160ef None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:28.216902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb154d-fc94-4ce4-bbfb-cfc005f160ef None admin] PATH_INFO: `/v3/projects/2a0a9c241dc94774b44d525c3de35603` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:28.217290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbe053-3c9d-4e95-89ca-7d77b6364373 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:28.217831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbe053-3c9d-4e95-89ca-7d77b6364373 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:28.218293 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbe053-3c9d-4e95-89ca-7d77b6364373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:28.218646 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb154d-fc94-4ce4-bbfb-cfc005f160ef None admin] RBAC: Authorizing `identity:get_project(project_id=2a0a9c241dc94774b44d525c3de35603)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:28.219558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbe053-3c9d-4e95-89ca-7d77b6364373 None admin] RBAC: Adding query filter params (role.id=b03b07e63e164e6a8858592b025c8103, scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc, user.id=ba8f59d247b54efd9168081ed348571f) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:28.220044 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbe053-3c9d-4e95-89ca-7d77b6364373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:28.220424 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb154d-fc94-4ce4-bbfb-cfc005f160ef None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:28.221885 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbe053-3c9d-4e95-89ca-7d77b6364373 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:28.227208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 48/92] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:28 2022] GET /identity/v3/projects/2a0a9c241dc94774b44d525c3de35603 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:28.227208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb154d-fc94-4ce4-bbfb-cfc005f160ef None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:28.236427 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 45/93] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:32:28 2022] GET /identity/v3/role_assignments?user.id=ba8f59d247b54efd9168081ed348571f&scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc&role.id=b03b07e63e164e6a8858592b025c8103 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:28.237580 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbe053-3c9d-4e95-89ca-7d77b6364373 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:28.352942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb154d-fc94-4ce4-bbfb-cfc005f160ef None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:28.371033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbe053-3c9d-4e95-89ca-7d77b6364373 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:28.402118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd39cb-2293-4872-9918-0208a7e1a048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:28.402805 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd39cb-2293-4872-9918-0208a7e1a048 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:28.403114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd39cb-2293-4872-9918-0208a7e1a048 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:28.403403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd39cb-2293-4872-9918-0208a7e1a048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:28.414956 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ead719-a187-4ce4-91b2-61d5dcd0a6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:28.415695 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ead719-a187-4ce4-91b2-61d5dcd0a6bd None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:28.415963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ead719-a187-4ce4-91b2-61d5dcd0a6bd None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:28.416247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ead719-a187-4ce4-91b2-61d5dcd0a6bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:28.417118 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ead719-a187-4ce4-91b2-61d5dcd0a6bd None admin] RBAC: Adding query filter params (role.id=b03b07e63e164e6a8858592b025c8103, scope.project.id=2a0a9c241dc94774b44d525c3de35603, user.id=ba8f59d247b54efd9168081ed348571f) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:28.417437 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ead719-a187-4ce4-91b2-61d5dcd0a6bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:28.420094 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ead719-a187-4ce4-91b2-61d5dcd0a6bd None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:28.426415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 46/94] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:32:28 2022] GET /identity/v3/role_assignments?user.id=ba8f59d247b54efd9168081ed348571f&scope.project.id=2a0a9c241dc94774b44d525c3de35603&role.id=b03b07e63e164e6a8858592b025c8103 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:28.484653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd39cb-2293-4872-9918-0208a7e1a048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:28.486056 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd39cb-2293-4872-9918-0208a7e1a048 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:28.594919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 49/95] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:32:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:32:28.601648 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ead719-a187-4ce4-91b2-61d5dcd0a6bd None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:28.722528 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ead719-a187-4ce4-91b2-61d5dcd0a6bd None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:28.757657 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a4d67-5feb-4578-b98b-a7093d9e2ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:28.758500 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a4d67-5feb-4578-b98b-a7093d9e2ec4 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:28.758904 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a4d67-5feb-4578-b98b-a7093d9e2ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:28.759112 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a4d67-5feb-4578-b98b-a7093d9e2ec4 None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:28.760282 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a4d67-5feb-4578-b98b-a7093d9e2ec4 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a06ae2ea914e91922edccf3b59d6dc)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:28.761816 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a4d67-5feb-4578-b98b-a7093d9e2ec4 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:28.764883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 47/96] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:28 2022] GET /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:28.769823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd39cb-2293-4872-9918-0208a7e1a048 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:28.870479 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd39cb-2293-4872-9918-0208a7e1a048 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:28.909541 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917b787-9bfd-4cba-b7dc-cab7d57b245b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:28.910347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917b787-9bfd-4cba-b7dc-cab7d57b245b None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:28.910644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917b787-9bfd-4cba-b7dc-cab7d57b245b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:28.910931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917b787-9bfd-4cba-b7dc-cab7d57b245b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:28.911842 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917b787-9bfd-4cba-b7dc-cab7d57b245b None admin] RBAC: Adding query filter params (role.id=c3d122a6c9c6478aa2dd7e5b8afe6471, scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc, user.id=ba8f59d247b54efd9168081ed348571f) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:28.912158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917b787-9bfd-4cba-b7dc-cab7d57b245b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:28.913627 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917b787-9bfd-4cba-b7dc-cab7d57b245b None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:28.922285 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 50/97] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:32:28 2022] GET /identity/v3/role_assignments?user.id=ba8f59d247b54efd9168081ed348571f&scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc&role.id=c3d122a6c9c6478aa2dd7e5b8afe6471 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:30.046440 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623a34d-ca61-4bd8-a444-4e0ecc2ac155 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:30.047529 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623a34d-ca61-4bd8-a444-4e0ecc2ac155 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:30.048027 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623a34d-ca61-4bd8-a444-4e0ecc2ac155 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:30.049907 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 48/98] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:30.055349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b2efd-889d-48f0-9d1e-0f975b42f0d6 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:30.056222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b2efd-889d-48f0-9d1e-0f975b42f0d6 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:30.056705 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b2efd-889d-48f0-9d1e-0f975b42f0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:30.080052 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-480b2efd-889d-48f0-9d1e-0f975b42f0d6 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:30.081625 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-480b2efd-889d-48f0-9d1e-0f975b42f0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:30.157607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 51/99] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:30.193294 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623a34d-ca61-4bd8-a444-4e0ecc2ac155 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:30.310957 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623a34d-ca61-4bd8-a444-4e0ecc2ac155 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:30.344075 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4eb04-308c-42fc-b516-80596319c13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:30.345216 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4eb04-308c-42fc-b516-80596319c13e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:30.345701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4eb04-308c-42fc-b516-80596319c13e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:30.346174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4eb04-308c-42fc-b516-80596319c13e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:30.357222 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4eb04-308c-42fc-b516-80596319c13e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:30.365260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-0ff4eb04-308c-42fc-b516-80596319c13e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:32:30.365260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:30.365260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:30.365260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:30.365260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:30.365260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:30.365260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:30.365260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:30.365260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:30.365260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:30.365260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:30.365260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:30.365260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:30.365260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:30.365260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:30.365260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:30.366152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:30.366152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:30.366152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:30.366152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:30.366152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:30.366152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:30.366152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:30.366152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:30.366152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:30.366152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:30.366152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:30.366152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:32:30.366152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:30.366152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:30.366152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:30.366152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:30.366943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:30.366943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:30.366943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:30.366943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:30.366943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:30.366943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:30.366943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:30.366943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:30.366943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:30.366943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:30.366943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:32:30.366943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:32:30.369460 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 49/100] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:32:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:30.376302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b2efd-889d-48f0-9d1e-0f975b42f0d6 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:30.480590 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b2efd-889d-48f0-9d1e-0f975b42f0d6 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:30.518564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74df5b4-051b-4ae6-8bff-e1cffaafa26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:30.519706 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74df5b4-051b-4ae6-8bff-e1cffaafa26e None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:30.520197 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74df5b4-051b-4ae6-8bff-e1cffaafa26e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:30.520672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74df5b4-051b-4ae6-8bff-e1cffaafa26e None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:30.521627 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74df5b4-051b-4ae6-8bff-e1cffaafa26e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:30.522144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74df5b4-051b-4ae6-8bff-e1cffaafa26e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:30.523877 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74df5b4-051b-4ae6-8bff-e1cffaafa26e None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:30.534895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 52/101] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:30.540072 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4eb04-308c-42fc-b516-80596319c13e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:30.644004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4eb04-308c-42fc-b516-80596319c13e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:30.678208 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7db2e4-1902-4fc1-a3b9-93ff799f4c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:30.679492 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7db2e4-1902-4fc1-a3b9-93ff799f4c94 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:30.679983 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7db2e4-1902-4fc1-a3b9-93ff799f4c94 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:30.680456 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7db2e4-1902-4fc1-a3b9-93ff799f4c94 None admin] PATH_INFO: `/v3/users/8799b046633442a48a4bc8f6f80a2cb9` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:30.681881 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7db2e4-1902-4fc1-a3b9-93ff799f4c94 None admin] RBAC: Authorizing `identity:get_user(user_id=8799b046633442a48a4bc8f6f80a2cb9)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:30.683703 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7db2e4-1902-4fc1-a3b9-93ff799f4c94 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:30.685948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 50/102] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:30 2022] GET /identity/v3/users/8799b046633442a48a4bc8f6f80a2cb9 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:30.691385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74df5b4-051b-4ae6-8bff-e1cffaafa26e None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:30.809206 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74df5b4-051b-4ae6-8bff-e1cffaafa26e None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:30.848258 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9bc2a-788a-44e2-9458-f3a6cbc5994d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:30.849933 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9bc2a-788a-44e2-9458-f3a6cbc5994d None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:30.850430 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9bc2a-788a-44e2-9458-f3a6cbc5994d None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:30.850962 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9bc2a-788a-44e2-9458-f3a6cbc5994d None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:30.852429 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9bc2a-788a-44e2-9458-f3a6cbc5994d None admin] RBAC: Authorizing `identity:get_project(project_id=b8a06ae2ea914e91922edccf3b59d6dc)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:30.854148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9bc2a-788a-44e2-9458-f3a6cbc5994d None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:30.856302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 53/103] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:30 2022] GET /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:30.862629 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7db2e4-1902-4fc1-a3b9-93ff799f4c94 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:30.967707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7db2e4-1902-4fc1-a3b9-93ff799f4c94 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:31.003883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1836d01-5a68-43db-8e3a-bcddb5f999ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:31.005177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1836d01-5a68-43db-8e3a-bcddb5f999ec None admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:31.005701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1836d01-5a68-43db-8e3a-bcddb5f999ec None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:31.006197 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1836d01-5a68-43db-8e3a-bcddb5f999ec None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc/users/8799b046633442a48a4bc8f6f80a2cb9/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:31.008591 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1836d01-5a68-43db-8e3a-bcddb5f999ec None admin] RBAC: Authorizing `identity:create_grant(project_id=b8a06ae2ea914e91922edccf3b59d6dc, user_id=8799b046633442a48a4bc8f6f80a2cb9, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:31.010320 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1836d01-5a68-43db-8e3a-bcddb5f999ec None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:31.026616 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 51/104] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:32:30 2022] PUT /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc/users/8799b046633442a48a4bc8f6f80a2cb9/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:32:31.207068 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df11ea-70c0-4a50-9f01-b3482e387ad9 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:31.208099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df11ea-70c0-4a50-9f01-b3482e387ad9 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:31.208624 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df11ea-70c0-4a50-9f01-b3482e387ad9 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:31.210660 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 54/105] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:31.217581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b00231-bfb3-4fda-9e81-6723d98e7ee7 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:31.218583 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b00231-bfb3-4fda-9e81-6723d98e7ee7 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:31.219136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b00231-bfb3-4fda-9e81-6723d98e7ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:31.237834 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-36b00231-bfb3-4fda-9e81-6723d98e7ee7 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:31.239461 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-36b00231-bfb3-4fda-9e81-6723d98e7ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:31.311271 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 52/106] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:32:31.345080 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df11ea-70c0-4a50-9f01-b3482e387ad9 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:31.455375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df11ea-70c0-4a50-9f01-b3482e387ad9 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:31.490587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc272d-27fb-4cf0-b4a9-0eb120b4ceee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:31.491735 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc272d-27fb-4cf0-b4a9-0eb120b4ceee None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:31.492388 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc272d-27fb-4cf0-b4a9-0eb120b4ceee None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:31.492865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc272d-27fb-4cf0-b4a9-0eb120b4ceee None admin] PATH_INFO: `/v3/roles/member` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:31.504839 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc272d-27fb-4cf0-b4a9-0eb120b4ceee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:31.513289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-75cc272d-27fb-4cf0-b4a9-0eb120b4ceee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:31.513289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:31.513289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:31.513289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:31.513289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:31.513289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:31.513289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:31.513289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:31.513289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:31.513289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:31.513289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:31.513289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:31.513289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:31.513289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:31.513289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:31.513289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:31.514133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:31.514133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:31.514133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:31.514133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:31.514133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:31.514133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:31.514133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:31.514133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:31.514133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:31.514133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:31.514133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:31.514133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:32:31.514133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:31.514133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:31.514133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:31.514133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:31.514878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:31.514878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:31.514878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:31.514878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:31.514878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:31.514878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:31.514878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:31.514878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:31.514878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:31.514878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:31.514878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:31.514878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:32:31.518497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 55/107] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:31.523201 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b00231-bfb3-4fda-9e81-6723d98e7ee7 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:31.646806 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b00231-bfb3-4fda-9e81-6723d98e7ee7 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:31.686603 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b9eee-ffe6-445e-8149-6ec0f5541414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:31.687688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b9eee-ffe6-445e-8149-6ec0f5541414 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:31.688188 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b9eee-ffe6-445e-8149-6ec0f5541414 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:31.688657 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b9eee-ffe6-445e-8149-6ec0f5541414 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:31.689607 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b9eee-ffe6-445e-8149-6ec0f5541414 None admin] RBAC: Adding query filter params (name=member) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:31.690130 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b9eee-ffe6-445e-8149-6ec0f5541414 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:31.691786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b9eee-ffe6-445e-8149-6ec0f5541414 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:31.701149 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 53/108] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:32:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:31.706689 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc272d-27fb-4cf0-b4a9-0eb120b4ceee None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:31.743334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50916a8-c1a8-493c-abe6-742833216714 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:31.743618 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50916a8-c1a8-493c-abe6-742833216714 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:31.743801 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50916a8-c1a8-493c-abe6-742833216714 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:31.745245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 54/109] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:31.753705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e192ef-dd70-4045-a2a3-2c8f561778bf None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:31.753705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e192ef-dd70-4045-a2a3-2c8f561778bf None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:31.753705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e192ef-dd70-4045-a2a3-2c8f561778bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:31.780921 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-a1e192ef-dd70-4045-a2a3-2c8f561778bf None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:31.782115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a1e192ef-dd70-4045-a2a3-2c8f561778bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:31.881623 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 55/110] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:32:31.898774 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc272d-27fb-4cf0-b4a9-0eb120b4ceee None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:31.929000 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e192ef-dd70-4045-a2a3-2c8f561778bf None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:31.972320 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a4886-7c37-42a8-b8a3-96c5e6f39321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:31.973219 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a4886-7c37-42a8-b8a3-96c5e6f39321 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:31.973506 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a4886-7c37-42a8-b8a3-96c5e6f39321 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:31.973787 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a4886-7c37-42a8-b8a3-96c5e6f39321 None admin] PATH_INFO: `/v3/users/ba8f59d247b54efd9168081ed348571f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:31.976605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a4886-7c37-42a8-b8a3-96c5e6f39321 None admin] RBAC: Authorizing `identity:get_user(user_id=ba8f59d247b54efd9168081ed348571f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:31.978098 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a4886-7c37-42a8-b8a3-96c5e6f39321 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:31.989222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 56/111] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:31 2022] GET /identity/v3/users/ba8f59d247b54efd9168081ed348571f => generated 275 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:31.996076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a4886-7c37-42a8-b8a3-96c5e6f39321 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:32.138591 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e192ef-dd70-4045-a2a3-2c8f561778bf None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:32.190813 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a4886-7c37-42a8-b8a3-96c5e6f39321 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:32.206679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6421b0f-e739-4110-9fc5-5921fe490758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:32.207863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6421b0f-e739-4110-9fc5-5921fe490758 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:32.209709 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6421b0f-e739-4110-9fc5-5921fe490758 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:32.210202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6421b0f-e739-4110-9fc5-5921fe490758 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:32.226187 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6421b0f-e739-4110-9fc5-5921fe490758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:32.234353 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce11119-2206-42ff-8479-edd3ec8e3299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:32.235844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce11119-2206-42ff-8479-edd3ec8e3299 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:32.236371 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce11119-2206-42ff-8479-edd3ec8e3299 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:32.236852 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce11119-2206-42ff-8479-edd3ec8e3299 None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:32.238196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-f6421b0f-e739-4110-9fc5-5921fe490758 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:32.238196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:32.238196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:32.238196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:32.238196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:32.238196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:32.238196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:32.238196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:32.238196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:32.238196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:32.238196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:32.238196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:32.238196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:32.238196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:32.238196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:32.238196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:32.239031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:32.239031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:32.239031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:32.239031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:32.239031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:32.239031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:32.239031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:32.239031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:32.239031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:32.239031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:32.239031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:32.239031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:32:32.239031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:32.239031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:32.239031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:32.239031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:32.240136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:32.240136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:32.240136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:32.240136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:32.240136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:32.240136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:32.240136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:32.240136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:32.240136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:32.240136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:32.240136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:32.240136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:32:32.240136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 56/112] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:32:32.241196 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce11119-2206-42ff-8479-edd3ec8e3299 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a06ae2ea914e91922edccf3b59d6dc)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:32.242942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce11119-2206-42ff-8479-edd3ec8e3299 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:32.245390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 57/113] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:31 2022] GET /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:32.245516 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba184978-b69a-4a1f-8d1c-3263f2cb1514 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:32.245770 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba184978-b69a-4a1f-8d1c-3263f2cb1514 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:32.246141 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba184978-b69a-4a1f-8d1c-3263f2cb1514 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:32.246996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce11119-2206-42ff-8479-edd3ec8e3299 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:32.247520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 57/114] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:32.251950 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba184978-b69a-4a1f-8d1c-3263f2cb1514 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:32.361040 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce11119-2206-42ff-8479-edd3ec8e3299 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:32.368704 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba184978-b69a-4a1f-8d1c-3263f2cb1514 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:32.409388 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c012e-dd3b-4d9e-925c-5564e8073862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:32.409388 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c012e-dd3b-4d9e-925c-5564e8073862 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:32.409388 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c012e-dd3b-4d9e-925c-5564e8073862 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:32.409388 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c012e-dd3b-4d9e-925c-5564e8073862 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:32.409800 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c012e-dd3b-4d9e-925c-5564e8073862 None admin] RBAC: Adding query filter params (name=member) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:32.409800 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c012e-dd3b-4d9e-925c-5564e8073862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:32.409800 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c012e-dd3b-4d9e-925c-5564e8073862 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:32.424807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 58/115] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:32:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:32.427014 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74342a3f-90c6-414e-beb0-966af31877e1 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:32.427372 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74342a3f-90c6-414e-beb0-966af31877e1 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:32.427655 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74342a3f-90c6-414e-beb0-966af31877e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:32.443963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f766d-52ea-4ff4-afb2-5cfe1b07062f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:32.444934 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f766d-52ea-4ff4-afb2-5cfe1b07062f None admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:32.445230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f766d-52ea-4ff4-afb2-5cfe1b07062f None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:32.445509 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f766d-52ea-4ff4-afb2-5cfe1b07062f None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc/users/ba8f59d247b54efd9168081ed348571f/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:32.447898 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f766d-52ea-4ff4-afb2-5cfe1b07062f None admin] RBAC: Authorizing `identity:create_grant(project_id=b8a06ae2ea914e91922edccf3b59d6dc, user_id=ba8f59d247b54efd9168081ed348571f, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:32.449704 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f766d-52ea-4ff4-afb2-5cfe1b07062f None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:32.452770 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-74342a3f-90c6-414e-beb0-966af31877e1 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:32.454197 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-74342a3f-90c6-414e-beb0-966af31877e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:32.466779 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 58/116] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:32:32 2022] PUT /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc/users/ba8f59d247b54efd9168081ed348571f/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:32:32.468072 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f766d-52ea-4ff4-afb2-5cfe1b07062f None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:32.590576 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 59/117] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:32.593482 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f58f6d-bef2-44de-9159-026373732347 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:32.594684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f58f6d-bef2-44de-9159-026373732347 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:32.595318 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f58f6d-bef2-44de-9159-026373732347 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:32.597520 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 60/118] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:32.606303 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ec709-6ca3-441c-a42d-97bfb02cf95c None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:32.607033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ec709-6ca3-441c-a42d-97bfb02cf95c None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:32.608708 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ec709-6ca3-441c-a42d-97bfb02cf95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:32.632235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-671ec709-6ca3-441c-a42d-97bfb02cf95c None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:32.633736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-671ec709-6ca3-441c-a42d-97bfb02cf95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:32.657805 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f766d-52ea-4ff4-afb2-5cfe1b07062f None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:32.700939 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e150cc-b7d2-4772-8ffa-44c31bc0a6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:32.701833 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e150cc-b7d2-4772-8ffa-44c31bc0a6c4 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:32.702120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e150cc-b7d2-4772-8ffa-44c31bc0a6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:32.702397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e150cc-b7d2-4772-8ffa-44c31bc0a6c4 None admin] PATH_INFO: `/v3/users/ba8f59d247b54efd9168081ed348571f` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:32.703620 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e150cc-b7d2-4772-8ffa-44c31bc0a6c4 None admin] RBAC: Authorizing `identity:get_user(user_id=ba8f59d247b54efd9168081ed348571f)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:32.705066 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e150cc-b7d2-4772-8ffa-44c31bc0a6c4 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:32.706694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 59/119] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:32 2022] GET /identity/v3/users/ba8f59d247b54efd9168081ed348571f => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:32.712663 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839afeca-e249-44e0-bd48-02203314ae80 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:32.713009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839afeca-e249-44e0-bd48-02203314ae80 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:32.713234 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839afeca-e249-44e0-bd48-02203314ae80 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:32.713429 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 61/120] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:32:32.714534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ec709-6ca3-441c-a42d-97bfb02cf95c None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:32.714637 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 60/121] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:32.715311 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839afeca-e249-44e0-bd48-02203314ae80 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:32.823016 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ec709-6ca3-441c-a42d-97bfb02cf95c None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:32.840880 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839afeca-e249-44e0-bd48-02203314ae80 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:32.856679 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908656b5-8c96-4139-b268-813948db5aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:32.857584 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908656b5-8c96-4139-b268-813948db5aee None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:32.857874 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908656b5-8c96-4139-b268-813948db5aee None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:32.858152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908656b5-8c96-4139-b268-813948db5aee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:32.868333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908656b5-8c96-4139-b268-813948db5aee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:32.876897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-908656b5-8c96-4139-b268-813948db5aee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:32:32.876897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:32.876897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:32.876897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:32.876897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:32.876897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:32.876897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:32.876897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:32.876897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:32.876897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:32.876897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:32.876897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:32.876897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:32.876897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:32.876897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:32.876897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:32.877751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:32.877751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:32.877751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:32.877751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:32.877751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:32.877751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:32.877751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:32.877751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:32.877751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:32.877751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:32.877751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:32.877751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:32:32.877751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:32.877751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:32.877751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:32.877751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:32.878523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:32.878523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:32.878523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:32.878523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:32.878523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:32.878523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:32.878523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:32.878523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:32.878523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:32.878523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:32.878523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:32:32.878523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:32:32.879124 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c09f9c-7fd4-4488-88ff-ca549ef2e28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:32.879229 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 62/122] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:32.879303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c09f9c-7fd4-4488-88ff-ca549ef2e28a None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:32.879303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c09f9c-7fd4-4488-88ff-ca549ef2e28a None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:32.879303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c09f9c-7fd4-4488-88ff-ca549ef2e28a None admin] PATH_INFO: `/v3/projects/2a0a9c241dc94774b44d525c3de35603` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:32.880015 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290647ff-4a43-4211-b1f0-21b217e46fb9 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:32.880113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290647ff-4a43-4211-b1f0-21b217e46fb9 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:32.883061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290647ff-4a43-4211-b1f0-21b217e46fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:32.884720 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c09f9c-7fd4-4488-88ff-ca549ef2e28a None admin] RBAC: Authorizing `identity:get_project(project_id=2a0a9c241dc94774b44d525c3de35603)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:32.891318 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c09f9c-7fd4-4488-88ff-ca549ef2e28a None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:32.894205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 61/123] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:32 2022] GET /identity/v3/projects/2a0a9c241dc94774b44d525c3de35603 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:32.894996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c09f9c-7fd4-4488-88ff-ca549ef2e28a None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:32.897228 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-290647ff-4a43-4211-b1f0-21b217e46fb9 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:32.898409 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-290647ff-4a43-4211-b1f0-21b217e46fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:32.965128 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 63/124] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:32.965991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290647ff-4a43-4211-b1f0-21b217e46fb9 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:33.025624 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c09f9c-7fd4-4488-88ff-ca549ef2e28a None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:33.073836 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b462a-6da5-474b-bd23-ad56d56983e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:33.074895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b462a-6da5-474b-bd23-ad56d56983e8 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:33.075218 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b462a-6da5-474b-bd23-ad56d56983e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:33.075501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b462a-6da5-474b-bd23-ad56d56983e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:33.076690 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b462a-6da5-474b-bd23-ad56d56983e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:33.078166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b462a-6da5-474b-bd23-ad56d56983e8 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:33.079850 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 62/125] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:32:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:33.085320 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b462a-6da5-474b-bd23-ad56d56983e8 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:33.095091 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290647ff-4a43-4211-b1f0-21b217e46fb9 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:33.133685 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b18b29-816b-4c8f-99d8-f16d87f66683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:33.134366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b18b29-816b-4c8f-99d8-f16d87f66683 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:33.134655 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b18b29-816b-4c8f-99d8-f16d87f66683 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:33.134934 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b18b29-816b-4c8f-99d8-f16d87f66683 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:33.135720 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b18b29-816b-4c8f-99d8-f16d87f66683 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:33.136033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b18b29-816b-4c8f-99d8-f16d87f66683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:33.137525 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b18b29-816b-4c8f-99d8-f16d87f66683 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:33.145853 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 64/126] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:32:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:33.146687 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b18b29-816b-4c8f-99d8-f16d87f66683 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:33.200259 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b462a-6da5-474b-bd23-ad56d56983e8 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:33.233699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77ae16-7e54-47e6-b7c9-8ff76321abcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:33.234597 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77ae16-7e54-47e6-b7c9-8ff76321abcb None admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:33.234881 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77ae16-7e54-47e6-b7c9-8ff76321abcb None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:33.235199 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77ae16-7e54-47e6-b7c9-8ff76321abcb None admin] PATH_INFO: `/v3/projects/2a0a9c241dc94774b44d525c3de35603/users/ba8f59d247b54efd9168081ed348571f/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:33.237176 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77ae16-7e54-47e6-b7c9-8ff76321abcb None admin] RBAC: Authorizing `identity:create_grant(project_id=2a0a9c241dc94774b44d525c3de35603, user_id=ba8f59d247b54efd9168081ed348571f, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:33.238664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77ae16-7e54-47e6-b7c9-8ff76321abcb None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:33.247800 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b18b29-816b-4c8f-99d8-f16d87f66683 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:33.253959 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 63/127] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:32:33 2022] PUT /identity/v3/projects/2a0a9c241dc94774b44d525c3de35603/users/ba8f59d247b54efd9168081ed348571f/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:32:33.254763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77ae16-7e54-47e6-b7c9-8ff76321abcb None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:33.294753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed27ca8-839c-4a01-aae7-441a080e7f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:33.296305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed27ca8-839c-4a01-aae7-441a080e7f2c None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:33.296600 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed27ca8-839c-4a01-aae7-441a080e7f2c None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:33.296887 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed27ca8-839c-4a01-aae7-441a080e7f2c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:33.321208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed27ca8-839c-4a01-aae7-441a080e7f2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:33.342728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-3ed27ca8-839c-4a01-aae7-441a080e7f2c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:32:33.342728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:33.342728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:33.342728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:33.342728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:33.342728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:33.342728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:33.342728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:33.342728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:33.342728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:33.342728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:33.342728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:33.342728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:33.342728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:33.342728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:33.342728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:33.344876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:33.344876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:33.344876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:33.344876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:33.344876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:33.344876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:33.344876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:33.344876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:33.344876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:33.344876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:33.344876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:33.344876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:32:33.344876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:33.344876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:33.344876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:33.344876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:33.346759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:33.346759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:33.346759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:33.346759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:33.346759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:33.346759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:33.346759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:33.346759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:33.346759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:33.346759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:33.346759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:32:33.346759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:32:33.346759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 65/128] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:32:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:33.346759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed27ca8-839c-4a01-aae7-441a080e7f2c None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:33.494154 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77ae16-7e54-47e6-b7c9-8ff76321abcb None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:33.530490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed27ca8-839c-4a01-aae7-441a080e7f2c None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:33.536243 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577def2f-f3e6-4a05-b156-34c7e14bedf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:33.537201 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577def2f-f3e6-4a05-b156-34c7e14bedf7 None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:33.537683 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577def2f-f3e6-4a05-b156-34c7e14bedf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:33.538174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577def2f-f3e6-4a05-b156-34c7e14bedf7 None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:33.539111 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577def2f-f3e6-4a05-b156-34c7e14bedf7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:33.540755 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577def2f-f3e6-4a05-b156-34c7e14bedf7 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:33.584358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 64/129] 10.222.0.11 () {60 vars in 1141 bytes} [Wed May 4 21:32:33 2022] POST /identity/v3/projects => generated 302 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:32:33.585882 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ac4aa-f2d1-4613-9d80-59de6c0dcc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:33.586651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577def2f-f3e6-4a05-b156-34c7e14bedf7 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:33.591074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ac4aa-f2d1-4613-9d80-59de6c0dcc72 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:33.591074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ac4aa-f2d1-4613-9d80-59de6c0dcc72 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:33.591074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ac4aa-f2d1-4613-9d80-59de6c0dcc72 None admin] PATH_INFO: `/v3/users/c1706219618547f0aae5412d934afd90` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:33.620192 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ac4aa-f2d1-4613-9d80-59de6c0dcc72 None admin] RBAC: Authorizing `identity:get_user(user_id=c1706219618547f0aae5412d934afd90)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:33.624642 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ac4aa-f2d1-4613-9d80-59de6c0dcc72 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:33.629222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 66/130] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:33 2022] GET /identity/v3/users/c1706219618547f0aae5412d934afd90 => generated 289 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:33.636464 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ac4aa-f2d1-4613-9d80-59de6c0dcc72 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:33.826064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577def2f-f3e6-4a05-b156-34c7e14bedf7 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:33.860996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ac4aa-f2d1-4613-9d80-59de6c0dcc72 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:33.886393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4b75d-6cfe-44ae-8e36-ac2440eabe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:33.887475 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4b75d-6cfe-44ae-8e36-ac2440eabe83 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:33.887978 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4b75d-6cfe-44ae-8e36-ac2440eabe83 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:33.888454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4b75d-6cfe-44ae-8e36-ac2440eabe83 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:33.889420 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4b75d-6cfe-44ae-8e36-ac2440eabe83 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:33.889927 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4b75d-6cfe-44ae-8e36-ac2440eabe83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:33.892573 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4b75d-6cfe-44ae-8e36-ac2440eabe83 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:33.911378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 65/131] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:32:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:33.915137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4b75d-6cfe-44ae-8e36-ac2440eabe83 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:33.932593 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85440ef-2776-40ba-9558-535fc36dde39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:33.933732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85440ef-2776-40ba-9558-535fc36dde39 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:33.934219 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85440ef-2776-40ba-9558-535fc36dde39 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:33.934699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85440ef-2776-40ba-9558-535fc36dde39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:34.050380 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85440ef-2776-40ba-9558-535fc36dde39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:34.052261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85440ef-2776-40ba-9558-535fc36dde39 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:34.089155 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4b75d-6cfe-44ae-8e36-ac2440eabe83 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:34.172384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5a0a4-f263-4775-aeb4-16b461127112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:34.173397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5a0a4-f263-4775-aeb4-16b461127112 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:34.173770 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5a0a4-f263-4775-aeb4-16b461127112 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:34.174118 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5a0a4-f263-4775-aeb4-16b461127112 None admin] PATH_INFO: `/v3/users/ba8f59d247b54efd9168081ed348571f` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:34.175459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5a0a4-f263-4775-aeb4-16b461127112 None admin] RBAC: Authorizing `identity:get_user(user_id=ba8f59d247b54efd9168081ed348571f)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:34.177006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5a0a4-f263-4775-aeb4-16b461127112 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:34.178983 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 66/132] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:33 2022] GET /identity/v3/users/ba8f59d247b54efd9168081ed348571f => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:34.188287 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d68482-9d8b-42e7-a9c4-a6a9f185316a None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:34.188643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d68482-9d8b-42e7-a9c4-a6a9f185316a None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:34.188857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 67/133] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:32:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:32:34.189030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d68482-9d8b-42e7-a9c4-a6a9f185316a None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:34.190165 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85440ef-2776-40ba-9558-535fc36dde39 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:34.190517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 67/134] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:34.195211 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d68482-9d8b-42e7-a9c4-a6a9f185316a None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:34.291033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85440ef-2776-40ba-9558-535fc36dde39 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:34.326310 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98ff7d-5187-4cf1-90d7-b2e280f77b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:34.327682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98ff7d-5187-4cf1-90d7-b2e280f77b7a None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:34.328143 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98ff7d-5187-4cf1-90d7-b2e280f77b7a None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:34.328606 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98ff7d-5187-4cf1-90d7-b2e280f77b7a None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:34.329972 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98ff7d-5187-4cf1-90d7-b2e280f77b7a None admin] RBAC: Authorizing `identity:get_project(project_id=b8a06ae2ea914e91922edccf3b59d6dc)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:34.331656 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98ff7d-5187-4cf1-90d7-b2e280f77b7a None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:34.333779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 68/135] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:34 2022] GET /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:34.335241 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e247a68-b99a-4351-8342-ce9a5b54766c None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:34.335819 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e247a68-b99a-4351-8342-ce9a5b54766c None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:34.336282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e247a68-b99a-4351-8342-ce9a5b54766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:34.363575 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-8e247a68-b99a-4351-8342-ce9a5b54766c None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:34.364750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-8e247a68-b99a-4351-8342-ce9a5b54766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:34.400682 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d68482-9d8b-42e7-a9c4-a6a9f185316a None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:34.430305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 69/136] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:34.431218 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e247a68-b99a-4351-8342-ce9a5b54766c None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:34.473825 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257a896-5004-4892-bae6-ccdcf725c934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:34.475012 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257a896-5004-4892-bae6-ccdcf725c934 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:34.475340 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257a896-5004-4892-bae6-ccdcf725c934 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:34.475617 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257a896-5004-4892-bae6-ccdcf725c934 None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:34.476786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257a896-5004-4892-bae6-ccdcf725c934 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a06ae2ea914e91922edccf3b59d6dc)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:34.480246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257a896-5004-4892-bae6-ccdcf725c934 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:34.480246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 68/137] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:34 2022] GET /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:34.480749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257a896-5004-4892-bae6-ccdcf725c934 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:34.581110 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257a896-5004-4892-bae6-ccdcf725c934 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:34.614316 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37822d98-b69b-4698-9ccf-0906965a2c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:34.615174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37822d98-b69b-4698-9ccf-0906965a2c05 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:34.615464 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37822d98-b69b-4698-9ccf-0906965a2c05 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:34.615744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37822d98-b69b-4698-9ccf-0906965a2c05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:34.626268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37822d98-b69b-4698-9ccf-0906965a2c05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:34.633893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-37822d98-b69b-4698-9ccf-0906965a2c05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:32:34.633893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:34.633893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:34.633893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:34.633893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:34.633893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:34.633893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:34.633893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:34.633893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:34.633893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:34.633893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:34.633893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:34.633893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:34.633893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:34.633893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:34.633893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:34.634748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:34.634748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:34.634748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:34.634748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:34.634748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:34.634748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:34.634748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:34.634748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:34.634748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:34.634748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:34.634748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:34.634748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:32:34.634748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:34.634748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:34.634748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:34.634748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:34.636041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:34.636041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:34.636041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:34.636041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:34.636041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:34.636041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:34.636041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:34.636041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:34.636041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:34.636041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:34.636041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:32:34.636041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:32:34.636041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 69/138] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:32:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:34.636041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37822d98-b69b-4698-9ccf-0906965a2c05 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:34.653874 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e247a68-b99a-4351-8342-ce9a5b54766c None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:34.738387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37822d98-b69b-4698-9ccf-0906965a2c05 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:34.748839 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a71e56-6845-43de-aca3-8dda1691e5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:34.749767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a71e56-6845-43de-aca3-8dda1691e5e8 None admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:34.750056 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a71e56-6845-43de-aca3-8dda1691e5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:34.750342 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a71e56-6845-43de-aca3-8dda1691e5e8 None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc/users/ba8f59d247b54efd9168081ed348571f/roles/c3d122a6c9c6478aa2dd7e5b8afe6471` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:34.757116 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a71e56-6845-43de-aca3-8dda1691e5e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8a06ae2ea914e91922edccf3b59d6dc, user_id=ba8f59d247b54efd9168081ed348571f, role_id=c3d122a6c9c6478aa2dd7e5b8afe6471)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:34.758614 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a71e56-6845-43de-aca3-8dda1691e5e8 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:34.774984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a51875-529d-4bd4-bbf0-6fd7005cc4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:34.775895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a51875-529d-4bd4-bbf0-6fd7005cc4b9 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:34.776182 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a51875-529d-4bd4-bbf0-6fd7005cc4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:34.776902 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a51875-529d-4bd4-bbf0-6fd7005cc4b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:34.777973 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a51875-529d-4bd4-bbf0-6fd7005cc4b9 None admin] RBAC: Adding query filter params (role.id=cafece24a80f46f589a1ac3512d79cec, scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc, user.id=c1706219618547f0aae5412d934afd90) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:34.778298 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a51875-529d-4bd4-bbf0-6fd7005cc4b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:34.779959 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a51875-529d-4bd4-bbf0-6fd7005cc4b9 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:34.788487 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 70/139] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:32:34 2022] GET /identity/v3/role_assignments?user.id=c1706219618547f0aae5412d934afd90&scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc&role.id=cafece24a80f46f589a1ac3512d79cec => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:34.789411 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a51875-529d-4bd4-bbf0-6fd7005cc4b9 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:34.797761 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 70/140] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:32:34 2022] PUT /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc/users/ba8f59d247b54efd9168081ed348571f/roles/c3d122a6c9c6478aa2dd7e5b8afe6471 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:32:34.904302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a51875-529d-4bd4-bbf0-6fd7005cc4b9 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:34.941206 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8596e4-e79e-4642-977c-98e821429464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:34.941906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8596e4-e79e-4642-977c-98e821429464 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:34.942190 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8596e4-e79e-4642-977c-98e821429464 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:34.942471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8596e4-e79e-4642-977c-98e821429464 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:34.943345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8596e4-e79e-4642-977c-98e821429464 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:34.943659 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8596e4-e79e-4642-977c-98e821429464 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:34.945164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8596e4-e79e-4642-977c-98e821429464 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:34.954418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 71/141] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:34.960051 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a71e56-6845-43de-aca3-8dda1691e5e8 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:35.071979 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a71e56-6845-43de-aca3-8dda1691e5e8 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:35.107492 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c657109-ee74-46f1-927f-dc03354ff9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:35.108391 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c657109-ee74-46f1-927f-dc03354ff9d8 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:35.108675 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c657109-ee74-46f1-927f-dc03354ff9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:35.108951 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c657109-ee74-46f1-927f-dc03354ff9d8 None admin] PATH_INFO: `/v3/users/8799b046633442a48a4bc8f6f80a2cb9` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:35.110178 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c657109-ee74-46f1-927f-dc03354ff9d8 None admin] RBAC: Authorizing `identity:get_user(user_id=8799b046633442a48a4bc8f6f80a2cb9)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:35.111674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c657109-ee74-46f1-927f-dc03354ff9d8 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:35.113635 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 71/142] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:34 2022] GET /identity/v3/users/8799b046633442a48a4bc8f6f80a2cb9 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:35.119244 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8596e4-e79e-4642-977c-98e821429464 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:35.221012 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8596e4-e79e-4642-977c-98e821429464 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:35.242451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d9910-e1a2-42c8-b0bb-e791e1bf6fd5 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:35.242765 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d9910-e1a2-42c8-b0bb-e791e1bf6fd5 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:35.243075 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d9910-e1a2-42c8-b0bb-e791e1bf6fd5 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:35.244391 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 72/143] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:35.250283 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eea585-d008-4996-974d-7592209d3f5e None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:35.250568 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eea585-d008-4996-974d-7592209d3f5e None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:35.250846 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eea585-d008-4996-974d-7592209d3f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:35.264892 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d0a40-6601-4d55-b638-8dc3c3ddd020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:35.265890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d0a40-6601-4d55-b638-8dc3c3ddd020 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:35.266368 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d0a40-6601-4d55-b638-8dc3c3ddd020 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:35.266849 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d0a40-6601-4d55-b638-8dc3c3ddd020 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:35.284960 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-85eea585-d008-4996-974d-7592209d3f5e None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:35.286537 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-85eea585-d008-4996-974d-7592209d3f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:35.422831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d0a40-6601-4d55-b638-8dc3c3ddd020 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:35.424370 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d0a40-6601-4d55-b638-8dc3c3ddd020 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:35.445034 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 73/144] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:32:35.483408 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eea585-d008-4996-974d-7592209d3f5e None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:35.594279 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 72/145] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:32:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:32:35.599953 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d0a40-6601-4d55-b638-8dc3c3ddd020 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:35.706719 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eea585-d008-4996-974d-7592209d3f5e None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:35.766880 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d0a40-6601-4d55-b638-8dc3c3ddd020 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:35.783742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16548920-ff51-4fcb-89bd-f8dc188ff55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:35.784564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16548920-ff51-4fcb-89bd-f8dc188ff55f None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:35.784851 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16548920-ff51-4fcb-89bd-f8dc188ff55f None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:35.785129 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16548920-ff51-4fcb-89bd-f8dc188ff55f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:35.807938 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16548920-ff51-4fcb-89bd-f8dc188ff55f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:35.815682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-16548920-ff51-4fcb-89bd-f8dc188ff55f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:35.815682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:35.815682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:35.815682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:35.815682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:35.815682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:35.815682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:35.815682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:35.815682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:35.815682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:35.815682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:35.815682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:35.815682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:35.815682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:35.815682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:35.815682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:35.816550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:35.816550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:35.816550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:35.816550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:35.816550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:35.816550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:35.816550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:35.816550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:35.816550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:35.816550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:35.816550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:35.816550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:32:35.816550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:35.816550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:35.816550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:35.816550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:35.817305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:35.817305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:35.817305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:35.817305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:35.817305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:35.817305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:35.817305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:35.817305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:35.817305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:35.817305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:35.817305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:35.817305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:32:35.823378 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 74/146] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:35.824363 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16548920-ff51-4fcb-89bd-f8dc188ff55f None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:35.852828 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0b5d5-a39d-49bf-bcf2-2d290d0feadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:35.854125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0b5d5-a39d-49bf-bcf2-2d290d0feadc None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:35.854705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0b5d5-a39d-49bf-bcf2-2d290d0feadc None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:35.855326 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0b5d5-a39d-49bf-bcf2-2d290d0feadc None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:35.860104 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0b5d5-a39d-49bf-bcf2-2d290d0feadc None admin] RBAC: Authorizing `identity:get_project(project_id=b8a06ae2ea914e91922edccf3b59d6dc)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:35.861614 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0b5d5-a39d-49bf-bcf2-2d290d0feadc None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:35.864255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 73/147] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:35 2022] GET /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:35.869977 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0b5d5-a39d-49bf-bcf2-2d290d0feadc None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:36.006277 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16548920-ff51-4fcb-89bd-f8dc188ff55f None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:36.049784 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0b5d5-a39d-49bf-bcf2-2d290d0feadc None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:36.066604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d75ca8-a7e5-4249-999a-2a19bc8cf8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:36.067363 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d75ca8-a7e5-4249-999a-2a19bc8cf8c7 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:36.067650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d75ca8-a7e5-4249-999a-2a19bc8cf8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:36.067933 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d75ca8-a7e5-4249-999a-2a19bc8cf8c7 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:36.068694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d75ca8-a7e5-4249-999a-2a19bc8cf8c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:36.069020 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d75ca8-a7e5-4249-999a-2a19bc8cf8c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:36.070445 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d75ca8-a7e5-4249-999a-2a19bc8cf8c7 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:36.079909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 75/148] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:32:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:36.085544 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d75ca8-a7e5-4249-999a-2a19bc8cf8c7 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:36.098234 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b57dbc-8b56-4165-a93c-3f23f1ed2a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:36.099561 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b57dbc-8b56-4165-a93c-3f23f1ed2a2c None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:36.100013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b57dbc-8b56-4165-a93c-3f23f1ed2a2c None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:36.100423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b57dbc-8b56-4165-a93c-3f23f1ed2a2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:36.101424 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b57dbc-8b56-4165-a93c-3f23f1ed2a2c None admin] RBAC: Adding query filter params (role.id=59778f07f0504e90a60212f460e8c774, scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc, user.id=8799b046633442a48a4bc8f6f80a2cb9) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:36.101864 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b57dbc-8b56-4165-a93c-3f23f1ed2a2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:36.103538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b57dbc-8b56-4165-a93c-3f23f1ed2a2c None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:36.110676 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 74/149] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:32:35 2022] GET /identity/v3/role_assignments?user.id=8799b046633442a48a4bc8f6f80a2cb9&scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc&role.id=59778f07f0504e90a60212f460e8c774 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:36.255573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d75ca8-a7e5-4249-999a-2a19bc8cf8c7 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:36.295664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d3242-b411-4d19-aa56-732b00557c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:36.296827 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d3242-b411-4d19-aa56-732b00557c93 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:36.297257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d3242-b411-4d19-aa56-732b00557c93 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:36.297669 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d3242-b411-4d19-aa56-732b00557c93 None admin] PATH_INFO: `/v3/users/ba8f59d247b54efd9168081ed348571f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:36.299840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d3242-b411-4d19-aa56-732b00557c93 None admin] RBAC: Authorizing `identity:get_user(user_id=ba8f59d247b54efd9168081ed348571f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:36.301348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d3242-b411-4d19-aa56-732b00557c93 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:36.303402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 76/150] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:36 2022] GET /identity/v3/users/ba8f59d247b54efd9168081ed348571f => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:36.308948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b57dbc-8b56-4165-a93c-3f23f1ed2a2c None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:36.445133 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b57dbc-8b56-4165-a93c-3f23f1ed2a2c None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:36.484793 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c71b3a-0951-4cbd-bf82-5575b04bc512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:36.485465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c71b3a-0951-4cbd-bf82-5575b04bc512 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:36.485755 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c71b3a-0951-4cbd-bf82-5575b04bc512 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:36.486034 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c71b3a-0951-4cbd-bf82-5575b04bc512 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:36.502853 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8af0da-83eb-4763-82a0-06ddfebdf3f3 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:36.503428 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8af0da-83eb-4763-82a0-06ddfebdf3f3 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:36.503428 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8af0da-83eb-4763-82a0-06ddfebdf3f3 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:36.504829 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 77/151] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:32:36.510496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbada6-e405-498c-9d8f-920f38b1a1b2 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:36.510797 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbada6-e405-498c-9d8f-920f38b1a1b2 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:36.511183 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbada6-e405-498c-9d8f-920f38b1a1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:36.544362 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-5bdbada6-e405-498c-9d8f-920f38b1a1b2 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:36.547719 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-5bdbada6-e405-498c-9d8f-920f38b1a1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:36.580578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c71b3a-0951-4cbd-bf82-5575b04bc512 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:36.582321 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c71b3a-0951-4cbd-bf82-5575b04bc512 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:36.621307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 78/152] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:32:36.645230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbada6-e405-498c-9d8f-920f38b1a1b2 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:36.760408 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbada6-e405-498c-9d8f-920f38b1a1b2 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:36.799335 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84e3b3-5971-41b5-85a6-e477bca5842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:36.800080 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84e3b3-5971-41b5-85a6-e477bca5842f None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:36.800367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84e3b3-5971-41b5-85a6-e477bca5842f None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:36.800659 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84e3b3-5971-41b5-85a6-e477bca5842f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:36.811916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84e3b3-5971-41b5-85a6-e477bca5842f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:36.820466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-aa84e3b3-5971-41b5-85a6-e477bca5842f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:36.820466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:36.820466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:36.820466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:36.820466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:36.820466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:36.820466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:36.820466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:36.820466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:36.820466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:36.820466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:36.820466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:36.820466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:36.820466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:36.820466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:36.820466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:36.821312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:36.821312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:36.821312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:36.821312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:36.821312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:36.821312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:36.821312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:36.821312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:36.821312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:36.821312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:36.821312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:36.821312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:32:36.821312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:36.821312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:36.821312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:36.821312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:36.822064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:36.822064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:36.822064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:36.822064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:36.822064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:36.822064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:36.822064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:36.822064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:36.822064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:36.822064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:36.822064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:36.822064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:32:36.822064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 79/153] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:36.827791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 75/154] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:32:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:32:36.829196 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4c7c2-2fc2-48a7-ba34-a0c395a0fe7d None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:36.829488 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4c7c2-2fc2-48a7-ba34-a0c395a0fe7d None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:36.829769 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4c7c2-2fc2-48a7-ba34-a0c395a0fe7d None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:36.831501 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 80/155] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:32:36.832914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c71b3a-0951-4cbd-bf82-5575b04bc512 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:36.837597 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101db37d-9b4a-4d4a-a0f7-ffb09100ee1d None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:36.837597 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101db37d-9b4a-4d4a-a0f7-ffb09100ee1d None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:36.837597 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101db37d-9b4a-4d4a-a0f7-ffb09100ee1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:36.862562 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-101db37d-9b4a-4d4a-a0f7-ffb09100ee1d None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:36.864057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-101db37d-9b4a-4d4a-a0f7-ffb09100ee1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:36.938177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 81/156] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:32:36.939156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101db37d-9b4a-4d4a-a0f7-ffb09100ee1d None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:36.944304 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c71b3a-0951-4cbd-bf82-5575b04bc512 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:36.980980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cd51e-e342-477e-ab2f-5bd71adeb216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:36.982156 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cd51e-e342-477e-ab2f-5bd71adeb216 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:36.982603 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cd51e-e342-477e-ab2f-5bd71adeb216 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:36.983061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cd51e-e342-477e-ab2f-5bd71adeb216 None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:36.985112 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cd51e-e342-477e-ab2f-5bd71adeb216 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a06ae2ea914e91922edccf3b59d6dc)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:36.987233 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cd51e-e342-477e-ab2f-5bd71adeb216 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:36.990095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 76/157] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:36 2022] GET /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:36.991342 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cd51e-e342-477e-ab2f-5bd71adeb216 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:37.065863 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101db37d-9b4a-4d4a-a0f7-ffb09100ee1d None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:37.104596 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182200e-2b69-4428-920c-19501337b2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:37.105916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182200e-2b69-4428-920c-19501337b2eb None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:37.106276 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182200e-2b69-4428-920c-19501337b2eb None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:37.106630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182200e-2b69-4428-920c-19501337b2eb None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:37.107661 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182200e-2b69-4428-920c-19501337b2eb None admin] RBAC: Adding query filter params (name=member) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:37.108337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182200e-2b69-4428-920c-19501337b2eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:37.110067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182200e-2b69-4428-920c-19501337b2eb None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:37.111182 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cd51e-e342-477e-ab2f-5bd71adeb216 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:37.119577 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 82/158] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:32:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:37.124380 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182200e-2b69-4428-920c-19501337b2eb None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:37.150509 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a5166-3a22-4a14-b721-d2830c5092de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:37.151389 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a5166-3a22-4a14-b721-d2830c5092de None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:37.151673 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a5166-3a22-4a14-b721-d2830c5092de None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:37.152325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a5166-3a22-4a14-b721-d2830c5092de None admin] PATH_INFO: `/v3/domains/default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:37.153360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a5166-3a22-4a14-b721-d2830c5092de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:37.154939 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a5166-3a22-4a14-b721-d2830c5092de None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:37.156665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 77/159] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:32:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:37.161952 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a5166-3a22-4a14-b721-d2830c5092de None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:37.240461 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182200e-2b69-4428-920c-19501337b2eb None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:37.272832 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a5166-3a22-4a14-b721-d2830c5092de None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:37.281251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59e04c-6ed4-48b1-9071-31e9f6ac42db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:37.282549 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59e04c-6ed4-48b1-9071-31e9f6ac42db None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:37.283059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59e04c-6ed4-48b1-9071-31e9f6ac42db None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:37.283541 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59e04c-6ed4-48b1-9071-31e9f6ac42db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:37.285083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59e04c-6ed4-48b1-9071-31e9f6ac42db None admin] RBAC: Adding query filter params (role.id=b03b07e63e164e6a8858592b025c8103, scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc, user.id=ba8f59d247b54efd9168081ed348571f) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:37.285579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59e04c-6ed4-48b1-9071-31e9f6ac42db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:37.287723 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59e04c-6ed4-48b1-9071-31e9f6ac42db None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:37.295653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 83/160] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:32:37 2022] GET /identity/v3/role_assignments?user.id=ba8f59d247b54efd9168081ed348571f&scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc&role.id=b03b07e63e164e6a8858592b025c8103 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:37.296903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59e04c-6ed4-48b1-9071-31e9f6ac42db None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:37.308540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789099d-9427-462a-90cb-14ad343e6056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:37.309814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789099d-9427-462a-90cb-14ad343e6056 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:37.309814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789099d-9427-462a-90cb-14ad343e6056 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:37.310189 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789099d-9427-462a-90cb-14ad343e6056 None admin] PATH_INFO: `/v3/users/ba8f59d247b54efd9168081ed348571f` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:37.311732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789099d-9427-462a-90cb-14ad343e6056 None admin] RBAC: Authorizing `identity:get_user(user_id=ba8f59d247b54efd9168081ed348571f)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:37.313383 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789099d-9427-462a-90cb-14ad343e6056 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:37.315380 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 78/161] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:37 2022] GET /identity/v3/users/ba8f59d247b54efd9168081ed348571f => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:37.328437 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789099d-9427-462a-90cb-14ad343e6056 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:37.422738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59e04c-6ed4-48b1-9071-31e9f6ac42db None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:37.464449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d6db0-0c20-4348-bdf2-52b9c4671945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:37.466207 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d6db0-0c20-4348-bdf2-52b9c4671945 None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:37.471515 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d6db0-0c20-4348-bdf2-52b9c4671945 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:37.471799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d6db0-0c20-4348-bdf2-52b9c4671945 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:37.472578 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d6db0-0c20-4348-bdf2-52b9c4671945 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:37.474399 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d6db0-0c20-4348-bdf2-52b9c4671945 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:37.518158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789099d-9427-462a-90cb-14ad343e6056 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:37.530045 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 84/162] 10.222.0.11 () {60 vars in 1132 bytes} [Wed May 4 21:32:37 2022] POST /identity/v3/users => generated 283 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:32:37.558327 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcd4f4-f975-401a-ac72-c944577136f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:37.559458 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcd4f4-f975-401a-ac72-c944577136f2 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:37.559918 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcd4f4-f975-401a-ac72-c944577136f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:37.560358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcd4f4-f975-401a-ac72-c944577136f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:37.645331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcd4f4-f975-401a-ac72-c944577136f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:37.646919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcd4f4-f975-401a-ac72-c944577136f2 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:37.758243 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 79/163] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:32:37.768269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d6db0-0c20-4348-bdf2-52b9c4671945 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:37.838549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9a75f-ff64-4f6a-9872-17c74735b5a6 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:37.838921 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9a75f-ff64-4f6a-9872-17c74735b5a6 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:37.839142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9a75f-ff64-4f6a-9872-17c74735b5a6 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:37.840824 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 80/164] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:32:37.847631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead0fad-e1cd-4db6-a1f3-6f37f05fe197 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:37.847917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead0fad-e1cd-4db6-a1f3-6f37f05fe197 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:37.848191 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead0fad-e1cd-4db6-a1f3-6f37f05fe197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:37.866705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-3ead0fad-e1cd-4db6-a1f3-6f37f05fe197 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:37.867922 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-3ead0fad-e1cd-4db6-a1f3-6f37f05fe197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:37.897282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d6db0-0c20-4348-bdf2-52b9c4671945 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:37.938721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153159af-c38a-4dc6-b8d9-7bb04fa27eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:37.939634 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153159af-c38a-4dc6-b8d9-7bb04fa27eb7 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:37.939918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153159af-c38a-4dc6-b8d9-7bb04fa27eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:37.940201 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153159af-c38a-4dc6-b8d9-7bb04fa27eb7 None admin] PATH_INFO: `/v3/projects/2a0a9c241dc94774b44d525c3de35603` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:37.941408 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153159af-c38a-4dc6-b8d9-7bb04fa27eb7 None admin] RBAC: Authorizing `identity:get_project(project_id=2a0a9c241dc94774b44d525c3de35603)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:37.942851 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153159af-c38a-4dc6-b8d9-7bb04fa27eb7 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:37.944624 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 81/165] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:37.944739 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 85/166] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:37 2022] GET /identity/v3/projects/2a0a9c241dc94774b44d525c3de35603 => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:37.951277 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead0fad-e1cd-4db6-a1f3-6f37f05fe197 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:37.955776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580177a-e0ff-4a1a-bc60-cec89d1b9ef4 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:37.956148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580177a-e0ff-4a1a-bc60-cec89d1b9ef4 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:37.956496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580177a-e0ff-4a1a-bc60-cec89d1b9ef4 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:37.958193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 86/167] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:32:37.963417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d193e2-def1-4d05-ae8b-2cd8f1cc12b9 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:37.963548 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d193e2-def1-4d05-ae8b-2cd8f1cc12b9 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:37.963924 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d193e2-def1-4d05-ae8b-2cd8f1cc12b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:37.984103 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-85d193e2-def1-4d05-ae8b-2cd8f1cc12b9 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:37.985304 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-85d193e2-def1-4d05-ae8b-2cd8f1cc12b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:38.064981 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 87/168] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:38.066722 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d193e2-def1-4d05-ae8b-2cd8f1cc12b9 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:38.069549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead0fad-e1cd-4db6-a1f3-6f37f05fe197 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:38.122836 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34648e-b16a-4226-8ca2-53b42d50d212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:38.123459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34648e-b16a-4226-8ca2-53b42d50d212 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:38.123737 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34648e-b16a-4226-8ca2-53b42d50d212 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:38.124005 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34648e-b16a-4226-8ca2-53b42d50d212 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:38.124845 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34648e-b16a-4226-8ca2-53b42d50d212 None admin] RBAC: Adding query filter params (role.id=b03b07e63e164e6a8858592b025c8103, scope.project.id=2a0a9c241dc94774b44d525c3de35603, user.id=ba8f59d247b54efd9168081ed348571f) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:38.125160 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34648e-b16a-4226-8ca2-53b42d50d212 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:38.126611 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34648e-b16a-4226-8ca2-53b42d50d212 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:38.133103 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 82/169] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:32:37 2022] GET /identity/v3/role_assignments?user.id=ba8f59d247b54efd9168081ed348571f&scope.project.id=2a0a9c241dc94774b44d525c3de35603&role.id=b03b07e63e164e6a8858592b025c8103 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:38.133914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34648e-b16a-4226-8ca2-53b42d50d212 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:38.193447 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d193e2-def1-4d05-ae8b-2cd8f1cc12b9 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:38.241087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571827f-e865-4ae3-8e89-704426fc28ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:38.242045 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571827f-e865-4ae3-8e89-704426fc28ea None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:38.242421 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571827f-e865-4ae3-8e89-704426fc28ea None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:38.243022 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571827f-e865-4ae3-8e89-704426fc28ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:38.248564 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34648e-b16a-4226-8ca2-53b42d50d212 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:38.260503 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571827f-e865-4ae3-8e89-704426fc28ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:38.271923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-e571827f-e865-4ae3-8e89-704426fc28ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:32:38.271923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:38.271923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:38.271923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:38.271923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:38.271923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:38.271923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:38.271923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:38.271923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:38.271923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:38.271923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:38.271923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:38.271923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:38.271923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:38.271923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:38.271923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:38.272929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:38.272929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:38.272929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:38.272929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:38.272929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:38.272929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:38.272929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:38.272929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:38.272929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:38.272929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:38.272929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:38.272929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:32:38.272929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:38.272929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:38.272929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:38.272929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:38.274198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:38.274198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:38.274198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:38.274198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:38.274198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:38.274198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:38.274198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:38.274198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:38.274198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:38.274198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:38.274198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:32:38.274198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:32:38.274198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 88/170] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:32:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:38.280229 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571827f-e865-4ae3-8e89-704426fc28ea None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:38.291161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e83741-dc13-4272-a2f9-eeef7b710943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:38.292107 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e83741-dc13-4272-a2f9-eeef7b710943 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:38.292515 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e83741-dc13-4272-a2f9-eeef7b710943 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:38.292975 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e83741-dc13-4272-a2f9-eeef7b710943 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:38.305096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e83741-dc13-4272-a2f9-eeef7b710943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:38.313373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-84e83741-dc13-4272-a2f9-eeef7b710943 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:32:38.313373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:38.313373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:38.313373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:38.313373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:38.313373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:38.313373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:38.313373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:38.313373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:38.313373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:38.313373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:38.313373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:38.313373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:38.313373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:38.313373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:38.313373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:38.314344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:38.314344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:38.314344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:38.314344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:38.314344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:38.314344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:38.314344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:38.314344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:38.314344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:38.314344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:38.314344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:38.314344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:32:38.314344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:38.314344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:38.314344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:38.314344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:38.315138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:38.315138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:38.315138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:38.315138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:38.315138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:38.315138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:38.315138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:38.315138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:38.315138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:38.315138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:38.315138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:32:38.315138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:32:38.315138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 83/171] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:38.322822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e83741-dc13-4272-a2f9-eeef7b710943 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:38.416022 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571827f-e865-4ae3-8e89-704426fc28ea None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:38.440221 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e83741-dc13-4272-a2f9-eeef7b710943 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:38.460530 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c6fa3-6d54-448f-918b-be4d226c10b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:38.461572 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c6fa3-6d54-448f-918b-be4d226c10b0 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:38.462504 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c6fa3-6d54-448f-918b-be4d226c10b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:38.462986 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c6fa3-6d54-448f-918b-be4d226c10b0 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:38.464385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c6fa3-6d54-448f-918b-be4d226c10b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:38.465015 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c6fa3-6d54-448f-918b-be4d226c10b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:38.467346 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c6fa3-6d54-448f-918b-be4d226c10b0 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:38.476589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783ef93-9017-4f25-9d5f-e6739202e48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:38.477348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783ef93-9017-4f25-9d5f-e6739202e48c None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:38.477714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783ef93-9017-4f25-9d5f-e6739202e48c None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:38.478058 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783ef93-9017-4f25-9d5f-e6739202e48c None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:38.478870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783ef93-9017-4f25-9d5f-e6739202e48c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:38.479272 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783ef93-9017-4f25-9d5f-e6739202e48c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:38.479740 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 89/172] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:32:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:38.483289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783ef93-9017-4f25-9d5f-e6739202e48c None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:38.486604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c6fa3-6d54-448f-918b-be4d226c10b0 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:38.492191 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 84/173] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:32:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:38.497790 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783ef93-9017-4f25-9d5f-e6739202e48c None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:38.602250 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783ef93-9017-4f25-9d5f-e6739202e48c None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:38.606616 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c6fa3-6d54-448f-918b-be4d226c10b0 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:38.635960 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25836cf-0d05-476d-a2e5-1dc774faf8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:38.637248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25836cf-0d05-476d-a2e5-1dc774faf8f8 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:38.637619 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25836cf-0d05-476d-a2e5-1dc774faf8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:38.638037 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25836cf-0d05-476d-a2e5-1dc774faf8f8 None admin] PATH_INFO: `/v3/users/c1706219618547f0aae5412d934afd90` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:38.639279 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25836cf-0d05-476d-a2e5-1dc774faf8f8 None admin] RBAC: Authorizing `identity:get_user(user_id=c1706219618547f0aae5412d934afd90)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:38.641015 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25836cf-0d05-476d-a2e5-1dc774faf8f8 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:38.643213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 85/174] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:38 2022] GET /identity/v3/users/c1706219618547f0aae5412d934afd90 => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:38.643531 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a49df-c0fd-4323-a022-bee3145c1a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:38.644589 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a49df-c0fd-4323-a022-bee3145c1a00 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:38.645139 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a49df-c0fd-4323-a022-bee3145c1a00 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:38.645573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a49df-c0fd-4323-a022-bee3145c1a00 None admin] PATH_INFO: `/v3/users/ba8f59d247b54efd9168081ed348571f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:38.647173 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a49df-c0fd-4323-a022-bee3145c1a00 None admin] RBAC: Authorizing `identity:get_user(user_id=ba8f59d247b54efd9168081ed348571f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:38.648816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a49df-c0fd-4323-a022-bee3145c1a00 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:38.648924 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25836cf-0d05-476d-a2e5-1dc774faf8f8 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:38.650758 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 90/175] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:38 2022] GET /identity/v3/users/ba8f59d247b54efd9168081ed348571f => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:38.656710 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a49df-c0fd-4323-a022-bee3145c1a00 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:38.748548 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25836cf-0d05-476d-a2e5-1dc774faf8f8 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:38.760549 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a49df-c0fd-4323-a022-bee3145c1a00 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:38.782445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555ccff-6282-4226-ba9a-6c852c938fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:38.783452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555ccff-6282-4226-ba9a-6c852c938fa5 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:38.783803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555ccff-6282-4226-ba9a-6c852c938fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:38.784153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555ccff-6282-4226-ba9a-6c852c938fa5 None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:38.785692 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555ccff-6282-4226-ba9a-6c852c938fa5 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a06ae2ea914e91922edccf3b59d6dc)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:38.786950 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555ccff-6282-4226-ba9a-6c852c938fa5 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:38.789101 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 86/176] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:38 2022] GET /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:38.794957 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555ccff-6282-4226-ba9a-6c852c938fa5 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:38.797000 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbe69f-5ec4-4de6-ab6d-a6b33bf0cdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:38.797894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbe69f-5ec4-4de6-ab6d-a6b33bf0cdac None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:38.798351 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbe69f-5ec4-4de6-ab6d-a6b33bf0cdac None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:38.798859 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbe69f-5ec4-4de6-ab6d-a6b33bf0cdac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:38.871172 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbe69f-5ec4-4de6-ab6d-a6b33bf0cdac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:38.873018 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbe69f-5ec4-4de6-ab6d-a6b33bf0cdac None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:38.891834 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555ccff-6282-4226-ba9a-6c852c938fa5 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:38.924740 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfc737-1934-4e29-80cd-e569a16d39b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:38.925446 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfc737-1934-4e29-80cd-e569a16d39b9 None admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:38.925795 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfc737-1934-4e29-80cd-e569a16d39b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:38.926136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfc737-1934-4e29-80cd-e569a16d39b9 None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc/users/c1706219618547f0aae5412d934afd90/roles/cafece24a80f46f589a1ac3512d79cec` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:38.928197 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfc737-1934-4e29-80cd-e569a16d39b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8a06ae2ea914e91922edccf3b59d6dc, user_id=c1706219618547f0aae5412d934afd90, role_id=cafece24a80f46f589a1ac3512d79cec)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:38.929698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfc737-1934-4e29-80cd-e569a16d39b9 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:38.946893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 87/177] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:32:38 2022] PUT /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc/users/c1706219618547f0aae5412d934afd90/roles/cafece24a80f46f589a1ac3512d79cec => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:32:38.983370 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 91/178] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:32:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:32:38.985815 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfc737-1934-4e29-80cd-e569a16d39b9 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:39.090436 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfc737-1934-4e29-80cd-e569a16d39b9 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:39.135888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4bff9-9eed-4806-9f4d-e4bb86818309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:39.137118 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4bff9-9eed-4806-9f4d-e4bb86818309 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:39.137572 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4bff9-9eed-4806-9f4d-e4bb86818309 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:39.138022 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4bff9-9eed-4806-9f4d-e4bb86818309 None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:39.139555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4bff9-9eed-4806-9f4d-e4bb86818309 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a06ae2ea914e91922edccf3b59d6dc)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:39.141348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4bff9-9eed-4806-9f4d-e4bb86818309 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:39.143531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 88/179] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:38 2022] GET /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:39.149687 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbe69f-5ec4-4de6-ab6d-a6b33bf0cdac None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:39.255336 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbe69f-5ec4-4de6-ab6d-a6b33bf0cdac None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:39.291078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349894e-ac0b-418b-959e-1d9500c23256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:39.291749 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349894e-ac0b-418b-959e-1d9500c23256 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:39.292033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349894e-ac0b-418b-959e-1d9500c23256 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:39.292337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349894e-ac0b-418b-959e-1d9500c23256 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:39.293238 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349894e-ac0b-418b-959e-1d9500c23256 None admin] RBAC: Adding query filter params (role.id=c3d122a6c9c6478aa2dd7e5b8afe6471, scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc, user.id=ba8f59d247b54efd9168081ed348571f) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:39.293553 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349894e-ac0b-418b-959e-1d9500c23256 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:39.295073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349894e-ac0b-418b-959e-1d9500c23256 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:39.301479 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 92/180] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:32:39 2022] GET /identity/v3/role_assignments?user.id=ba8f59d247b54efd9168081ed348571f&scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc&role.id=c3d122a6c9c6478aa2dd7e5b8afe6471 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:40.407280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5b625-86cb-4868-83e2-49480b013679 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:40.407834 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5b625-86cb-4868-83e2-49480b013679 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:40.407834 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5b625-86cb-4868-83e2-49480b013679 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:40.409601 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 89/181] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:40.415809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad62cb-1c05-478d-9bb9-14fc88be7f6d None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:40.416350 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad62cb-1c05-478d-9bb9-14fc88be7f6d None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:40.416350 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad62cb-1c05-478d-9bb9-14fc88be7f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:40.434422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-37ad62cb-1c05-478d-9bb9-14fc88be7f6d None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:40.435669 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-37ad62cb-1c05-478d-9bb9-14fc88be7f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:40.507153 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 93/182] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:32:40.527414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5b625-86cb-4868-83e2-49480b013679 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:40.630235 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5b625-86cb-4868-83e2-49480b013679 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:40.665541 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc18b0a-64c2-4c72-a4e4-1694c7e51bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:40.666292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc18b0a-64c2-4c72-a4e4-1694c7e51bbb None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:40.666578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc18b0a-64c2-4c72-a4e4-1694c7e51bbb None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:40.666858 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc18b0a-64c2-4c72-a4e4-1694c7e51bbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:40.679830 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc18b0a-64c2-4c72-a4e4-1694c7e51bbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:40.688121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-dcc18b0a-64c2-4c72-a4e4-1694c7e51bbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:32:40.688121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:40.688121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:40.688121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:40.688121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:40.688121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:40.688121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:40.688121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:40.688121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:40.688121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:40.688121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:40.688121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:40.688121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:40.688121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:40.688121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:40.688121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:40.690343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:40.690343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:40.690343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:40.690343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:40.690343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:40.690343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:40.690343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:40.690343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:40.690343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:40.690343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:40.690343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:40.690343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:32:40.690343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:40.690343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:40.690343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:40.690343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:40.692325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:40.692325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:40.692325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:40.692325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:40.692325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:40.692325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:40.692325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:40.692325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:40.692325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:40.692325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:40.692325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:32:40.692325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:32:40.695092 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 90/183] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:32:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:40.696562 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad62cb-1c05-478d-9bb9-14fc88be7f6d None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:40.800755 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad62cb-1c05-478d-9bb9-14fc88be7f6d None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:40.838606 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d0890-5f8b-4245-af84-92b63dbcc95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:40.839694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d0890-5f8b-4245-af84-92b63dbcc95c None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:40.840122 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d0890-5f8b-4245-af84-92b63dbcc95c None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:40.840539 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d0890-5f8b-4245-af84-92b63dbcc95c None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:40.841461 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d0890-5f8b-4245-af84-92b63dbcc95c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:40.841911 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d0890-5f8b-4245-af84-92b63dbcc95c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:40.843479 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d0890-5f8b-4245-af84-92b63dbcc95c None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:40.855719 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 94/184] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:40.857545 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4fdac-5890-4c71-ae40-1a6ddbe9b0ac None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:40.858011 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4fdac-5890-4c71-ae40-1a6ddbe9b0ac None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:40.858508 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4fdac-5890-4c71-ae40-1a6ddbe9b0ac None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:40.860566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 91/185] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:40.861432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d0890-5f8b-4245-af84-92b63dbcc95c None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:40.867612 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30c77c-ba33-4ea0-bad2-a66e7ffa3c9c None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:40.868174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30c77c-ba33-4ea0-bad2-a66e7ffa3c9c None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:40.868666 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30c77c-ba33-4ea0-bad2-a66e7ffa3c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:40.890454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-7a30c77c-ba33-4ea0-bad2-a66e7ffa3c9c None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:40.892545 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-7a30c77c-ba33-4ea0-bad2-a66e7ffa3c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:40.962018 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d0890-5f8b-4245-af84-92b63dbcc95c None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:40.972921 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 92/186] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:40.976044 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75698c2f-797c-4ff3-9c80-870a33e462a6 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:40.976579 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75698c2f-797c-4ff3-9c80-870a33e462a6 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:40.977051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75698c2f-797c-4ff3-9c80-870a33e462a6 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:40.978598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 93/187] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:32:40.984348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fe814-da91-41d9-b886-7d140dfa6621 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:40.984906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fe814-da91-41d9-b886-7d140dfa6621 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:40.985391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fe814-da91-41d9-b886-7d140dfa6621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:40.998711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7a2a8-d6b9-4193-a7f5-03640c34d5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:40.999637 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7a2a8-d6b9-4193-a7f5-03640c34d5a9 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:40.999922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7a2a8-d6b9-4193-a7f5-03640c34d5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:41.000198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7a2a8-d6b9-4193-a7f5-03640c34d5a9 None admin] PATH_INFO: `/v3/users/8538e81c865d4acaad873a82be436495` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:41.003947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-503fe814-da91-41d9-b886-7d140dfa6621 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:41.005354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-503fe814-da91-41d9-b886-7d140dfa6621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:41.014210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7a2a8-d6b9-4193-a7f5-03640c34d5a9 None admin] RBAC: Authorizing `identity:get_user(user_id=8538e81c865d4acaad873a82be436495)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:41.015761 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7a2a8-d6b9-4193-a7f5-03640c34d5a9 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:41.017648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 95/188] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:40 2022] GET /identity/v3/users/8538e81c865d4acaad873a82be436495 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:41.018294 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7a2a8-d6b9-4193-a7f5-03640c34d5a9 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:41.081192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 94/189] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:41.082046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fe814-da91-41d9-b886-7d140dfa6621 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:41.120214 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7a2a8-d6b9-4193-a7f5-03640c34d5a9 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:41.153658 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f5d61-471e-4c23-8c9e-37ae1b8a60dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:41.154483 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f5d61-471e-4c23-8c9e-37ae1b8a60dd None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:41.154768 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f5d61-471e-4c23-8c9e-37ae1b8a60dd None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:41.155065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f5d61-471e-4c23-8c9e-37ae1b8a60dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:41.165956 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f5d61-471e-4c23-8c9e-37ae1b8a60dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:41.174366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-ed1f5d61-471e-4c23-8c9e-37ae1b8a60dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:32:41.174366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:41.174366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:41.174366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:41.174366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:41.174366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:41.174366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:41.174366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:41.174366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:41.174366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:41.174366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:41.174366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:41.174366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:41.174366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:41.174366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:41.174366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:41.175307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:41.175307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:41.175307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:41.175307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:41.175307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:41.175307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:41.175307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:41.175307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:41.175307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:41.175307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:41.175307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:41.175307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:32:41.175307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:41.175307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:41.175307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:41.175307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:41.176108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:41.176108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:41.176108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:41.176108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:41.176108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:41.176108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:41.176108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:41.176108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:41.176108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:41.176108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:41.176108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:32:41.176108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:32:41.176108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 96/190] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:32:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:41.176765 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f5d61-471e-4c23-8c9e-37ae1b8a60dd None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:41.191779 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fe814-da91-41d9-b886-7d140dfa6621 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:41.226324 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfd5eb-7639-443d-81b4-350a59529217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:41.227104 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfd5eb-7639-443d-81b4-350a59529217 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:41.227388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfd5eb-7639-443d-81b4-350a59529217 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:41.227781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfd5eb-7639-443d-81b4-350a59529217 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:41.277605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f5d61-471e-4c23-8c9e-37ae1b8a60dd None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:41.293429 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfd5eb-7639-443d-81b4-350a59529217 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:41.294913 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfd5eb-7639-443d-81b4-350a59529217 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:41.310728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c369e-e787-48ff-b723-ea9ecec653fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:41.311539 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c369e-e787-48ff-b723-ea9ecec653fe None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:41.311824 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c369e-e787-48ff-b723-ea9ecec653fe None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:41.312097 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c369e-e787-48ff-b723-ea9ecec653fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:41.313321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c369e-e787-48ff-b723-ea9ecec653fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:41.314780 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c369e-e787-48ff-b723-ea9ecec653fe None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:41.316485 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 97/191] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:32:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:41.317239 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c369e-e787-48ff-b723-ea9ecec653fe None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:41.399838 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 95/192] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:32:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:32:41.400643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfd5eb-7639-443d-81b4-350a59529217 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:41.432271 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c369e-e787-48ff-b723-ea9ecec653fe None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:41.469967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf819f8-b4c8-47de-b595-7a04ee08525e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:41.470688 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf819f8-b4c8-47de-b595-7a04ee08525e None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:41.470970 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf819f8-b4c8-47de-b595-7a04ee08525e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:41.471283 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf819f8-b4c8-47de-b595-7a04ee08525e None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:41.472229 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf819f8-b4c8-47de-b595-7a04ee08525e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:41.472549 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf819f8-b4c8-47de-b595-7a04ee08525e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:41.474291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf819f8-b4c8-47de-b595-7a04ee08525e None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:41.487449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 98/193] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:32:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:41.487449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf819f8-b4c8-47de-b595-7a04ee08525e None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:41.507226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfd5eb-7639-443d-81b4-350a59529217 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:41.546757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e896a7-2c14-4491-b24c-7e1a72d77970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:41.547470 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e896a7-2c14-4491-b24c-7e1a72d77970 None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:41.547753 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e896a7-2c14-4491-b24c-7e1a72d77970 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:41.548025 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e896a7-2c14-4491-b24c-7e1a72d77970 None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:41.548741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e896a7-2c14-4491-b24c-7e1a72d77970 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:41.550182 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e896a7-2c14-4491-b24c-7e1a72d77970 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:41.572852 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 96/194] 10.222.0.11 () {60 vars in 1132 bytes} [Wed May 4 21:32:41 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:32:41.585622 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e896a7-2c14-4491-b24c-7e1a72d77970 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:41.587957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf819f8-b4c8-47de-b595-7a04ee08525e None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:41.625725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aedec2-f5e5-4a04-a398-3d46fb8c1591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:41.626628 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aedec2-f5e5-4a04-a398-3d46fb8c1591 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:41.626949 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aedec2-f5e5-4a04-a398-3d46fb8c1591 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:41.627217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aedec2-f5e5-4a04-a398-3d46fb8c1591 None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:41.628984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aedec2-f5e5-4a04-a398-3d46fb8c1591 None admin] RBAC: Authorizing `identity:get_project(project_id=70d15e4994bb4da4af477c7904278502)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:41.630456 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aedec2-f5e5-4a04-a398-3d46fb8c1591 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:41.632436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 99/195] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:41 2022] GET /identity/v3/projects/70d15e4994bb4da4af477c7904278502 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:41.633874 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d7a3c-c0fe-41c0-ae68-5567995d838f None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:41.634115 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d7a3c-c0fe-41c0-ae68-5567995d838f None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:41.634722 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d7a3c-c0fe-41c0-ae68-5567995d838f None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:41.636066 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 100/196] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:41.640106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d7a3c-c0fe-41c0-ae68-5567995d838f None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:41.704988 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e896a7-2c14-4491-b24c-7e1a72d77970 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:41.741207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b79cd1-b4a7-42bd-8897-3695ab7e14e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:41.742471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b79cd1-b4a7-42bd-8897-3695ab7e14e1 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:41.742970 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b79cd1-b4a7-42bd-8897-3695ab7e14e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:41.743313 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b79cd1-b4a7-42bd-8897-3695ab7e14e1 None admin] PATH_INFO: `/v3/users/8538e81c865d4acaad873a82be436495` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:41.744762 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b79cd1-b4a7-42bd-8897-3695ab7e14e1 None admin] RBAC: Authorizing `identity:get_user(user_id=8538e81c865d4acaad873a82be436495)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:41.746622 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b79cd1-b4a7-42bd-8897-3695ab7e14e1 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:41.748798 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d7a3c-c0fe-41c0-ae68-5567995d838f None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:41.748922 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 97/197] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:41 2022] GET /identity/v3/users/8538e81c865d4acaad873a82be436495 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:41.750216 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3c8c7-e524-4205-898e-fe4c9d034a09 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:41.750513 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3c8c7-e524-4205-898e-fe4c9d034a09 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:41.750801 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3c8c7-e524-4205-898e-fe4c9d034a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:41.771743 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-d7d3c8c7-e524-4205-898e-fe4c9d034a09 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:41.773132 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-d7d3c8c7-e524-4205-898e-fe4c9d034a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:41.784307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162268b7-cd3c-4908-a8ac-2cd537cb325d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:41.784983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162268b7-cd3c-4908-a8ac-2cd537cb325d None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:41.785276 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162268b7-cd3c-4908-a8ac-2cd537cb325d None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:41.785556 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162268b7-cd3c-4908-a8ac-2cd537cb325d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:41.786435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162268b7-cd3c-4908-a8ac-2cd537cb325d None admin] RBAC: Adding query filter params (role.id=59778f07f0504e90a60212f460e8c774, scope.project.id=70d15e4994bb4da4af477c7904278502, user.id=8538e81c865d4acaad873a82be436495) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:41.786751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162268b7-cd3c-4908-a8ac-2cd537cb325d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:41.788343 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162268b7-cd3c-4908-a8ac-2cd537cb325d None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:41.795831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 101/198] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:32:41 2022] GET /identity/v3/role_assignments?user.id=8538e81c865d4acaad873a82be436495&scope.project.id=70d15e4994bb4da4af477c7904278502&role.id=59778f07f0504e90a60212f460e8c774 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:41.796766 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162268b7-cd3c-4908-a8ac-2cd537cb325d None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:41.872223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 98/199] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:41.896969 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3c8c7-e524-4205-898e-fe4c9d034a09 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:41.931650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162268b7-cd3c-4908-a8ac-2cd537cb325d None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:41.977069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21a94f-2453-4971-b70d-9427d9b3e8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:41.978055 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21a94f-2453-4971-b70d-9427d9b3e8bc None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:41.978518 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21a94f-2453-4971-b70d-9427d9b3e8bc None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:41.978995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21a94f-2453-4971-b70d-9427d9b3e8bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:42.034881 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3c8c7-e524-4205-898e-fe4c9d034a09 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:42.062725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21a94f-2453-4971-b70d-9427d9b3e8bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:42.064525 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21a94f-2453-4971-b70d-9427d9b3e8bc None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:42.078542 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5deefb-f4ca-4f18-af90-a330b5aeab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:42.079468 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5deefb-f4ca-4f18-af90-a330b5aeab28 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:42.079755 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5deefb-f4ca-4f18-af90-a330b5aeab28 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:42.080036 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5deefb-f4ca-4f18-af90-a330b5aeab28 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:42.093366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5deefb-f4ca-4f18-af90-a330b5aeab28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:42.104120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-af5deefb-f4ca-4f18-af90-a330b5aeab28 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:32:42.104120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:42.104120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:42.104120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:42.104120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:42.104120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:42.104120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:42.104120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:42.104120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:42.104120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:42.104120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:42.104120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:42.104120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:42.104120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:42.104120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:42.104120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:42.105826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:42.105826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:42.105826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:42.105826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:42.105826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:42.105826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:42.105826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:42.105826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:42.105826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:42.105826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:42.105826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:42.105826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:32:42.105826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:42.105826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:42.105826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:42.105826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:42.107255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:42.107255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:42.107255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:42.107255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:42.107255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:42.107255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:42.107255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:42.107255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:42.107255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:42.107255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:42.107255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:32:42.107255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:32:42.108818 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 99/200] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:42.118399 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5deefb-f4ca-4f18-af90-a330b5aeab28 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:42.222390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 102/201] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:32:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:32:42.228384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21a94f-2453-4971-b70d-9427d9b3e8bc None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:42.266445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5deefb-f4ca-4f18-af90-a330b5aeab28 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:42.339588 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e539e36-937e-4c56-a34b-0060fa41c4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:42.340198 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e539e36-937e-4c56-a34b-0060fa41c4a3 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:42.340485 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e539e36-937e-4c56-a34b-0060fa41c4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:42.340765 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e539e36-937e-4c56-a34b-0060fa41c4a3 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:42.341528 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e539e36-937e-4c56-a34b-0060fa41c4a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:42.341841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e539e36-937e-4c56-a34b-0060fa41c4a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:42.343260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e539e36-937e-4c56-a34b-0060fa41c4a3 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:42.373215 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 100/202] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:32:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:42.379141 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e539e36-937e-4c56-a34b-0060fa41c4a3 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:42.382589 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21a94f-2453-4971-b70d-9427d9b3e8bc None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:42.431745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df939ed2-cd90-42bf-9a8b-3d65d3e4baba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:42.432632 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df939ed2-cd90-42bf-9a8b-3d65d3e4baba None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:42.433263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df939ed2-cd90-42bf-9a8b-3d65d3e4baba None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:42.433465 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df939ed2-cd90-42bf-9a8b-3d65d3e4baba None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:42.434730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df939ed2-cd90-42bf-9a8b-3d65d3e4baba None admin] RBAC: Authorizing `identity:get_project(project_id=70d15e4994bb4da4af477c7904278502)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:42.436229 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df939ed2-cd90-42bf-9a8b-3d65d3e4baba None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:42.437951 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 103/203] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:42 2022] GET /identity/v3/projects/70d15e4994bb4da4af477c7904278502 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:42.452897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df939ed2-cd90-42bf-9a8b-3d65d3e4baba None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:42.502240 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e539e36-937e-4c56-a34b-0060fa41c4a3 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:42.535192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9bbdc-b25e-4ddc-9424-c46bde8a4050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:42.536079 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9bbdc-b25e-4ddc-9424-c46bde8a4050 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:42.536370 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9bbdc-b25e-4ddc-9424-c46bde8a4050 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:42.536648 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9bbdc-b25e-4ddc-9424-c46bde8a4050 None admin] PATH_INFO: `/v3/users/c1706219618547f0aae5412d934afd90` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:42.537863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9bbdc-b25e-4ddc-9424-c46bde8a4050 None admin] RBAC: Authorizing `identity:get_user(user_id=c1706219618547f0aae5412d934afd90)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:42.539355 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9bbdc-b25e-4ddc-9424-c46bde8a4050 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:42.541299 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 101/204] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:42 2022] GET /identity/v3/users/c1706219618547f0aae5412d934afd90 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:42.546594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9bbdc-b25e-4ddc-9424-c46bde8a4050 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:42.605193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df939ed2-cd90-42bf-9a8b-3d65d3e4baba None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:42.640109 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a84a2a-878c-4c14-bd38-7b89f7ff84f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:42.640781 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a84a2a-878c-4c14-bd38-7b89f7ff84f8 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:42.641071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a84a2a-878c-4c14-bd38-7b89f7ff84f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:42.641350 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a84a2a-878c-4c14-bd38-7b89f7ff84f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:42.642190 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a84a2a-878c-4c14-bd38-7b89f7ff84f8 None admin] RBAC: Adding query filter params (role.id=c3d122a6c9c6478aa2dd7e5b8afe6471, scope.project.id=70d15e4994bb4da4af477c7904278502, user.id=8538e81c865d4acaad873a82be436495) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:42.642507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a84a2a-878c-4c14-bd38-7b89f7ff84f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:42.644121 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a84a2a-878c-4c14-bd38-7b89f7ff84f8 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:42.649949 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 104/205] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:32:42 2022] GET /identity/v3/role_assignments?user.id=8538e81c865d4acaad873a82be436495&scope.project.id=70d15e4994bb4da4af477c7904278502&role.id=c3d122a6c9c6478aa2dd7e5b8afe6471 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:42.775821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9bbdc-b25e-4ddc-9424-c46bde8a4050 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:42.833293 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d5a61-63d5-499a-a61f-5087e2eab2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:42.833982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d5a61-63d5-499a-a61f-5087e2eab2a9 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:42.834274 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d5a61-63d5-499a-a61f-5087e2eab2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:42.834556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d5a61-63d5-499a-a61f-5087e2eab2a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:42.932685 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d5a61-63d5-499a-a61f-5087e2eab2a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:42.934792 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d5a61-63d5-499a-a61f-5087e2eab2a9 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:43.065585 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 102/206] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:32:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 21:32:43.071868 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a84a2a-878c-4c14-bd38-7b89f7ff84f8 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:43.219379 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a84a2a-878c-4c14-bd38-7b89f7ff84f8 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:43.258480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351c815-7e31-464a-af8c-3542eddcc825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:43.259397 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351c815-7e31-464a-af8c-3542eddcc825 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:43.259683 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351c815-7e31-464a-af8c-3542eddcc825 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:43.259964 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351c815-7e31-464a-af8c-3542eddcc825 None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:43.261211 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351c815-7e31-464a-af8c-3542eddcc825 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a06ae2ea914e91922edccf3b59d6dc)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:43.262666 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351c815-7e31-464a-af8c-3542eddcc825 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:43.264719 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 105/207] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:43 2022] GET /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:43.270592 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d5a61-63d5-499a-a61f-5087e2eab2a9 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:43.430776 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d5a61-63d5-499a-a61f-5087e2eab2a9 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:43.474302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876ad99-b875-4c99-840d-2d2260f72893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:43.474907 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876ad99-b875-4c99-840d-2d2260f72893 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:43.475228 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876ad99-b875-4c99-840d-2d2260f72893 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:43.475504 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876ad99-b875-4c99-840d-2d2260f72893 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:43.476341 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876ad99-b875-4c99-840d-2d2260f72893 None admin] RBAC: Adding query filter params (role.id=cafece24a80f46f589a1ac3512d79cec, scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc, user.id=c1706219618547f0aae5412d934afd90) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:43.476656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876ad99-b875-4c99-840d-2d2260f72893 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:43.478120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876ad99-b875-4c99-840d-2d2260f72893 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:43.485000 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 103/208] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:32:43 2022] GET /identity/v3/role_assignments?user.id=c1706219618547f0aae5412d934afd90&scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc&role.id=cafece24a80f46f589a1ac3512d79cec => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:44.293842 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97f6a6-9583-4950-a173-33951736f2ab None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:44.294387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97f6a6-9583-4950-a173-33951736f2ab None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:44.294387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97f6a6-9583-4950-a173-33951736f2ab None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:44.296032 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 106/209] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:44.302429 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832ec82-53bc-4cbb-95c0-7693bd9cf112 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:44.303465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832ec82-53bc-4cbb-95c0-7693bd9cf112 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:44.303970 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832ec82-53bc-4cbb-95c0-7693bd9cf112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:44.323565 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-9832ec82-53bc-4cbb-95c0-7693bd9cf112 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:44.325463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-9832ec82-53bc-4cbb-95c0-7693bd9cf112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:44.397224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 104/210] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:32:44.421209 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97f6a6-9583-4950-a173-33951736f2ab None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:44.505951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd260d-5617-4c4e-939d-9f0c7804c9e7 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:44.506605 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd260d-5617-4c4e-939d-9f0c7804c9e7 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:44.507129 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd260d-5617-4c4e-939d-9f0c7804c9e7 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:44.509869 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 105/211] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:44.515581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfe96c-1a33-4e65-b47a-1578939f5243 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:44.516313 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfe96c-1a33-4e65-b47a-1578939f5243 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:44.517221 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfe96c-1a33-4e65-b47a-1578939f5243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:44.537382 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97f6a6-9583-4950-a173-33951736f2ab None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:44.539238 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-a7bfe96c-1a33-4e65-b47a-1578939f5243 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:44.541525 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a7bfe96c-1a33-4e65-b47a-1578939f5243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:44.584852 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65ad41-5670-4ed0-8931-db3f72fdbe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:44.585864 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65ad41-5670-4ed0-8931-db3f72fdbe9a None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:44.586286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65ad41-5670-4ed0-8931-db3f72fdbe9a None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:44.586696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65ad41-5670-4ed0-8931-db3f72fdbe9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:44.598093 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65ad41-5670-4ed0-8931-db3f72fdbe9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:44.606311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-0c65ad41-5670-4ed0-8931-db3f72fdbe9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:32:44.606311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:44.606311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:44.606311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:44.606311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:44.606311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:44.606311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:44.606311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:44.606311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:44.606311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:44.606311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:44.606311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:44.606311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:44.606311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:44.606311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:44.606311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:44.607261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:44.607261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:44.607261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:44.607261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:44.607261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:44.607261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:44.607261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:44.607261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:44.607261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:44.607261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:44.607261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:44.607261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:32:44.607261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:44.607261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:44.607261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:44.607261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:44.608440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:44.608440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:44.608440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:44.608440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:44.608440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:44.608440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:44.608440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:44.608440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:44.608440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:44.608440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:44.608440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:32:44.608440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:32:44.608440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 107/212] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:32:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:44.609346 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b4cc7-0bea-4ed3-89f0-6ec1da5762c7 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:44.609346 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b4cc7-0bea-4ed3-89f0-6ec1da5762c7 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:44.609346 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b4cc7-0bea-4ed3-89f0-6ec1da5762c7 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:44.610716 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 108/213] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:44.615251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b4cc7-0bea-4ed3-89f0-6ec1da5762c7 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:44.624681 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 106/214] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:44.628847 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9d349-e274-4b79-b16c-43f3fa5ff623 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:44.629682 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9d349-e274-4b79-b16c-43f3fa5ff623 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:44.630169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9d349-e274-4b79-b16c-43f3fa5ff623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:44.652200 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-2ae9d349-e274-4b79-b16c-43f3fa5ff623 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:44.653619 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-2ae9d349-e274-4b79-b16c-43f3fa5ff623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:44.719576 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b4cc7-0bea-4ed3-89f0-6ec1da5762c7 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:44.726568 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 107/215] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:44.729809 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9d349-e274-4b79-b16c-43f3fa5ff623 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:44.756761 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb83a9c-91ad-4a1a-9a59-11a5f36945fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:44.757478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb83a9c-91ad-4a1a-9a59-11a5f36945fd None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:44.758076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb83a9c-91ad-4a1a-9a59-11a5f36945fd None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:44.758179 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb83a9c-91ad-4a1a-9a59-11a5f36945fd None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:44.758924 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb83a9c-91ad-4a1a-9a59-11a5f36945fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:44.759280 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb83a9c-91ad-4a1a-9a59-11a5f36945fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:44.760761 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb83a9c-91ad-4a1a-9a59-11a5f36945fd None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:44.770655 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 109/216] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:44.772078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb83a9c-91ad-4a1a-9a59-11a5f36945fd None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:44.830310 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9d349-e274-4b79-b16c-43f3fa5ff623 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:44.864789 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfa54c-9bda-470d-b2d8-30468f8d90d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:44.865922 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfa54c-9bda-470d-b2d8-30468f8d90d6 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:44.866384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfa54c-9bda-470d-b2d8-30468f8d90d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:44.866795 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfa54c-9bda-470d-b2d8-30468f8d90d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:44.868185 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfa54c-9bda-470d-b2d8-30468f8d90d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:44.868785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb83a9c-91ad-4a1a-9a59-11a5f36945fd None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:44.869986 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfa54c-9bda-470d-b2d8-30468f8d90d6 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:44.871934 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 108/217] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:32:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:44.872864 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfa54c-9bda-470d-b2d8-30468f8d90d6 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:44.903285 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d745a0-3045-4ed0-93ad-198a27d87b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:44.904097 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d745a0-3045-4ed0-93ad-198a27d87b46 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:44.904382 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d745a0-3045-4ed0-93ad-198a27d87b46 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:44.904657 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d745a0-3045-4ed0-93ad-198a27d87b46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:44.914422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d745a0-3045-4ed0-93ad-198a27d87b46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:44.922049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-14d745a0-3045-4ed0-93ad-198a27d87b46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:44.922049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:44.922049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:44.922049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:44.922049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:44.922049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:44.922049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:44.922049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:44.922049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:44.922049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:44.922049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:44.922049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:44.922049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:44.922049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:44.922049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:44.922049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:44.922922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:44.922922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:44.922922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:44.922922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:44.922922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:44.922922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:44.922922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:44.922922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:44.922922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:44.922922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:44.922922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:44.922922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:32:44.922922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:44.922922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:44.922922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:44.922922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:44.926847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:44.926847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:44.926847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:44.926847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:44.926847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:44.926847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:44.926847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:44.926847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:44.926847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:44.926847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:44.926847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:44.926847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:32:44.926847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 110/218] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:44.926847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d745a0-3045-4ed0-93ad-198a27d87b46 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:44.981964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfa54c-9bda-470d-b2d8-30468f8d90d6 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:45.015785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35173f73-085c-4ce0-8740-86e06664b028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:45.016664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35173f73-085c-4ce0-8740-86e06664b028 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:45.016943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35173f73-085c-4ce0-8740-86e06664b028 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:45.017214 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35173f73-085c-4ce0-8740-86e06664b028 None admin] PATH_INFO: `/v3/users/8538e81c865d4acaad873a82be436495` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:45.018395 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35173f73-085c-4ce0-8740-86e06664b028 None admin] RBAC: Authorizing `identity:get_user(user_id=8538e81c865d4acaad873a82be436495)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:45.019890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35173f73-085c-4ce0-8740-86e06664b028 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:45.021124 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d745a0-3045-4ed0-93ad-198a27d87b46 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:45.026142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 109/219] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:44 2022] GET /identity/v3/users/8538e81c865d4acaad873a82be436495 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:45.026142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35173f73-085c-4ce0-8740-86e06664b028 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:45.064509 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445315e-6a3c-403b-bb7e-9429e9952921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:45.065198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445315e-6a3c-403b-bb7e-9429e9952921 None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:45.065481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445315e-6a3c-403b-bb7e-9429e9952921 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:45.065758 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445315e-6a3c-403b-bb7e-9429e9952921 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:45.066484 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445315e-6a3c-403b-bb7e-9429e9952921 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:45.067973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445315e-6a3c-403b-bb7e-9429e9952921 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:45.089530 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 111/220] 10.222.0.11 () {60 vars in 1132 bytes} [Wed May 4 21:32:44 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:32:45.090520 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445315e-6a3c-403b-bb7e-9429e9952921 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:45.144032 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35173f73-085c-4ce0-8740-86e06664b028 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:45.184649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891ef5d-6d29-40d9-a1be-740a79a734fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:45.185754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891ef5d-6d29-40d9-a1be-740a79a734fb None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:45.185754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891ef5d-6d29-40d9-a1be-740a79a734fb None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:45.185943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891ef5d-6d29-40d9-a1be-740a79a734fb None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:45.186665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891ef5d-6d29-40d9-a1be-740a79a734fb None admin] RBAC: Adding query filter params (name=member) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:45.187375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891ef5d-6d29-40d9-a1be-740a79a734fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:45.189782 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891ef5d-6d29-40d9-a1be-740a79a734fb None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:45.204746 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 110/221] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:32:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:45.207196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891ef5d-6d29-40d9-a1be-740a79a734fb None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:45.212610 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445315e-6a3c-403b-bb7e-9429e9952921 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:45.256967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd17cb0-29b9-4264-a832-024d57d7f557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:45.258043 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd17cb0-29b9-4264-a832-024d57d7f557 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:45.259112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd17cb0-29b9-4264-a832-024d57d7f557 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:45.259525 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd17cb0-29b9-4264-a832-024d57d7f557 None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:45.261257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd17cb0-29b9-4264-a832-024d57d7f557 None admin] RBAC: Authorizing `identity:get_project(project_id=70d15e4994bb4da4af477c7904278502)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:45.263171 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd17cb0-29b9-4264-a832-024d57d7f557 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:45.267195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 112/222] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:45 2022] GET /identity/v3/projects/70d15e4994bb4da4af477c7904278502 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:45.272594 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd17cb0-29b9-4264-a832-024d57d7f557 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:45.338349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891ef5d-6d29-40d9-a1be-740a79a734fb None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:45.379279 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2246ca-6ff2-438e-94ed-58788454de8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:45.381095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2246ca-6ff2-438e-94ed-58788454de8f None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:45.381095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2246ca-6ff2-438e-94ed-58788454de8f None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:45.381095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2246ca-6ff2-438e-94ed-58788454de8f None admin] PATH_INFO: `/v3/users/4d1ed18878f1437dae1093f22b6702a4` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:45.388251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd17cb0-29b9-4264-a832-024d57d7f557 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:45.399660 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2246ca-6ff2-438e-94ed-58788454de8f None admin] RBAC: Authorizing `identity:get_user(user_id=4d1ed18878f1437dae1093f22b6702a4)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:45.401074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2246ca-6ff2-438e-94ed-58788454de8f None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:45.403678 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 111/223] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:45 2022] GET /identity/v3/users/4d1ed18878f1437dae1093f22b6702a4 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:45.405203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6020d0-514e-4308-947a-8ea959dee7ca None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:45.405462 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6020d0-514e-4308-947a-8ea959dee7ca None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:45.405739 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6020d0-514e-4308-947a-8ea959dee7ca None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:45.411162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 112/224] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:45.412003 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6020d0-514e-4308-947a-8ea959dee7ca None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:45.434067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6587865-7eaa-449e-89ac-f1c6a713ef4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:45.434990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6587865-7eaa-449e-89ac-f1c6a713ef4c None admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:45.435304 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6587865-7eaa-449e-89ac-f1c6a713ef4c None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:45.435582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6587865-7eaa-449e-89ac-f1c6a713ef4c None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502/users/8538e81c865d4acaad873a82be436495/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:45.438614 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6587865-7eaa-449e-89ac-f1c6a713ef4c None admin] RBAC: Authorizing `identity:create_grant(project_id=70d15e4994bb4da4af477c7904278502, user_id=8538e81c865d4acaad873a82be436495, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:45.439394 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6587865-7eaa-449e-89ac-f1c6a713ef4c None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:45.456551 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 113/225] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:32:45 2022] PUT /identity/v3/projects/70d15e4994bb4da4af477c7904278502/users/8538e81c865d4acaad873a82be436495/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:32:45.457907 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92ac66-45f0-4d8e-a6ec-43bce4c0bb25 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:45.458181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92ac66-45f0-4d8e-a6ec-43bce4c0bb25 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:45.458463 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92ac66-45f0-4d8e-a6ec-43bce4c0bb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:45.487441 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-de92ac66-45f0-4d8e-a6ec-43bce4c0bb25 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:45.489557 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-de92ac66-45f0-4d8e-a6ec-43bce4c0bb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:45.537831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6020d0-514e-4308-947a-8ea959dee7ca None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:45.568124 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 114/226] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:45.598181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92ac66-45f0-4d8e-a6ec-43bce4c0bb25 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:45.606949 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb60367-ec6d-4b1f-8816-638a38c29fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:45.607664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb60367-ec6d-4b1f-8816-638a38c29fcc None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:45.607951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb60367-ec6d-4b1f-8816-638a38c29fcc None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:45.608224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb60367-ec6d-4b1f-8816-638a38c29fcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:45.715642 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb60367-ec6d-4b1f-8816-638a38c29fcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:45.717187 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb60367-ec6d-4b1f-8816-638a38c29fcc None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:45.751150 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92ac66-45f0-4d8e-a6ec-43bce4c0bb25 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:45.790337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437436c-e595-499e-a991-f0bc3a28863e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:45.791190 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437436c-e595-499e-a991-f0bc3a28863e None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:45.791670 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437436c-e595-499e-a991-f0bc3a28863e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:45.791953 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437436c-e595-499e-a991-f0bc3a28863e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:45.814999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437436c-e595-499e-a991-f0bc3a28863e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:45.826000 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 113/227] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:32:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:32:45.826417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-0437436c-e595-499e-a991-f0bc3a28863e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:32:45.826417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:45.826417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:45.826417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:45.826417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:45.826417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:45.826417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:45.826417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:45.826417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:45.826417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:45.826417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:45.826417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:45.826417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:45.826417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:45.826417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:45.826417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:45.827508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:45.827508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:45.827508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:45.827508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:45.827508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:45.827508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:45.827508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:45.827508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:45.827508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:45.827508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:45.827508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:45.827508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:32:45.827508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:45.827508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:45.827508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:45.827508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:45.828422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:45.828422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:45.828422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:45.828422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:45.828422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:45.828422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:45.828422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:45.828422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:45.828422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:45.828422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:45.828422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:32:45.828422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:32:45.830588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 115/228] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:32:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:32:45.836008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb60367-ec6d-4b1f-8816-638a38c29fcc None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:45.836255 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437436c-e595-499e-a991-f0bc3a28863e None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:45.975651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb60367-ec6d-4b1f-8816-638a38c29fcc None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:45.998029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437436c-e595-499e-a991-f0bc3a28863e None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:46.024661 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cebf3-1da9-40a6-b308-30650caf54f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:46.025687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cebf3-1da9-40a6-b308-30650caf54f4 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:46.025995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cebf3-1da9-40a6-b308-30650caf54f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:46.026342 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cebf3-1da9-40a6-b308-30650caf54f4 None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:46.031798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cebf3-1da9-40a6-b308-30650caf54f4 None admin] RBAC: Authorizing `identity:get_project(project_id=70d15e4994bb4da4af477c7904278502)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:46.033360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cebf3-1da9-40a6-b308-30650caf54f4 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:46.043060 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 114/229] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:45 2022] GET /identity/v3/projects/70d15e4994bb4da4af477c7904278502 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:46.043060 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cebf3-1da9-40a6-b308-30650caf54f4 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:46.053234 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8919a-b9c7-4b38-a387-de0a2eb27aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:46.053932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8919a-b9c7-4b38-a387-de0a2eb27aff None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:46.054219 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8919a-b9c7-4b38-a387-de0a2eb27aff None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:46.054493 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8919a-b9c7-4b38-a387-de0a2eb27aff None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:46.055281 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8919a-b9c7-4b38-a387-de0a2eb27aff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:46.055595 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8919a-b9c7-4b38-a387-de0a2eb27aff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:46.057144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8919a-b9c7-4b38-a387-de0a2eb27aff None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:46.072791 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 116/230] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:32:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:46.079180 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8919a-b9c7-4b38-a387-de0a2eb27aff None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:46.190015 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cebf3-1da9-40a6-b308-30650caf54f4 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:46.202721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8919a-b9c7-4b38-a387-de0a2eb27aff None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:46.230392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55577c47-40f5-44c5-abf3-2664ff08dc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:46.230977 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55577c47-40f5-44c5-abf3-2664ff08dc30 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:46.232013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55577c47-40f5-44c5-abf3-2664ff08dc30 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:46.232958 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55577c47-40f5-44c5-abf3-2664ff08dc30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:46.233807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55577c47-40f5-44c5-abf3-2664ff08dc30 None admin] RBAC: Adding query filter params (role.id=b03b07e63e164e6a8858592b025c8103, scope.project.id=70d15e4994bb4da4af477c7904278502, user.id=4d1ed18878f1437dae1093f22b6702a4) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:46.234116 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55577c47-40f5-44c5-abf3-2664ff08dc30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:46.237522 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55577c47-40f5-44c5-abf3-2664ff08dc30 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:46.247015 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7c272-2385-41bd-aea9-a2066e6db889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:46.247933 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7c272-2385-41bd-aea9-a2066e6db889 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:46.248211 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7c272-2385-41bd-aea9-a2066e6db889 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:46.248486 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7c272-2385-41bd-aea9-a2066e6db889 None admin] PATH_INFO: `/v3/users/8538e81c865d4acaad873a82be436495` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:46.250394 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7c272-2385-41bd-aea9-a2066e6db889 None admin] RBAC: Authorizing `identity:get_user(user_id=8538e81c865d4acaad873a82be436495)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:46.251850 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7c272-2385-41bd-aea9-a2066e6db889 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:46.253489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 117/231] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:46 2022] GET /identity/v3/users/8538e81c865d4acaad873a82be436495 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:46.255673 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 115/232] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:32:46 2022] GET /identity/v3/role_assignments?user.id=4d1ed18878f1437dae1093f22b6702a4&scope.project.id=70d15e4994bb4da4af477c7904278502&role.id=b03b07e63e164e6a8858592b025c8103 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:46.259340 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7c272-2385-41bd-aea9-a2066e6db889 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:46.390647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7c272-2385-41bd-aea9-a2066e6db889 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:46.425845 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f59ba-3481-4b56-9d6b-86f398fe42dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:46.426730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f59ba-3481-4b56-9d6b-86f398fe42dc None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:46.427013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f59ba-3481-4b56-9d6b-86f398fe42dc None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:46.427329 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f59ba-3481-4b56-9d6b-86f398fe42dc None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:46.428611 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f59ba-3481-4b56-9d6b-86f398fe42dc None admin] RBAC: Authorizing `identity:get_project(project_id=70d15e4994bb4da4af477c7904278502)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:46.430142 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f59ba-3481-4b56-9d6b-86f398fe42dc None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:46.432319 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 118/233] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:46 2022] GET /identity/v3/projects/70d15e4994bb4da4af477c7904278502 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:46.440221 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55577c47-40f5-44c5-abf3-2664ff08dc30 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:46.541259 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55577c47-40f5-44c5-abf3-2664ff08dc30 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:46.574471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf051392-1141-4208-91bb-273d711ad310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:46.575425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf051392-1141-4208-91bb-273d711ad310 None admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:46.575681 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf051392-1141-4208-91bb-273d711ad310 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:46.575955 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf051392-1141-4208-91bb-273d711ad310 None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502/users/8538e81c865d4acaad873a82be436495/roles/c3d122a6c9c6478aa2dd7e5b8afe6471` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:46.578264 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf051392-1141-4208-91bb-273d711ad310 None admin] RBAC: Authorizing `identity:create_grant(project_id=70d15e4994bb4da4af477c7904278502, user_id=8538e81c865d4acaad873a82be436495, role_id=c3d122a6c9c6478aa2dd7e5b8afe6471)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:46.582018 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf051392-1141-4208-91bb-273d711ad310 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:46.596610 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 116/234] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:32:46 2022] PUT /identity/v3/projects/70d15e4994bb4da4af477c7904278502/users/8538e81c865d4acaad873a82be436495/roles/c3d122a6c9c6478aa2dd7e5b8afe6471 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:32:47.909218 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cc21c-6330-485e-b091-4c77dcb05130 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:47.909704 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cc21c-6330-485e-b091-4c77dcb05130 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:47.909704 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cc21c-6330-485e-b091-4c77dcb05130 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:47.911076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 119/235] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:47.929417 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae21c81-43d8-4ce8-b1a8-f5212026b236 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:47.929852 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae21c81-43d8-4ce8-b1a8-f5212026b236 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:47.930033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae21c81-43d8-4ce8-b1a8-f5212026b236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:47.956071 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-9ae21c81-43d8-4ce8-b1a8-f5212026b236 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:47.957264 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-9ae21c81-43d8-4ce8-b1a8-f5212026b236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:48.035321 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 117/236] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:48.081220 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cc21c-6330-485e-b091-4c77dcb05130 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:48.219906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cc21c-6330-485e-b091-4c77dcb05130 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:48.245194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf03779-8b74-4bd5-8f94-92c6b8b7c5be None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:48.245588 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf03779-8b74-4bd5-8f94-92c6b8b7c5be None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:48.245819 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf03779-8b74-4bd5-8f94-92c6b8b7c5be None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:48.247524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 118/237] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:32:48.252422 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1586755-3132-4499-a73d-60867a2c3522 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:48.252716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1586755-3132-4499-a73d-60867a2c3522 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:48.252999 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1586755-3132-4499-a73d-60867a2c3522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:48.272892 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d2e0b-250d-4a0a-b932-dee42fcf1755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:48.273539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-d1586755-3132-4499-a73d-60867a2c3522 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:48.273710 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d2e0b-250d-4a0a-b932-dee42fcf1755 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:48.273975 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d2e0b-250d-4a0a-b932-dee42fcf1755 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:48.274254 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d2e0b-250d-4a0a-b932-dee42fcf1755 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:48.275678 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-d1586755-3132-4499-a73d-60867a2c3522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:48.293154 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d2e0b-250d-4a0a-b932-dee42fcf1755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:48.302608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-9b5d2e0b-250d-4a0a-b932-dee42fcf1755 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:32:48.302608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:48.302608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:48.302608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:48.302608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:48.302608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:48.302608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:48.302608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:48.302608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:48.302608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:48.302608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:48.302608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:48.302608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:48.302608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:48.302608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:48.302608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:48.304059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:48.304059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:48.304059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:48.304059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:48.304059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:48.304059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:48.304059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:48.304059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:48.304059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:48.304059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:48.304059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:48.304059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:32:48.304059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:48.304059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:48.304059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:48.304059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:48.305291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:48.305291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:48.305291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:48.305291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:48.305291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:48.305291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:48.305291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:48.305291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:48.305291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:48.305291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:48.305291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:32:48.305291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:32:48.305291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 120/238] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:48.314503 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d2e0b-250d-4a0a-b932-dee42fcf1755 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:48.421991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d2e0b-250d-4a0a-b932-dee42fcf1755 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:48.438249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 119/239] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:32:48.439649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5edee-195e-457d-8a19-6d1eba6d8ace None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:48.439941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5edee-195e-457d-8a19-6d1eba6d8ace None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:48.440283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5edee-195e-457d-8a19-6d1eba6d8ace None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:48.441570 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 120/240] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:48.447071 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe32e45-0c87-4f67-a0b5-721202009608 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:48.447372 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe32e45-0c87-4f67-a0b5-721202009608 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:48.447657 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe32e45-0c87-4f67-a0b5-721202009608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:48.464406 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-ebe32e45-0c87-4f67-a0b5-721202009608 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:48.466130 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ebe32e45-0c87-4f67-a0b5-721202009608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:48.474716 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec1b9d-4924-4fc4-b9ff-f3cbb023e8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:48.475364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec1b9d-4924-4fc4-b9ff-f3cbb023e8fc None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:48.475646 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec1b9d-4924-4fc4-b9ff-f3cbb023e8fc None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:48.475918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec1b9d-4924-4fc4-b9ff-f3cbb023e8fc None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:48.476675 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec1b9d-4924-4fc4-b9ff-f3cbb023e8fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:48.476990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec1b9d-4924-4fc4-b9ff-f3cbb023e8fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:48.478388 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec1b9d-4924-4fc4-b9ff-f3cbb023e8fc None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:48.493920 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 121/241] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:32:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:48.494798 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec1b9d-4924-4fc4-b9ff-f3cbb023e8fc None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:48.550667 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 121/242] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:48.551572 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe32e45-0c87-4f67-a0b5-721202009608 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:48.631918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec1b9d-4924-4fc4-b9ff-f3cbb023e8fc None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:48.655583 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe32e45-0c87-4f67-a0b5-721202009608 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:48.673029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b2e62-0e04-46fc-9b79-8a3c49ac9632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:48.674126 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b2e62-0e04-46fc-9b79-8a3c49ac9632 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:48.674413 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b2e62-0e04-46fc-9b79-8a3c49ac9632 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:48.674690 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b2e62-0e04-46fc-9b79-8a3c49ac9632 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:48.675889 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b2e62-0e04-46fc-9b79-8a3c49ac9632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:48.677769 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b2e62-0e04-46fc-9b79-8a3c49ac9632 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:48.683207 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 122/243] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:32:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:48.684421 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b2e62-0e04-46fc-9b79-8a3c49ac9632 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:48.697242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e324c4-8a17-41de-9f1b-20d5e6b1b42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:48.698628 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e324c4-8a17-41de-9f1b-20d5e6b1b42a None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:48.699200 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e324c4-8a17-41de-9f1b-20d5e6b1b42a None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:48.699676 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e324c4-8a17-41de-9f1b-20d5e6b1b42a None admin] PATH_INFO: `/v3/users/ff0beea6129f4ee7bf98b6db7d6b74df` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:48.714489 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e324c4-8a17-41de-9f1b-20d5e6b1b42a None admin] RBAC: Authorizing `identity:get_user(user_id=ff0beea6129f4ee7bf98b6db7d6b74df)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:48.716321 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e324c4-8a17-41de-9f1b-20d5e6b1b42a None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:48.718621 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 122/244] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:48 2022] GET /identity/v3/users/ff0beea6129f4ee7bf98b6db7d6b74df => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:48.720146 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e324c4-8a17-41de-9f1b-20d5e6b1b42a None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:48.809874 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b2e62-0e04-46fc-9b79-8a3c49ac9632 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:48.827112 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e324c4-8a17-41de-9f1b-20d5e6b1b42a None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:48.850268 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5376c-111c-4a62-9df5-e27ae746fe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:48.851510 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5376c-111c-4a62-9df5-e27ae746fe2c None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:48.852018 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5376c-111c-4a62-9df5-e27ae746fe2c None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:48.852487 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5376c-111c-4a62-9df5-e27ae746fe2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:48.863366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5376c-111c-4a62-9df5-e27ae746fe2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:48.869422 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce917ec-7269-4bf9-81f4-59a06c954a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:48.870097 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce917ec-7269-4bf9-81f4-59a06c954a8e None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:48.870495 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce917ec-7269-4bf9-81f4-59a06c954a8e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:48.870775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce917ec-7269-4bf9-81f4-59a06c954a8e None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:48.871544 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce917ec-7269-4bf9-81f4-59a06c954a8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:48.872991 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce917ec-7269-4bf9-81f4-59a06c954a8e None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:48.873114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-c2c5376c-111c-4a62-9df5-e27ae746fe2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:32:48.873114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:48.873114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:48.873114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:48.873114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:48.873114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:48.873114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:48.873114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:48.873114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:48.873114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:48.873114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:48.873114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:48.873114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:48.873114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:48.873114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:48.873114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:48.873918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:48.873918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:48.873918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:48.873918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:48.873918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:48.873918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:48.873918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:48.873918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:48.873918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:48.873918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:48.873918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:48.873918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:32:48.873918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:48.873918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:48.873918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:48.873918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:48.874721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:48.874721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:48.874721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:48.874721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:48.874721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:48.874721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:48.874721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:48.874721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:48.874721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:48.874721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:48.874721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:32:48.874721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:32:48.877113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 123/245] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:32:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:48.882743 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5376c-111c-4a62-9df5-e27ae746fe2c None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:48.896837 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 123/246] 10.222.0.11 () {60 vars in 1132 bytes} [Wed May 4 21:32:48 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:32:48.897670 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce917ec-7269-4bf9-81f4-59a06c954a8e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:49.016301 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5376c-111c-4a62-9df5-e27ae746fe2c None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:49.052038 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce917ec-7269-4bf9-81f4-59a06c954a8e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:49.065374 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877f83e-0a27-43a7-ad22-662180ab0f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:49.065973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877f83e-0a27-43a7-ad22-662180ab0f9e None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:49.066558 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877f83e-0a27-43a7-ad22-662180ab0f9e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:49.066852 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877f83e-0a27-43a7-ad22-662180ab0f9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:49.090199 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d35736-c163-4a37-b85f-16e6033e7052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:49.090891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d35736-c163-4a37-b85f-16e6033e7052 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:49.091205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d35736-c163-4a37-b85f-16e6033e7052 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:49.091487 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d35736-c163-4a37-b85f-16e6033e7052 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:49.092267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d35736-c163-4a37-b85f-16e6033e7052 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:49.092565 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d35736-c163-4a37-b85f-16e6033e7052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:49.093963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d35736-c163-4a37-b85f-16e6033e7052 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:49.103066 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 124/247] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:49.104419 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbe7e1-92b2-49bc-8e29-68dde7fd584d None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:49.104746 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbe7e1-92b2-49bc-8e29-68dde7fd584d None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:49.105109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbe7e1-92b2-49bc-8e29-68dde7fd584d None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:49.106689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 125/248] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:49.110621 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbe7e1-92b2-49bc-8e29-68dde7fd584d None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:49.157982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877f83e-0a27-43a7-ad22-662180ab0f9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:49.159794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877f83e-0a27-43a7-ad22-662180ab0f9e None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:49.253099 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbe7e1-92b2-49bc-8e29-68dde7fd584d None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:49.289601 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb052a-4078-4ad7-85fb-7aca2a1e285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:49.290541 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb052a-4078-4ad7-85fb-7aca2a1e285c None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:49.290824 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb052a-4078-4ad7-85fb-7aca2a1e285c None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:49.291134 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb052a-4078-4ad7-85fb-7aca2a1e285c None admin] PATH_INFO: `/v3/users/8538e81c865d4acaad873a82be436495` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:49.293247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb052a-4078-4ad7-85fb-7aca2a1e285c None admin] RBAC: Authorizing `identity:get_user(user_id=8538e81c865d4acaad873a82be436495)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:49.294577 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 124/249] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:32:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:32:49.294793 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb052a-4078-4ad7-85fb-7aca2a1e285c None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:49.296198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd9dc8-094c-4976-aa62-0474c6ebfd09 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:49.296490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd9dc8-094c-4976-aa62-0474c6ebfd09 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:49.296764 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 126/250] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:49 2022] GET /identity/v3/users/8538e81c865d4acaad873a82be436495 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:49.296858 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd9dc8-094c-4976-aa62-0474c6ebfd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:49.302090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb052a-4078-4ad7-85fb-7aca2a1e285c None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:49.315597 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-a9bd9dc8-094c-4976-aa62-0474c6ebfd09 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:49.316773 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a9bd9dc8-094c-4976-aa62-0474c6ebfd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:49.432522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 125/251] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:49.439144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd9dc8-094c-4976-aa62-0474c6ebfd09 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:49.464351 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb052a-4078-4ad7-85fb-7aca2a1e285c None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:49.526902 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629c0b0-35d7-4a1c-b4c0-8d6cffab8e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:49.527827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629c0b0-35d7-4a1c-b4c0-8d6cffab8e32 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:49.528095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629c0b0-35d7-4a1c-b4c0-8d6cffab8e32 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:49.528370 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629c0b0-35d7-4a1c-b4c0-8d6cffab8e32 None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:49.530405 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629c0b0-35d7-4a1c-b4c0-8d6cffab8e32 None admin] RBAC: Authorizing `identity:get_project(project_id=70d15e4994bb4da4af477c7904278502)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:49.531891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629c0b0-35d7-4a1c-b4c0-8d6cffab8e32 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:49.533907 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 127/252] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:49 2022] GET /identity/v3/projects/70d15e4994bb4da4af477c7904278502 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:49.535215 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dfe93-882c-45b9-9e89-5c675d8dbd05 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:49.535498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dfe93-882c-45b9-9e89-5c675d8dbd05 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:49.535771 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dfe93-882c-45b9-9e89-5c675d8dbd05 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:49.537140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 128/253] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:49.537687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dfe93-882c-45b9-9e89-5c675d8dbd05 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:49.597760 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd9dc8-094c-4976-aa62-0474c6ebfd09 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:49.644776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92ea19-cd87-4fac-be41-22ba3bf7984f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:49.645438 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92ea19-cd87-4fac-be41-22ba3bf7984f None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:49.645719 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92ea19-cd87-4fac-be41-22ba3bf7984f None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:49.645989 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92ea19-cd87-4fac-be41-22ba3bf7984f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:49.691355 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dfe93-882c-45b9-9e89-5c675d8dbd05 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:49.756853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92172a5-1b97-4fba-9ba6-29baf758f296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:49.759665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92172a5-1b97-4fba-9ba6-29baf758f296 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:49.760257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92172a5-1b97-4fba-9ba6-29baf758f296 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:49.760535 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92172a5-1b97-4fba-9ba6-29baf758f296 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:49.778182 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92ea19-cd87-4fac-be41-22ba3bf7984f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:49.782218 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92ea19-cd87-4fac-be41-22ba3bf7984f None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:49.790907 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92172a5-1b97-4fba-9ba6-29baf758f296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:49.804531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-a92172a5-1b97-4fba-9ba6-29baf758f296 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:49.804531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:49.804531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:49.804531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:49.804531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:49.804531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:49.804531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:49.804531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:49.804531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:49.804531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:49.804531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:49.804531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:49.804531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:49.804531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:49.804531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:49.804531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:49.805459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:49.805459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:49.805459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:49.805459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:49.805459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:49.805459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:49.805459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:49.805459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:49.805459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:49.805459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:49.805459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:49.805459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:32:49.805459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:49.805459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:49.805459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:49.805459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:49.806248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:49.806248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:49.806248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:49.806248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:49.806248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:49.806248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:49.806248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:49.806248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:49.806248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:49.806248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:49.806248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:49.806248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:32:49.808067 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 129/254] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:49.808067 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92172a5-1b97-4fba-9ba6-29baf758f296 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:49.917175 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 126/255] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:32:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:32:49.917175 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03efcf-02d5-473b-993c-05fc25458817 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:49.917175 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03efcf-02d5-473b-993c-05fc25458817 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:49.917175 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03efcf-02d5-473b-993c-05fc25458817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:49.936446 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92172a5-1b97-4fba-9ba6-29baf758f296 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:49.937004 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-8d03efcf-02d5-473b-993c-05fc25458817 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:49.938339 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-8d03efcf-02d5-473b-993c-05fc25458817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:49.972406 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa18164-c7a1-4c60-afba-a3a2166c77df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:49.973298 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa18164-c7a1-4c60-afba-a3a2166c77df None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:49.973765 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa18164-c7a1-4c60-afba-a3a2166c77df None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:49.974517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa18164-c7a1-4c60-afba-a3a2166c77df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:49.975584 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa18164-c7a1-4c60-afba-a3a2166c77df None admin] RBAC: Adding query filter params (role.id=cafece24a80f46f589a1ac3512d79cec, scope.project.id=70d15e4994bb4da4af477c7904278502, user.id=ff0beea6129f4ee7bf98b6db7d6b74df) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:49.976073 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa18164-c7a1-4c60-afba-a3a2166c77df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:49.977706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa18164-c7a1-4c60-afba-a3a2166c77df None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:49.985713 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 130/256] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:32:49 2022] GET /identity/v3/role_assignments?user.id=ff0beea6129f4ee7bf98b6db7d6b74df&scope.project.id=70d15e4994bb4da4af477c7904278502&role.id=cafece24a80f46f589a1ac3512d79cec => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:49.986743 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa18164-c7a1-4c60-afba-a3a2166c77df None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:50.031076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 127/257] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:50.031076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03efcf-02d5-473b-993c-05fc25458817 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:50.118158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa18164-c7a1-4c60-afba-a3a2166c77df None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:50.156312 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b932c13-93d9-4b7c-8951-1a953dd339a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:50.157285 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b932c13-93d9-4b7c-8951-1a953dd339a8 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:50.157714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b932c13-93d9-4b7c-8951-1a953dd339a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:50.158131 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b932c13-93d9-4b7c-8951-1a953dd339a8 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:50.159065 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b932c13-93d9-4b7c-8951-1a953dd339a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:50.159521 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b932c13-93d9-4b7c-8951-1a953dd339a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:50.161118 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b932c13-93d9-4b7c-8951-1a953dd339a8 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:50.171939 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 131/258] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:32:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:50.173150 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b932c13-93d9-4b7c-8951-1a953dd339a8 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:50.209227 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03efcf-02d5-473b-993c-05fc25458817 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:50.280382 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fc632-8be6-4c15-8398-cc70588560a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:50.281600 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fc632-8be6-4c15-8398-cc70588560a6 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:50.282027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fc632-8be6-4c15-8398-cc70588560a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:50.282447 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fc632-8be6-4c15-8398-cc70588560a6 None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:50.285171 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fc632-8be6-4c15-8398-cc70588560a6 None admin] RBAC: Authorizing `identity:get_project(project_id=70d15e4994bb4da4af477c7904278502)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:50.287888 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fc632-8be6-4c15-8398-cc70588560a6 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:50.291553 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 128/259] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:50 2022] GET /identity/v3/projects/70d15e4994bb4da4af477c7904278502 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:50.295614 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fc632-8be6-4c15-8398-cc70588560a6 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:50.306915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b932c13-93d9-4b7c-8951-1a953dd339a8 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:50.347583 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f237969-7ca7-457e-8d96-8c676767ebf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:50.348650 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f237969-7ca7-457e-8d96-8c676767ebf9 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:50.349468 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f237969-7ca7-457e-8d96-8c676767ebf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:50.349888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f237969-7ca7-457e-8d96-8c676767ebf9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:50.361652 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f237969-7ca7-457e-8d96-8c676767ebf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:50.371267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-0f237969-7ca7-457e-8d96-8c676767ebf9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:32:50.371267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:50.371267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:50.371267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:50.371267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:50.371267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:50.371267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:50.371267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:50.371267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:50.371267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:50.371267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:50.371267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:50.371267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:50.371267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:50.371267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:50.371267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:50.372418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:50.372418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:50.372418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:50.372418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:50.372418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:50.372418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:50.372418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:50.372418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:50.372418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:50.372418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:50.372418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:50.372418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:32:50.372418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:50.372418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:50.372418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:50.372418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:50.373408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:50.373408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:50.373408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:50.373408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:50.373408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:50.373408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:50.373408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:50.373408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:50.373408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:50.373408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:50.373408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:32:50.373408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:32:50.375866 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 132/260] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:32:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:50.376898 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f237969-7ca7-457e-8d96-8c676767ebf9 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:50.483855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f237969-7ca7-457e-8d96-8c676767ebf9 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:50.534786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811430d-bae0-43e1-9ec7-8015f2e9df2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:50.535746 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811430d-bae0-43e1-9ec7-8015f2e9df2f None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:50.536257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811430d-bae0-43e1-9ec7-8015f2e9df2f None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:50.536678 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811430d-bae0-43e1-9ec7-8015f2e9df2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:50.537663 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811430d-bae0-43e1-9ec7-8015f2e9df2f None admin] RBAC: Adding query filter params (role.id=59778f07f0504e90a60212f460e8c774, scope.project.id=70d15e4994bb4da4af477c7904278502, user.id=8538e81c865d4acaad873a82be436495) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:50.538121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811430d-bae0-43e1-9ec7-8015f2e9df2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:50.539786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811430d-bae0-43e1-9ec7-8015f2e9df2f None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:50.547347 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 133/261] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:32:50 2022] GET /identity/v3/role_assignments?user.id=8538e81c865d4acaad873a82be436495&scope.project.id=70d15e4994bb4da4af477c7904278502&role.id=59778f07f0504e90a60212f460e8c774 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:50.548468 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811430d-bae0-43e1-9ec7-8015f2e9df2f None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:50.549168 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fc632-8be6-4c15-8398-cc70588560a6 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:50.656781 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0a87e-5681-4710-b84d-e29a0076f179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:50.657690 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0a87e-5681-4710-b84d-e29a0076f179 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:50.657972 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0a87e-5681-4710-b84d-e29a0076f179 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:50.658245 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0a87e-5681-4710-b84d-e29a0076f179 None admin] PATH_INFO: `/v3/users/4d1ed18878f1437dae1093f22b6702a4` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:50.658680 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811430d-bae0-43e1-9ec7-8015f2e9df2f None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:50.663750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0a87e-5681-4710-b84d-e29a0076f179 None admin] RBAC: Authorizing `identity:get_user(user_id=4d1ed18878f1437dae1093f22b6702a4)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:50.665268 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0a87e-5681-4710-b84d-e29a0076f179 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:50.667491 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 129/262] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:50 2022] GET /identity/v3/users/4d1ed18878f1437dae1093f22b6702a4 => generated 297 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:50.673710 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0a87e-5681-4710-b84d-e29a0076f179 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:50.695381 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648e3cf-36c7-4b4d-91fe-a786dda4a94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:50.696348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648e3cf-36c7-4b4d-91fe-a786dda4a94f None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:50.696770 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648e3cf-36c7-4b4d-91fe-a786dda4a94f None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:50.697184 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648e3cf-36c7-4b4d-91fe-a786dda4a94f None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:50.698103 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648e3cf-36c7-4b4d-91fe-a786dda4a94f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:50.698560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648e3cf-36c7-4b4d-91fe-a786dda4a94f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:50.700272 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648e3cf-36c7-4b4d-91fe-a786dda4a94f None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:50.709348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 134/263] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:32:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:50.715708 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648e3cf-36c7-4b4d-91fe-a786dda4a94f None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:50.825491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648e3cf-36c7-4b4d-91fe-a786dda4a94f None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:50.861192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c79ec-f3ad-4fe2-9505-6b92a9e048eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:50.862363 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c79ec-f3ad-4fe2-9505-6b92a9e048eb None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:50.862785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c79ec-f3ad-4fe2-9505-6b92a9e048eb None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:50.863222 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c79ec-f3ad-4fe2-9505-6b92a9e048eb None admin] PATH_INFO: `/v3/users/8538e81c865d4acaad873a82be436495` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:50.864762 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c79ec-f3ad-4fe2-9505-6b92a9e048eb None admin] RBAC: Authorizing `identity:get_user(user_id=8538e81c865d4acaad873a82be436495)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:50.866436 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c79ec-f3ad-4fe2-9505-6b92a9e048eb None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:50.868327 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 135/264] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:50 2022] GET /identity/v3/users/8538e81c865d4acaad873a82be436495 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:50.876079 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c79ec-f3ad-4fe2-9505-6b92a9e048eb None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:50.896052 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0a87e-5681-4710-b84d-e29a0076f179 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:50.975792 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69782577-889d-4594-b7cf-2abc81f5c716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:50.976680 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69782577-889d-4594-b7cf-2abc81f5c716 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:50.976965 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69782577-889d-4594-b7cf-2abc81f5c716 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:50.977245 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69782577-889d-4594-b7cf-2abc81f5c716 None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:50.978635 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69782577-889d-4594-b7cf-2abc81f5c716 None admin] RBAC: Authorizing `identity:get_project(project_id=70d15e4994bb4da4af477c7904278502)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:50.980217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69782577-889d-4594-b7cf-2abc81f5c716 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:50.981090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c79ec-f3ad-4fe2-9505-6b92a9e048eb None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:50.982430 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 130/265] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:50 2022] GET /identity/v3/projects/70d15e4994bb4da4af477c7904278502 => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:50.987950 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69782577-889d-4594-b7cf-2abc81f5c716 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:51.015337 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c474c-12d7-40d3-a3dd-a26bfaed0bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:51.016353 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c474c-12d7-40d3-a3dd-a26bfaed0bfa None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:51.016823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c474c-12d7-40d3-a3dd-a26bfaed0bfa None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:51.017308 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c474c-12d7-40d3-a3dd-a26bfaed0bfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:51.086048 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c474c-12d7-40d3-a3dd-a26bfaed0bfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:51.087881 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c474c-12d7-40d3-a3dd-a26bfaed0bfa None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:51.186874 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69782577-889d-4594-b7cf-2abc81f5c716 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:51.187597 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 136/266] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:32:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 21:32:51.200764 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c474c-12d7-40d3-a3dd-a26bfaed0bfa None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:51.231073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5269f-09bc-4a55-9407-6aae27b63e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:51.231073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5269f-09bc-4a55-9407-6aae27b63e52 None admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:51.231073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5269f-09bc-4a55-9407-6aae27b63e52 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:51.231073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5269f-09bc-4a55-9407-6aae27b63e52 None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502/users/4d1ed18878f1437dae1093f22b6702a4/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:51.234002 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5269f-09bc-4a55-9407-6aae27b63e52 None admin] RBAC: Authorizing `identity:create_grant(project_id=70d15e4994bb4da4af477c7904278502, user_id=4d1ed18878f1437dae1093f22b6702a4, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:51.235501 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5269f-09bc-4a55-9407-6aae27b63e52 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:51.256531 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 131/267] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:32:50 2022] PUT /identity/v3/projects/70d15e4994bb4da4af477c7904278502/users/4d1ed18878f1437dae1093f22b6702a4/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:32:51.328013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c474c-12d7-40d3-a3dd-a26bfaed0bfa None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:51.365878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f263c89-35ef-4e58-b305-fc94ad853740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:51.366687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f263c89-35ef-4e58-b305-fc94ad853740 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:51.366973 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f263c89-35ef-4e58-b305-fc94ad853740 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:51.367282 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f263c89-35ef-4e58-b305-fc94ad853740 None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:51.368534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f263c89-35ef-4e58-b305-fc94ad853740 None admin] RBAC: Authorizing `identity:get_project(project_id=70d15e4994bb4da4af477c7904278502)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:51.370014 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f263c89-35ef-4e58-b305-fc94ad853740 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:51.371940 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 137/268] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:51 2022] GET /identity/v3/projects/70d15e4994bb4da4af477c7904278502 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:51.377963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5269f-09bc-4a55-9407-6aae27b63e52 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:51.499954 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5269f-09bc-4a55-9407-6aae27b63e52 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:51.543328 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462285d-3e1f-43f3-88cc-095b0bc930db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:51.544016 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462285d-3e1f-43f3-88cc-095b0bc930db None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:51.544303 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462285d-3e1f-43f3-88cc-095b0bc930db None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:51.544583 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462285d-3e1f-43f3-88cc-095b0bc930db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:51.545429 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462285d-3e1f-43f3-88cc-095b0bc930db None admin] RBAC: Adding query filter params (role.id=c3d122a6c9c6478aa2dd7e5b8afe6471, scope.project.id=70d15e4994bb4da4af477c7904278502, user.id=8538e81c865d4acaad873a82be436495) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:51.545748 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462285d-3e1f-43f3-88cc-095b0bc930db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:51.551360 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462285d-3e1f-43f3-88cc-095b0bc930db None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:51.558756 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 132/269] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:32:51 2022] GET /identity/v3/role_assignments?user.id=8538e81c865d4acaad873a82be436495&scope.project.id=70d15e4994bb4da4af477c7904278502&role.id=c3d122a6c9c6478aa2dd7e5b8afe6471 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:51.688987 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c700b-2faa-4e79-9205-91faac98fc19 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:51.689276 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c700b-2faa-4e79-9205-91faac98fc19 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:51.689557 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c700b-2faa-4e79-9205-91faac98fc19 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:51.691324 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 138/270] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:51.696610 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4e7aa-3ebb-4ae9-b1e1-1338d30cbf46 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:51.696906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4e7aa-3ebb-4ae9-b1e1-1338d30cbf46 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:51.697190 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4e7aa-3ebb-4ae9-b1e1-1338d30cbf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:51.715212 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-99d4e7aa-3ebb-4ae9-b1e1-1338d30cbf46 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:51.716408 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-99d4e7aa-3ebb-4ae9-b1e1-1338d30cbf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:51.784163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 133/271] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:51.819206 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c700b-2faa-4e79-9205-91faac98fc19 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:51.931894 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c700b-2faa-4e79-9205-91faac98fc19 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:51.967346 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f373eb-782d-4018-916f-17c71b2e6b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:51.968544 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f373eb-782d-4018-916f-17c71b2e6b6e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:51.969022 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f373eb-782d-4018-916f-17c71b2e6b6e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:51.969485 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f373eb-782d-4018-916f-17c71b2e6b6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:51.985271 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f373eb-782d-4018-916f-17c71b2e6b6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:51.993604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-c9f373eb-782d-4018-916f-17c71b2e6b6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:51.993604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:51.993604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:51.993604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:51.993604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:51.993604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:51.993604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:51.993604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:51.993604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:51.993604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:51.993604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:51.993604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:51.993604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:51.993604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:51.993604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:51.993604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:51.994555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:51.994555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:51.994555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:51.994555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:51.994555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:51.994555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:51.994555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:51.994555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:51.994555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:51.994555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:51.994555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:51.994555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:32:51.994555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:51.994555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:51.994555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:51.994555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:51.995533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:51.995533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:51.995533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:51.995533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:51.995533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:51.995533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:51.995533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:51.995533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:51.995533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:51.995533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:51.995533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:51.995533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:32:51.998394 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 139/272] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:52.004368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4e7aa-3ebb-4ae9-b1e1-1338d30cbf46 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:52.109895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4e7aa-3ebb-4ae9-b1e1-1338d30cbf46 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:52.146140 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8630b5-0d8c-4e99-aabe-f1129d61c01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:52.147241 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8630b5-0d8c-4e99-aabe-f1129d61c01e None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:52.147723 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8630b5-0d8c-4e99-aabe-f1129d61c01e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:52.148206 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8630b5-0d8c-4e99-aabe-f1129d61c01e None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:52.149160 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8630b5-0d8c-4e99-aabe-f1129d61c01e None admin] RBAC: Adding query filter params (name=member) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:52.149671 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8630b5-0d8c-4e99-aabe-f1129d61c01e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:52.151285 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8630b5-0d8c-4e99-aabe-f1129d61c01e None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:52.160486 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 134/273] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:32:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:52.166239 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f373eb-782d-4018-916f-17c71b2e6b6e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:52.187303 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25551633-9754-492d-862d-1eda13ad78e3 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:52.187807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25551633-9754-492d-862d-1eda13ad78e3 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:52.187914 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25551633-9754-492d-862d-1eda13ad78e3 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:52.189469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 135/274] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:32:52.194367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e78f9f-f6cd-480c-9975-6d246a5b82c9 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:52.194660 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e78f9f-f6cd-480c-9975-6d246a5b82c9 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:52.194942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e78f9f-f6cd-480c-9975-6d246a5b82c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:52.213306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-02e78f9f-f6cd-480c-9975-6d246a5b82c9 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:52.215325 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-02e78f9f-f6cd-480c-9975-6d246a5b82c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:52.286605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 136/275] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:32:52.289219 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f373eb-782d-4018-916f-17c71b2e6b6e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:52.313949 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e78f9f-f6cd-480c-9975-6d246a5b82c9 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:52.323624 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c19c77-9d14-4391-a255-2469b523cc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:52.324847 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c19c77-9d14-4391-a255-2469b523cc9e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:52.325346 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c19c77-9d14-4391-a255-2469b523cc9e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:52.325810 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c19c77-9d14-4391-a255-2469b523cc9e None admin] PATH_INFO: `/v3/users/405036e8650e4ca594c8848c37b494bd` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:52.340147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c19c77-9d14-4391-a255-2469b523cc9e None admin] RBAC: Authorizing `identity:get_user(user_id=405036e8650e4ca594c8848c37b494bd)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:52.341980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c19c77-9d14-4391-a255-2469b523cc9e None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:52.344378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 140/276] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:52 2022] GET /identity/v3/users/405036e8650e4ca594c8848c37b494bd => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:52.350416 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c19c77-9d14-4391-a255-2469b523cc9e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:52.411802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e78f9f-f6cd-480c-9975-6d246a5b82c9 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:52.446100 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17a8be-3f65-4dcf-b301-aca1baa86cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:52.446801 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17a8be-3f65-4dcf-b301-aca1baa86cb6 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:52.447105 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17a8be-3f65-4dcf-b301-aca1baa86cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:52.447385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17a8be-3f65-4dcf-b301-aca1baa86cb6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:52.448962 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17a8be-3f65-4dcf-b301-aca1baa86cb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:52.450125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17a8be-3f65-4dcf-b301-aca1baa86cb6 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:52.451702 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c19c77-9d14-4391-a255-2469b523cc9e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:52.456362 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 137/277] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:32:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:52.457195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17a8be-3f65-4dcf-b301-aca1baa86cb6 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:52.488318 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906c341-84bd-4477-b4ca-bb2cabdcb828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:52.489359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906c341-84bd-4477-b4ca-bb2cabdcb828 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:52.489897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906c341-84bd-4477-b4ca-bb2cabdcb828 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:52.490390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906c341-84bd-4477-b4ca-bb2cabdcb828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:52.491506 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906c341-84bd-4477-b4ca-bb2cabdcb828 None admin] RBAC: Adding query filter params (role.id=b03b07e63e164e6a8858592b025c8103, user.id=405036e8650e4ca594c8848c37b494bd, scope.system=all) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:52.492019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906c341-84bd-4477-b4ca-bb2cabdcb828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:52.493675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906c341-84bd-4477-b4ca-bb2cabdcb828 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:52.499611 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 141/278] 10.222.0.11 () {56 vars in 1308 bytes} [Wed May 4 21:32:52 2022] GET /identity/v3/role_assignments?user.id=405036e8650e4ca594c8848c37b494bd&scope.system=all&role.id=b03b07e63e164e6a8858592b025c8103 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:52.560514 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17a8be-3f65-4dcf-b301-aca1baa86cb6 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:52.601211 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b9ba1-7a3d-4546-8b3f-067769972269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:52.601931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b9ba1-7a3d-4546-8b3f-067769972269 None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:52.602198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b9ba1-7a3d-4546-8b3f-067769972269 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:52.602476 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b9ba1-7a3d-4546-8b3f-067769972269 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:52.603239 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b9ba1-7a3d-4546-8b3f-067769972269 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:52.604827 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b9ba1-7a3d-4546-8b3f-067769972269 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:52.627764 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 138/279] 10.222.0.11 () {60 vars in 1132 bytes} [Wed May 4 21:32:52 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:32:52.783559 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e5d60-a66a-4035-a3bc-eee4331aa765 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:52.783935 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e5d60-a66a-4035-a3bc-eee4331aa765 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:52.784112 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e5d60-a66a-4035-a3bc-eee4331aa765 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:52.785557 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 142/280] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:52.791517 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7e8a8-2ffc-4eaa-bd8c-a5edb96a271b None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:52.791807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7e8a8-2ffc-4eaa-bd8c-a5edb96a271b None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:52.792199 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7e8a8-2ffc-4eaa-bd8c-a5edb96a271b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:52.810089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-75d7e8a8-2ffc-4eaa-bd8c-a5edb96a271b None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:52.812267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-75d7e8a8-2ffc-4eaa-bd8c-a5edb96a271b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:52.879019 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 139/281] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:52.901916 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e5d60-a66a-4035-a3bc-eee4331aa765 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:53.018064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e5d60-a66a-4035-a3bc-eee4331aa765 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:53.052275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8d632-7875-443b-b5f8-53703ce5f912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:53.053374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8d632-7875-443b-b5f8-53703ce5f912 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:53.053818 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8d632-7875-443b-b5f8-53703ce5f912 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:53.054324 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8d632-7875-443b-b5f8-53703ce5f912 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:53.065509 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8d632-7875-443b-b5f8-53703ce5f912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:53.073645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-b7f8d632-7875-443b-b5f8-53703ce5f912 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:32:53.073645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:53.073645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:53.073645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:53.073645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:53.073645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:53.073645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:53.073645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:53.073645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:53.073645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:53.073645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:53.073645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:53.073645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:53.073645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:53.073645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:53.073645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:53.074705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:53.074705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:53.074705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:53.074705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:53.074705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:53.074705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:53.074705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:53.074705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:53.074705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:53.074705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:53.074705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:53.074705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:32:53.074705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:53.074705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:53.074705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:53.074705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:53.075514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:53.075514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:53.075514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:53.075514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:53.075514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:53.075514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:53.075514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:53.075514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:53.075514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:53.075514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:53.075514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:32:53.075514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:32:53.079096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 143/282] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:53.086615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7e8a8-2ffc-4eaa-bd8c-a5edb96a271b None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:53.184166 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7e8a8-2ffc-4eaa-bd8c-a5edb96a271b None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:53.226394 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9387657-3ea8-40fd-8b54-e9b0dc71e177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:53.227935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9387657-3ea8-40fd-8b54-e9b0dc71e177 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:53.228380 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9387657-3ea8-40fd-8b54-e9b0dc71e177 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:53.228785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9387657-3ea8-40fd-8b54-e9b0dc71e177 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:53.229847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9387657-3ea8-40fd-8b54-e9b0dc71e177 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:53.230293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9387657-3ea8-40fd-8b54-e9b0dc71e177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:53.231834 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9387657-3ea8-40fd-8b54-e9b0dc71e177 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:53.246950 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 140/283] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:32:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:53.253270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8d632-7875-443b-b5f8-53703ce5f912 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:53.357016 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8d632-7875-443b-b5f8-53703ce5f912 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:53.405148 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9084d4a-40d9-4945-95dc-08f32974065e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:53.406039 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9084d4a-40d9-4945-95dc-08f32974065e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:53.406324 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9084d4a-40d9-4945-95dc-08f32974065e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:53.406603 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9084d4a-40d9-4945-95dc-08f32974065e None admin] PATH_INFO: `/v3/users/ff0beea6129f4ee7bf98b6db7d6b74df` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:53.407872 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9084d4a-40d9-4945-95dc-08f32974065e None admin] RBAC: Authorizing `identity:get_user(user_id=ff0beea6129f4ee7bf98b6db7d6b74df)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:53.409340 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9084d4a-40d9-4945-95dc-08f32974065e None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:53.411319 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 144/284] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:53 2022] GET /identity/v3/users/ff0beea6129f4ee7bf98b6db7d6b74df => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:53.417724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9387657-3ea8-40fd-8b54-e9b0dc71e177 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:53.552161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9387657-3ea8-40fd-8b54-e9b0dc71e177 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:53.595072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090a9f4-48a1-40d3-80fc-d15b20d225e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:53.595948 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090a9f4-48a1-40d3-80fc-d15b20d225e8 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:53.596229 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090a9f4-48a1-40d3-80fc-d15b20d225e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:53.596556 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090a9f4-48a1-40d3-80fc-d15b20d225e8 None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:53.597775 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090a9f4-48a1-40d3-80fc-d15b20d225e8 None admin] RBAC: Authorizing `identity:get_project(project_id=70d15e4994bb4da4af477c7904278502)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:53.599550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090a9f4-48a1-40d3-80fc-d15b20d225e8 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:53.601243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 141/285] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:53 2022] GET /identity/v3/projects/70d15e4994bb4da4af477c7904278502 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:53.608159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9084d4a-40d9-4945-95dc-08f32974065e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:53.769151 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9084d4a-40d9-4945-95dc-08f32974065e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:53.813134 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1157b-2359-4688-934c-70698a4e3767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:53.814043 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1157b-2359-4688-934c-70698a4e3767 None admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:53.814324 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1157b-2359-4688-934c-70698a4e3767 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:53.814600 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1157b-2359-4688-934c-70698a4e3767 None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502/users/ff0beea6129f4ee7bf98b6db7d6b74df/roles/cafece24a80f46f589a1ac3512d79cec` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:53.816572 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1157b-2359-4688-934c-70698a4e3767 None admin] RBAC: Authorizing `identity:create_grant(project_id=70d15e4994bb4da4af477c7904278502, user_id=ff0beea6129f4ee7bf98b6db7d6b74df, role_id=cafece24a80f46f589a1ac3512d79cec)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:53.818007 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1157b-2359-4688-934c-70698a4e3767 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:53.836391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 145/286] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:32:53 2022] PUT /identity/v3/projects/70d15e4994bb4da4af477c7904278502/users/ff0beea6129f4ee7bf98b6db7d6b74df/roles/cafece24a80f46f589a1ac3512d79cec => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:32:53.944942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfba440-f574-4d96-8139-dcc75464ce7e None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:53.945320 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfba440-f574-4d96-8139-dcc75464ce7e None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:53.945499 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfba440-f574-4d96-8139-dcc75464ce7e None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:53.947376 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 142/287] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:53.952999 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b33f9-faf1-4f3e-9b84-e8b5320c9919 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:53.953325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b33f9-faf1-4f3e-9b84-e8b5320c9919 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:53.953547 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b33f9-faf1-4f3e-9b84-e8b5320c9919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:53.976144 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-4f1b33f9-faf1-4f3e-9b84-e8b5320c9919 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:53.977413 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-4f1b33f9-faf1-4f3e-9b84-e8b5320c9919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:54.068389 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 146/288] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:54.102049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfba440-f574-4d96-8139-dcc75464ce7e None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:54.210740 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfba440-f574-4d96-8139-dcc75464ce7e None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:54.252702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642b582-f3eb-4b37-8e73-62f48f2b117d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:54.253524 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642b582-f3eb-4b37-8e73-62f48f2b117d None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:54.253809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642b582-f3eb-4b37-8e73-62f48f2b117d None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:54.254085 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642b582-f3eb-4b37-8e73-62f48f2b117d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:54.267986 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642b582-f3eb-4b37-8e73-62f48f2b117d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:54.275585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-c642b582-f3eb-4b37-8e73-62f48f2b117d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:54.275585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:54.275585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:54.275585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:54.275585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:54.275585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:54.275585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:54.275585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:54.275585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:54.275585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:54.275585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:54.275585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:54.275585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:54.275585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:54.275585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:54.275585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:54.276534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:54.276534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:54.276534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:54.276534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:54.276534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:54.276534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:54.276534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:54.276534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:54.276534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:54.276534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:54.276534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:54.276534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:32:54.276534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:54.276534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:54.276534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:54.276534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:54.277327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:54.277327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:54.277327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:54.277327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:54.277327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:54.277327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:54.277327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:54.277327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:54.277327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:54.277327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:54.277327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:54.277327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:32:54.277327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 143/289] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:54.287591 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b33f9-faf1-4f3e-9b84-e8b5320c9919 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:54.413017 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b33f9-faf1-4f3e-9b84-e8b5320c9919 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:54.448655 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248601ec-d29c-48ed-bdfa-146bf667cbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:54.449339 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248601ec-d29c-48ed-bdfa-146bf667cbc7 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:54.449622 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248601ec-d29c-48ed-bdfa-146bf667cbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:54.449897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248601ec-d29c-48ed-bdfa-146bf667cbc7 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:54.450658 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248601ec-d29c-48ed-bdfa-146bf667cbc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:54.450966 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248601ec-d29c-48ed-bdfa-146bf667cbc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:54.452358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248601ec-d29c-48ed-bdfa-146bf667cbc7 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:54.461487 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 147/290] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:32:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:54.466726 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642b582-f3eb-4b37-8e73-62f48f2b117d None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:54.587076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642b582-f3eb-4b37-8e73-62f48f2b117d None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:54.622604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e74f79-2da0-4e18-b4bc-5fd72d0a78f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:54.623516 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e74f79-2da0-4e18-b4bc-5fd72d0a78f2 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:54.623800 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e74f79-2da0-4e18-b4bc-5fd72d0a78f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:54.624075 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e74f79-2da0-4e18-b4bc-5fd72d0a78f2 None admin] PATH_INFO: `/v3/users/4d1ed18878f1437dae1093f22b6702a4` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:54.627747 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e74f79-2da0-4e18-b4bc-5fd72d0a78f2 None admin] RBAC: Authorizing `identity:get_user(user_id=4d1ed18878f1437dae1093f22b6702a4)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:54.629230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e74f79-2da0-4e18-b4bc-5fd72d0a78f2 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:54.631204 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 144/291] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:54 2022] GET /identity/v3/users/4d1ed18878f1437dae1093f22b6702a4 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:54.636982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248601ec-d29c-48ed-bdfa-146bf667cbc7 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:54.789356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248601ec-d29c-48ed-bdfa-146bf667cbc7 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:54.829951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289b3eb-9c45-4c9f-b19e-01067fe006af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:54.830973 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289b3eb-9c45-4c9f-b19e-01067fe006af None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:54.831480 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289b3eb-9c45-4c9f-b19e-01067fe006af None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:54.831948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289b3eb-9c45-4c9f-b19e-01067fe006af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:54.926473 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289b3eb-9c45-4c9f-b19e-01067fe006af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:54.928335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289b3eb-9c45-4c9f-b19e-01067fe006af None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:55.067121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 148/292] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:32:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:32:55.072692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e74f79-2da0-4e18-b4bc-5fd72d0a78f2 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:55.211919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d40140-3d46-4e1b-80e3-9bb600ad53e0 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:55.212623 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d40140-3d46-4e1b-80e3-9bb600ad53e0 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:55.213107 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d40140-3d46-4e1b-80e3-9bb600ad53e0 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:55.214003 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e74f79-2da0-4e18-b4bc-5fd72d0a78f2 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:55.214976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 149/293] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:55.220334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82cff6-127b-4839-8c4c-a48c99b120ee None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:55.220897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82cff6-127b-4839-8c4c-a48c99b120ee None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:55.221369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82cff6-127b-4839-8c4c-a48c99b120ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:55.249268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-4d82cff6-127b-4839-8c4c-a48c99b120ee None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:55.250819 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-4d82cff6-127b-4839-8c4c-a48c99b120ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:55.256052 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88840e-9be9-4f98-888a-5aa3192cd39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:55.256052 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88840e-9be9-4f98-888a-5aa3192cd39a None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:55.256052 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88840e-9be9-4f98-888a-5aa3192cd39a None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:55.256052 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88840e-9be9-4f98-888a-5aa3192cd39a None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:55.259848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88840e-9be9-4f98-888a-5aa3192cd39a None admin] RBAC: Authorizing `identity:get_project(project_id=70d15e4994bb4da4af477c7904278502)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:55.261387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88840e-9be9-4f98-888a-5aa3192cd39a None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:55.263369 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 145/294] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:55 2022] GET /identity/v3/projects/70d15e4994bb4da4af477c7904278502 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:55.271104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88840e-9be9-4f98-888a-5aa3192cd39a None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:55.373675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 150/295] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:55.396427 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82cff6-127b-4839-8c4c-a48c99b120ee None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:55.485353 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88840e-9be9-4f98-888a-5aa3192cd39a None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:55.524238 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82cff6-127b-4839-8c4c-a48c99b120ee None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:55.554419 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b20ef-5527-4d5a-9e3a-87cb78c10613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:55.555336 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b20ef-5527-4d5a-9e3a-87cb78c10613 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:55.555745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b20ef-5527-4d5a-9e3a-87cb78c10613 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:55.556141 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b20ef-5527-4d5a-9e3a-87cb78c10613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:55.557126 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b20ef-5527-4d5a-9e3a-87cb78c10613 None admin] RBAC: Adding query filter params (role.id=b03b07e63e164e6a8858592b025c8103, scope.project.id=70d15e4994bb4da4af477c7904278502, user.id=4d1ed18878f1437dae1093f22b6702a4) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:55.557593 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b20ef-5527-4d5a-9e3a-87cb78c10613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:55.559198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b20ef-5527-4d5a-9e3a-87cb78c10613 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:55.566137 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 146/296] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:32:55 2022] GET /identity/v3/role_assignments?user.id=4d1ed18878f1437dae1093f22b6702a4&scope.project.id=70d15e4994bb4da4af477c7904278502&role.id=b03b07e63e164e6a8858592b025c8103 => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:55.567817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05195e-1bd7-464e-8afe-d3d88baef203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:55.568904 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05195e-1bd7-464e-8afe-d3d88baef203 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:55.569397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05195e-1bd7-464e-8afe-d3d88baef203 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:55.569896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05195e-1bd7-464e-8afe-d3d88baef203 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:55.586775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05195e-1bd7-464e-8afe-d3d88baef203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:55.595814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-3c05195e-1bd7-464e-8afe-d3d88baef203 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:32:55.595814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:55.595814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:55.595814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:55.595814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:55.595814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:55.595814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:55.595814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:55.595814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:55.595814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:55.595814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:55.595814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:55.595814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:55.595814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:55.595814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:55.595814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:55.596749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:55.596749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:55.596749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:55.596749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:55.596749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:55.596749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:55.596749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:55.596749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:55.596749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:55.596749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:55.596749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:55.596749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:32:55.596749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:55.596749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:55.596749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:55.596749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:55.597539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:55.597539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:55.597539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:55.597539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:55.597539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:55.597539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:55.597539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:55.597539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:55.597539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:55.597539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:55.597539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:32:55.597539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:32:55.603758 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 151/297] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:32:55.607441 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b20ef-5527-4d5a-9e3a-87cb78c10613 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:55.621095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53a10b-2644-4ac2-ad3a-56d6eb8906dc None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:55.621373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53a10b-2644-4ac2-ad3a-56d6eb8906dc None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:55.621813 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53a10b-2644-4ac2-ad3a-56d6eb8906dc None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:55.623592 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 152/298] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:32:55.629556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c522-430d-456e-bfd2-405fe9c0b9d0 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:55.629832 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c522-430d-456e-bfd2-405fe9c0b9d0 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:55.630026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c522-430d-456e-bfd2-405fe9c0b9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:55.667582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-33c3c522-430d-456e-bfd2-405fe9c0b9d0 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:55.669139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-33c3c522-430d-456e-bfd2-405fe9c0b9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:55.777436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b20ef-5527-4d5a-9e3a-87cb78c10613 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:55.794170 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 153/299] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:32:55.816496 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3c522-430d-456e-bfd2-405fe9c0b9d0 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:55.820996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d13a23-62a9-438a-a548-c4c25550c8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:55.821589 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d13a23-62a9-438a-a548-c4c25550c8e0 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:55.821874 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d13a23-62a9-438a-a548-c4c25550c8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:55.822152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d13a23-62a9-438a-a548-c4c25550c8e0 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:55.822902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d13a23-62a9-438a-a548-c4c25550c8e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:55.823301 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d13a23-62a9-438a-a548-c4c25550c8e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:55.824743 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d13a23-62a9-438a-a548-c4c25550c8e0 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:55.834123 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 147/300] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:32:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:55.835449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d41f-4ce6-435a-ab5c-480535bdca2e None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:55.835986 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d41f-4ce6-435a-ab5c-480535bdca2e None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:55.836398 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d41f-4ce6-435a-ab5c-480535bdca2e None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:55.837742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 148/301] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:55.842524 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882d41f-4ce6-435a-ab5c-480535bdca2e None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:55.925510 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3c522-430d-456e-bfd2-405fe9c0b9d0 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:55.945610 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882d41f-4ce6-435a-ab5c-480535bdca2e None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:55.958668 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f5c57-b77b-415a-b5b8-2522fc88b386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:55.959499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f5c57-b77b-415a-b5b8-2522fc88b386 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:55.959780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f5c57-b77b-415a-b5b8-2522fc88b386 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:55.960053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f5c57-b77b-415a-b5b8-2522fc88b386 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:55.972740 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f5c57-b77b-415a-b5b8-2522fc88b386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:55.978719 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdcdee-3f27-4260-8782-2ec3d5103589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:55.979822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdcdee-3f27-4260-8782-2ec3d5103589 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:55.980284 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdcdee-3f27-4260-8782-2ec3d5103589 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:55.980571 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdcdee-3f27-4260-8782-2ec3d5103589 None admin] PATH_INFO: `/v3/users/669c70854d614e03bf7fcaebb7f4c1c9` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:55.981384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-935f5c57-b77b-415a-b5b8-2522fc88b386 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:55.981384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:55.981384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:55.981384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:55.981384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:55.981384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:55.981384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:55.981384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:55.981384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:55.981384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:55.981384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:55.981384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:55.981384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:55.981384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:55.981384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:55.981384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:55.982247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:55.982247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:55.982247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:55.982247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:55.982247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:55.982247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:55.982247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:55.982247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:55.982247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:55.982247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:55.982247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:55.982247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:32:55.982247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:55.982247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:55.982247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:55.982247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:55.983452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:55.983452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:55.983452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:55.983452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:55.983452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:55.983452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:55.983452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:55.983452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:55.983452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:55.983452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:55.983452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:55.983452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:32:55.983452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 154/302] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:32:55.988449 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861ac6d-c062-477a-bf86-ad5eef6ba545 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:55.988743 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861ac6d-c062-477a-bf86-ad5eef6ba545 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:55.989017 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861ac6d-c062-477a-bf86-ad5eef6ba545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:55.997190 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdcdee-3f27-4260-8782-2ec3d5103589 None admin] RBAC: Authorizing `identity:get_user(user_id=669c70854d614e03bf7fcaebb7f4c1c9)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:55.998657 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdcdee-3f27-4260-8782-2ec3d5103589 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:56.000808 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 149/303] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:55 2022] GET /identity/v3/users/669c70854d614e03bf7fcaebb7f4c1c9 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:32:56.001558 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdcdee-3f27-4260-8782-2ec3d5103589 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:56.006640 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-6861ac6d-c062-477a-bf86-ad5eef6ba545 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:56.007979 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-6861ac6d-c062-477a-bf86-ad5eef6ba545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:56.087084 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 155/304] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:56.087084 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861ac6d-c062-477a-bf86-ad5eef6ba545 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:56.099866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdcdee-3f27-4260-8782-2ec3d5103589 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:56.132694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c03d0-76c1-443f-afa6-36f5fdf28c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:56.133366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c03d0-76c1-443f-afa6-36f5fdf28c84 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:56.133658 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c03d0-76c1-443f-afa6-36f5fdf28c84 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:56.133915 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c03d0-76c1-443f-afa6-36f5fdf28c84 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:56.134640 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c03d0-76c1-443f-afa6-36f5fdf28c84 None admin] RBAC: Adding query filter params (name=member) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:56.134987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c03d0-76c1-443f-afa6-36f5fdf28c84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:56.136425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c03d0-76c1-443f-afa6-36f5fdf28c84 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:56.144516 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 150/305] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:32:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:56.145328 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c03d0-76c1-443f-afa6-36f5fdf28c84 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:56.180052 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861ac6d-c062-477a-bf86-ad5eef6ba545 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:56.212296 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecae9c-8ddf-4e2e-adac-f0fb1408f580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:56.212956 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecae9c-8ddf-4e2e-adac-f0fb1408f580 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:56.213236 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecae9c-8ddf-4e2e-adac-f0fb1408f580 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:56.213511 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecae9c-8ddf-4e2e-adac-f0fb1408f580 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:56.214390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aecae9c-8ddf-4e2e-adac-f0fb1408f580 None admin] RBAC: Adding query filter params (role.id=cafece24a80f46f589a1ac3512d79cec, user.id=669c70854d614e03bf7fcaebb7f4c1c9, scope.system=all) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:56.214697 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aecae9c-8ddf-4e2e-adac-f0fb1408f580 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:56.216173 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aecae9c-8ddf-4e2e-adac-f0fb1408f580 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:56.221243 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 156/306] 10.222.0.11 () {56 vars in 1308 bytes} [Wed May 4 21:32:56 2022] GET /identity/v3/role_assignments?user.id=669c70854d614e03bf7fcaebb7f4c1c9&scope.system=all&role.id=cafece24a80f46f589a1ac3512d79cec => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:56.222247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecae9c-8ddf-4e2e-adac-f0fb1408f580 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:56.256635 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c03d0-76c1-443f-afa6-36f5fdf28c84 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:56.301687 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805f26d-bd68-47ee-893f-fbf2d8c443de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:56.302900 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805f26d-bd68-47ee-893f-fbf2d8c443de None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:56.303846 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805f26d-bd68-47ee-893f-fbf2d8c443de None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:56.304328 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805f26d-bd68-47ee-893f-fbf2d8c443de None admin] PATH_INFO: `/v3/domains/default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:56.306447 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805f26d-bd68-47ee-893f-fbf2d8c443de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:56.308850 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805f26d-bd68-47ee-893f-fbf2d8c443de None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:56.311926 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 151/307] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:32:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:56.316909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805f26d-bd68-47ee-893f-fbf2d8c443de None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:56.333364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecae9c-8ddf-4e2e-adac-f0fb1408f580 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:56.380185 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b4096-1397-4f50-8bb8-b1e34697679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:56.381829 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b4096-1397-4f50-8bb8-b1e34697679e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:56.382337 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b4096-1397-4f50-8bb8-b1e34697679e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:56.382963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b4096-1397-4f50-8bb8-b1e34697679e None admin] PATH_INFO: `/v3/users/405036e8650e4ca594c8848c37b494bd` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:56.385351 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b4096-1397-4f50-8bb8-b1e34697679e None admin] RBAC: Authorizing `identity:get_user(user_id=405036e8650e4ca594c8848c37b494bd)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:56.387824 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b4096-1397-4f50-8bb8-b1e34697679e None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:56.394775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 157/308] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:56 2022] GET /identity/v3/users/405036e8650e4ca594c8848c37b494bd => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:56.396831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b4096-1397-4f50-8bb8-b1e34697679e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:56.439101 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805f26d-bd68-47ee-893f-fbf2d8c443de None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:56.485341 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b012d-8cd9-4f44-ab6f-64d7548d1a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:56.486942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b012d-8cd9-4f44-ab6f-64d7548d1a4e None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:56.487439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b012d-8cd9-4f44-ab6f-64d7548d1a4e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:56.487887 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b012d-8cd9-4f44-ab6f-64d7548d1a4e None admin] PATH_INFO: `/v3/groups` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:56.489258 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b012d-8cd9-4f44-ab6f-64d7548d1a4e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:56.491265 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b012d-8cd9-4f44-ab6f-64d7548d1a4e None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:56.506745 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b4096-1397-4f50-8bb8-b1e34697679e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:56.515498 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 152/309] 10.222.0.11 () {60 vars in 1134 bytes} [Wed May 4 21:32:56 2022] POST /identity/v3/groups => generated 229 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:32:56.544538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb7cfd-092c-470a-8d4e-9d155574477c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:56.546033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb7cfd-092c-470a-8d4e-9d155574477c None admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:56.546458 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb7cfd-092c-470a-8d4e-9d155574477c None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:56.546902 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb7cfd-092c-470a-8d4e-9d155574477c None admin] PATH_INFO: `/v3/system/users/405036e8650e4ca594c8848c37b494bd/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:56.548742 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb7cfd-092c-470a-8d4e-9d155574477c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=405036e8650e4ca594c8848c37b494bd, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:56.550403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb7cfd-092c-470a-8d4e-9d155574477c None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:56.562510 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 158/310] 10.222.0.11 () {58 vars in 1334 bytes} [Wed May 4 21:32:56 2022] PUT /identity/v3/system/users/405036e8650e4ca594c8848c37b494bd/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:32:56.576132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5394cb5-e7bf-4873-b0f4-3fa95b0920d9 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:56.576833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5394cb5-e7bf-4873-b0f4-3fa95b0920d9 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:56.577357 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5394cb5-e7bf-4873-b0f4-3fa95b0920d9 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:56.579119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 153/311] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:56.585473 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d55648-ae64-4570-84a2-fc559fb7f142 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:56.585765 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d55648-ae64-4570-84a2-fc559fb7f142 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:56.586045 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d55648-ae64-4570-84a2-fc559fb7f142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:56.606497 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-21d55648-ae64-4570-84a2-fc559fb7f142 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:56.607782 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-21d55648-ae64-4570-84a2-fc559fb7f142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:56.685459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 159/312] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:56.709902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5394cb5-e7bf-4873-b0f4-3fa95b0920d9 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:56.821029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5394cb5-e7bf-4873-b0f4-3fa95b0920d9 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:56.853164 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd689f-aec6-4b27-90a9-e4e9925739c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:56.853959 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd689f-aec6-4b27-90a9-e4e9925739c4 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:56.854238 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd689f-aec6-4b27-90a9-e4e9925739c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:56.854537 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd689f-aec6-4b27-90a9-e4e9925739c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:56.864225 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd689f-aec6-4b27-90a9-e4e9925739c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:56.872991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-76cd689f-aec6-4b27-90a9-e4e9925739c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:32:56.872991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:56.872991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:56.872991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:56.872991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:56.872991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:56.872991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:56.872991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:56.872991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:56.872991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:56.872991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:56.872991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:56.872991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:56.872991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:56.872991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:56.872991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:56.873932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:56.873932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:56.873932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:56.873932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:56.873932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:56.873932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:56.873932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:56.873932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:56.873932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:56.873932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:56.873932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:56.873932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:32:56.873932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:56.873932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:56.873932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:56.873932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:56.874752 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:56.874752 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:56.874752 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:56.874752 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:56.874752 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:56.874752 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:56.874752 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:56.874752 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:56.874752 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:56.874752 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:56.874752 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:32:56.874752 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:32:56.874752 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 154/313] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:56.881948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d55648-ae64-4570-84a2-fc559fb7f142 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:56.986317 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d55648-ae64-4570-84a2-fc559fb7f142 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:57.023702 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e351ffb-4f5b-43a3-baf1-e701a11d2d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:57.024385 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e351ffb-4f5b-43a3-baf1-e701a11d2d6e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:57.024669 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e351ffb-4f5b-43a3-baf1-e701a11d2d6e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:57.024947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e351ffb-4f5b-43a3-baf1-e701a11d2d6e None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:57.025723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e351ffb-4f5b-43a3-baf1-e701a11d2d6e None admin] RBAC: Adding query filter params (name=reader) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:57.026037 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e351ffb-4f5b-43a3-baf1-e701a11d2d6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:57.027700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e351ffb-4f5b-43a3-baf1-e701a11d2d6e None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:57.041703 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 160/314] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:32:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:57.047358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd689f-aec6-4b27-90a9-e4e9925739c4 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:57.147652 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd689f-aec6-4b27-90a9-e4e9925739c4 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:57.180287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396d78a-e966-401e-a9ab-e12fb8a30626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:57.181170 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396d78a-e966-401e-a9ab-e12fb8a30626 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:57.181456 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396d78a-e966-401e-a9ab-e12fb8a30626 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:57.181753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396d78a-e966-401e-a9ab-e12fb8a30626 None admin] PATH_INFO: `/v3/users/ff0beea6129f4ee7bf98b6db7d6b74df` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:57.183023 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396d78a-e966-401e-a9ab-e12fb8a30626 None admin] RBAC: Authorizing `identity:get_user(user_id=ff0beea6129f4ee7bf98b6db7d6b74df)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:57.184601 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396d78a-e966-401e-a9ab-e12fb8a30626 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:57.186531 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 155/315] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:57 2022] GET /identity/v3/users/ff0beea6129f4ee7bf98b6db7d6b74df => generated 297 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:57.192044 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e351ffb-4f5b-43a3-baf1-e701a11d2d6e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:57.290857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e351ffb-4f5b-43a3-baf1-e701a11d2d6e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:57.330249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b3e8d-1a77-47ba-88c0-466874f44f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:57.330914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b3e8d-1a77-47ba-88c0-466874f44f54 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:57.331236 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b3e8d-1a77-47ba-88c0-466874f44f54 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:57.331521 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b3e8d-1a77-47ba-88c0-466874f44f54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:57.400825 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b3e8d-1a77-47ba-88c0-466874f44f54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:57.402488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b3e8d-1a77-47ba-88c0-466874f44f54 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:57.498412 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 161/316] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:32:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:32:57.503962 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396d78a-e966-401e-a9ab-e12fb8a30626 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:57.610639 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396d78a-e966-401e-a9ab-e12fb8a30626 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:57.644541 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47b0b7-1511-45a9-a6b9-6c7b67b43113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:57.645418 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47b0b7-1511-45a9-a6b9-6c7b67b43113 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:57.645706 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47b0b7-1511-45a9-a6b9-6c7b67b43113 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:57.645987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47b0b7-1511-45a9-a6b9-6c7b67b43113 None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:57.647219 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47b0b7-1511-45a9-a6b9-6c7b67b43113 None admin] RBAC: Authorizing `identity:get_project(project_id=70d15e4994bb4da4af477c7904278502)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:57.648675 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47b0b7-1511-45a9-a6b9-6c7b67b43113 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:57.650690 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 156/317] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:32:57 2022] GET /identity/v3/projects/70d15e4994bb4da4af477c7904278502 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:57.656584 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b3e8d-1a77-47ba-88c0-466874f44f54 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:57.756613 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b3e8d-1a77-47ba-88c0-466874f44f54 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:57.792676 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58629eca-4ed0-4c2c-819b-c5c6a588cf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:57.793341 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58629eca-4ed0-4c2c-819b-c5c6a588cf67 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:57.793625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58629eca-4ed0-4c2c-819b-c5c6a588cf67 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:57.793901 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58629eca-4ed0-4c2c-819b-c5c6a588cf67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:57.794736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58629eca-4ed0-4c2c-819b-c5c6a588cf67 None admin] RBAC: Adding query filter params (role.id=cafece24a80f46f589a1ac3512d79cec, scope.project.id=70d15e4994bb4da4af477c7904278502, user.id=ff0beea6129f4ee7bf98b6db7d6b74df) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:57.795064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58629eca-4ed0-4c2c-819b-c5c6a588cf67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:57.796509 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58629eca-4ed0-4c2c-819b-c5c6a588cf67 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:57.803325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 162/318] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:32:57 2022] GET /identity/v3/role_assignments?user.id=ff0beea6129f4ee7bf98b6db7d6b74df&scope.project.id=70d15e4994bb4da4af477c7904278502&role.id=cafece24a80f46f589a1ac3512d79cec => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:58.495966 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d207c3-d428-4443-b15f-138ba5d862fb None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:58.496213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d207c3-d428-4443-b15f-138ba5d862fb None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:58.496723 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d207c3-d428-4443-b15f-138ba5d862fb None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:58.498262 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 157/319] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:58.503605 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91af7-123d-4061-b080-2568a09a3247 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:58.503869 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91af7-123d-4061-b080-2568a09a3247 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:58.504175 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91af7-123d-4061-b080-2568a09a3247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:58.520994 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-86c91af7-123d-4061-b080-2568a09a3247 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:58.522155 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-86c91af7-123d-4061-b080-2568a09a3247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:58.595614 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 163/320] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:58.617871 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d207c3-d428-4443-b15f-138ba5d862fb None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:58.720601 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d207c3-d428-4443-b15f-138ba5d862fb None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:58.762125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f400c-c812-469f-922c-b2944f9e533d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:58.762860 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f400c-c812-469f-922c-b2944f9e533d None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:58.763174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f400c-c812-469f-922c-b2944f9e533d None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:58.763452 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f400c-c812-469f-922c-b2944f9e533d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:58.774281 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f400c-c812-469f-922c-b2944f9e533d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:58.782057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-c72f400c-c812-469f-922c-b2944f9e533d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:32:58.782057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:58.782057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:58.782057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:58.782057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:58.782057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:58.782057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:58.782057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:58.782057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:58.782057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:58.782057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:58.782057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:58.782057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:58.782057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:58.782057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:58.782057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:58.782963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:58.782963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:58.782963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:58.782963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:58.782963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:58.782963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:58.782963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:58.782963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:58.782963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:58.782963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:58.782963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:58.782963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:32:58.782963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:58.782963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:58.782963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:58.782963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:58.783776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:58.783776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:58.783776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:58.783776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:58.783776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:58.783776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:58.783776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:58.783776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:58.783776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:58.783776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:58.783776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:32:58.783776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:32:58.787451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 158/321] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:58.789290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c91af7-123d-4061-b080-2568a09a3247 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:58.887539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c91af7-123d-4061-b080-2568a09a3247 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:58.910833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683308-15ec-4221-b8ae-d8e9141a038a None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:58.911172 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683308-15ec-4221-b8ae-d8e9141a038a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:58.911459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683308-15ec-4221-b8ae-d8e9141a038a None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:58.912832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 159/322] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:32:58.918372 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0af53-e83a-4414-bec0-72f3e9657747 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:58.918660 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0af53-e83a-4414-bec0-72f3e9657747 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:58.918943 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0af53-e83a-4414-bec0-72f3e9657747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:58.922971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05308e72-d199-48f1-b8f4-d34613ffe6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:58.923675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05308e72-d199-48f1-b8f4-d34613ffe6a8 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:58.923962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05308e72-d199-48f1-b8f4-d34613ffe6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:58.924232 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05308e72-d199-48f1-b8f4-d34613ffe6a8 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:58.924983 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05308e72-d199-48f1-b8f4-d34613ffe6a8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:58.925563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05308e72-d199-48f1-b8f4-d34613ffe6a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:58.926942 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05308e72-d199-48f1-b8f4-d34613ffe6a8 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:58.939716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 164/323] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:32:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:58.939716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe0ce2-d28f-4624-930e-1f28dd0f388b None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:58.939716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe0ce2-d28f-4624-930e-1f28dd0f388b None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:58.939716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe0ce2-d28f-4624-930e-1f28dd0f388b None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:58.939716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 165/324] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:58.940551 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe0ce2-d28f-4624-930e-1f28dd0f388b None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:58.941186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-15a0af53-e83a-4414-bec0-72f3e9657747 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:58.942593 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-15a0af53-e83a-4414-bec0-72f3e9657747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:59.006984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 160/325] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:32:59.008291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7e4e1-58d5-4833-b38e-b03475388abd None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:59.008580 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7e4e1-58d5-4833-b38e-b03475388abd None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:59.008841 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7e4e1-58d5-4833-b38e-b03475388abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:59.024881 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-1cc7e4e1-58d5-4833-b38e-b03475388abd None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:59.025973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-1cc7e4e1-58d5-4833-b38e-b03475388abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:59.047400 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe0ce2-d28f-4624-930e-1f28dd0f388b None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:59.085571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c037b84-18c6-4051-bf3d-142fd4ed0758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:59.086841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c037b84-18c6-4051-bf3d-142fd4ed0758 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:59.087216 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c037b84-18c6-4051-bf3d-142fd4ed0758 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:59.087552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c037b84-18c6-4051-bf3d-142fd4ed0758 None admin] PATH_INFO: `/v3/users/669c70854d614e03bf7fcaebb7f4c1c9` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:59.089048 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c037b84-18c6-4051-bf3d-142fd4ed0758 None admin] RBAC: Authorizing `identity:get_user(user_id=669c70854d614e03bf7fcaebb7f4c1c9)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:59.090196 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 161/326] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:32:59.091075 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c037b84-18c6-4051-bf3d-142fd4ed0758 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:59.091171 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7e4e1-58d5-4833-b38e-b03475388abd None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:59.093947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 166/327] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:58 2022] GET /identity/v3/users/669c70854d614e03bf7fcaebb7f4c1c9 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:59.100710 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c037b84-18c6-4051-bf3d-142fd4ed0758 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:59.190649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7e4e1-58d5-4833-b38e-b03475388abd None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:59.198817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c037b84-18c6-4051-bf3d-142fd4ed0758 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:59.224176 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e47ca8-e688-43b0-899e-028ba13e56c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:59.224988 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e47ca8-e688-43b0-899e-028ba13e56c3 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:59.225268 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e47ca8-e688-43b0-899e-028ba13e56c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:59.225539 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e47ca8-e688-43b0-899e-028ba13e56c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:59.226702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e47ca8-e688-43b0-899e-028ba13e56c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:59.228258 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e47ca8-e688-43b0-899e-028ba13e56c3 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:59.229999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 162/328] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:32:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:59.230757 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e47ca8-e688-43b0-899e-028ba13e56c3 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:59.235759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b120c-60bf-4109-aba3-89e2a9238b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:59.236627 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b120c-60bf-4109-aba3-89e2a9238b61 None admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:59.236906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b120c-60bf-4109-aba3-89e2a9238b61 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:59.237185 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b120c-60bf-4109-aba3-89e2a9238b61 None admin] PATH_INFO: `/v3/system/users/669c70854d614e03bf7fcaebb7f4c1c9/roles/cafece24a80f46f589a1ac3512d79cec` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:59.238667 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b120c-60bf-4109-aba3-89e2a9238b61 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=669c70854d614e03bf7fcaebb7f4c1c9, role_id=cafece24a80f46f589a1ac3512d79cec)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:59.240073 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b120c-60bf-4109-aba3-89e2a9238b61 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:59.248180 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 167/329] 10.222.0.11 () {58 vars in 1334 bytes} [Wed May 4 21:32:59 2022] PUT /identity/v3/system/users/669c70854d614e03bf7fcaebb7f4c1c9/roles/cafece24a80f46f589a1ac3512d79cec => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:32:59.248947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b120c-60bf-4109-aba3-89e2a9238b61 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:59.334588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e47ca8-e688-43b0-899e-028ba13e56c3 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:59.357037 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b120c-60bf-4109-aba3-89e2a9238b61 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:59.370281 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b119b4-9584-4840-b815-9efda3ff4503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:59.371135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b119b4-9584-4840-b815-9efda3ff4503 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:59.371418 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b119b4-9584-4840-b815-9efda3ff4503 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:59.371692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b119b4-9584-4840-b815-9efda3ff4503 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:59.382842 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b119b4-9584-4840-b815-9efda3ff4503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:32:59.390828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-71b119b4-9584-4840-b815-9efda3ff4503 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:59.390828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:32:59.390828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:32:59.390828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:32:59.390828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:32:59.390828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:32:59.390828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:32:59.390828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:32:59.390828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:32:59.390828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:32:59.390828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:32:59.390828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:32:59.390828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:32:59.390828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:32:59.390828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:32:59.390828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:32:59.392005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:32:59.392005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:32:59.392005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:32:59.392005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:32:59.392005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:32:59.392005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:32:59.392005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:32:59.392005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:32:59.392005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:32:59.392005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:32:59.392005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:32:59.392005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:32:59.392005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:32:59.392005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:32:59.392005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:32:59.392005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:32:59.392812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:32:59.392812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:32:59.392812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:32:59.392812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:32:59.392812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:32:59.392812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:32:59.392812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:32:59.392812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:32:59.392812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:32:59.392812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:32:59.392812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:32:59.392812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:32:59.393501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e4482-906e-4ec5-ad51-0a1ade8f8aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:59.393501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e4482-906e-4ec5-ad51-0a1ade8f8aff None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:59.393501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e4482-906e-4ec5-ad51-0a1ade8f8aff None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:59.393501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e4482-906e-4ec5-ad51-0a1ade8f8aff None admin] PATH_INFO: `/v3/groups` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:59.393769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e4482-906e-4ec5-ad51-0a1ade8f8aff None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:59.394952 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e4482-906e-4ec5-ad51-0a1ade8f8aff None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:59.397264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 163/330] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:32:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:32:59.398226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b119b4-9584-4840-b815-9efda3ff4503 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:59.423653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 168/331] 10.222.0.11 () {60 vars in 1134 bytes} [Wed May 4 21:32:59 2022] POST /identity/v3/groups => generated 226 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:32:59.505201 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b119b4-9584-4840-b815-9efda3ff4503 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:59.541513 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51da7c-0e7d-43ef-b772-3d6c47e840fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:59.542255 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51da7c-0e7d-43ef-b772-3d6c47e840fa None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:59.542501 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51da7c-0e7d-43ef-b772-3d6c47e840fa None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:59.542805 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51da7c-0e7d-43ef-b772-3d6c47e840fa None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:59.543577 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51da7c-0e7d-43ef-b772-3d6c47e840fa None admin] RBAC: Adding query filter params (name=member) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:59.543898 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51da7c-0e7d-43ef-b772-3d6c47e840fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:59.545285 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51da7c-0e7d-43ef-b772-3d6c47e840fa None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:59.554729 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 164/332] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:32:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:59.560419 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e4482-906e-4ec5-ad51-0a1ade8f8aff None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:59.663171 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e4482-906e-4ec5-ad51-0a1ade8f8aff None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:59.698732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b1351-a390-49b5-b16c-9926da4e1e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:59.699692 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b1351-a390-49b5-b16c-9926da4e1e71 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:59.699979 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b1351-a390-49b5-b16c-9926da4e1e71 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:59.700259 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b1351-a390-49b5-b16c-9926da4e1e71 None admin] PATH_INFO: `/v3/users/405036e8650e4ca594c8848c37b494bd` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:59.701664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b1351-a390-49b5-b16c-9926da4e1e71 None admin] RBAC: Authorizing `identity:get_user(user_id=405036e8650e4ca594c8848c37b494bd)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:59.703237 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b1351-a390-49b5-b16c-9926da4e1e71 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:59.704914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 169/333] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:32:59 2022] GET /identity/v3/users/405036e8650e4ca594c8848c37b494bd => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:32:59.710903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51da7c-0e7d-43ef-b772-3d6c47e840fa None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:59.810831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51da7c-0e7d-43ef-b772-3d6c47e840fa None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:59.845447 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3b7dd-2b00-427f-990f-4686ee9d2e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:59.846124 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3b7dd-2b00-427f-990f-4686ee9d2e53 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:59.846407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3b7dd-2b00-427f-990f-4686ee9d2e53 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:59.846684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3b7dd-2b00-427f-990f-4686ee9d2e53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:59.847575 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3b7dd-2b00-427f-990f-4686ee9d2e53 None admin] RBAC: Adding query filter params (role.id=b03b07e63e164e6a8858592b025c8103, user.id=405036e8650e4ca594c8848c37b494bd, scope.system=all) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:32:59.847941 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3b7dd-2b00-427f-990f-4686ee9d2e53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:59.849728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3b7dd-2b00-427f-990f-4686ee9d2e53 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:59.862742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 165/334] 10.222.0.11 () {56 vars in 1308 bytes} [Wed May 4 21:32:59 2022] GET /identity/v3/role_assignments?user.id=405036e8650e4ca594c8848c37b494bd&scope.system=all&role.id=b03b07e63e164e6a8858592b025c8103 => generated 510 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:01.872534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10673e15-306b-4372-9396-1ca3ebcc17ae None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:01.873055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10673e15-306b-4372-9396-1ca3ebcc17ae None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:01.873055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10673e15-306b-4372-9396-1ca3ebcc17ae None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:01.874720 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 170/335] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:01.879928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd476b-d805-4fcf-bd39-e8a3fc703fd5 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:01.880794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd476b-d805-4fcf-bd39-e8a3fc703fd5 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:01.881278 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd476b-d805-4fcf-bd39-e8a3fc703fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:01.908083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-04cd476b-d805-4fcf-bd39-e8a3fc703fd5 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:01.909637 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-04cd476b-d805-4fcf-bd39-e8a3fc703fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:01.986606 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 166/336] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:02.022301 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10673e15-306b-4372-9396-1ca3ebcc17ae None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:02.140776 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10673e15-306b-4372-9396-1ca3ebcc17ae None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:02.175117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed67fc2-9635-4a84-a251-ec5cf3da260e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:02.176346 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed67fc2-9635-4a84-a251-ec5cf3da260e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:02.176856 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed67fc2-9635-4a84-a251-ec5cf3da260e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:02.177340 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed67fc2-9635-4a84-a251-ec5cf3da260e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:02.195968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed67fc2-9635-4a84-a251-ec5cf3da260e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:02.204056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-6ed67fc2-9635-4a84-a251-ec5cf3da260e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:33:02.204056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:02.204056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:02.204056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:02.204056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:02.204056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:02.204056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:02.204056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:02.204056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:02.204056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:02.204056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:02.204056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:02.204056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:02.204056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:02.204056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:02.204056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:02.205002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:02.205002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:02.205002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:02.205002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:02.205002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:02.205002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:02.205002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:02.205002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:02.205002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:02.205002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:02.205002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:02.205002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:02.205002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:02.205002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:02.205002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:02.205002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:02.206397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:02.206397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:02.206397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:02.206397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:02.206397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:02.206397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:02.206397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:02.206397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:02.206397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:02.206397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:02.206397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:33:02.206397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:02.206397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 171/337] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:02.211509 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd476b-d805-4fcf-bd39-e8a3fc703fd5 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:02.271022 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91df4d6-e443-46cf-8c0a-211577441f46 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:02.271382 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91df4d6-e443-46cf-8c0a-211577441f46 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:02.271609 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91df4d6-e443-46cf-8c0a-211577441f46 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:02.273254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 172/338] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:02.278950 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff510064-d6e4-4395-9e10-a62ba02769a1 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:02.279264 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff510064-d6e4-4395-9e10-a62ba02769a1 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:02.279543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff510064-d6e4-4395-9e10-a62ba02769a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:02.304363 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-ff510064-d6e4-4395-9e10-a62ba02769a1 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:02.305547 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ff510064-d6e4-4395-9e10-a62ba02769a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:02.376234 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd476b-d805-4fcf-bd39-e8a3fc703fd5 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:02.426220 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4357bf-51b1-4ed9-b54e-1d03ffedb3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:02.426926 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4357bf-51b1-4ed9-b54e-1d03ffedb3a8 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:02.427238 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4357bf-51b1-4ed9-b54e-1d03ffedb3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:02.427517 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4357bf-51b1-4ed9-b54e-1d03ffedb3a8 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:02.428663 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4357bf-51b1-4ed9-b54e-1d03ffedb3a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:02.428976 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4357bf-51b1-4ed9-b54e-1d03ffedb3a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:02.430608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4357bf-51b1-4ed9-b54e-1d03ffedb3a8 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:02.446500 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 167/339] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:33:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:02.453746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4357bf-51b1-4ed9-b54e-1d03ffedb3a8 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:02.489719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 173/340] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:33:02.518719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658311b-91a7-45e6-b1d4-20840f16053e None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:02.519287 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658311b-91a7-45e6-b1d4-20840f16053e None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:02.519722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658311b-91a7-45e6-b1d4-20840f16053e None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:02.521510 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 174/341] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:02.527009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3d4da-435c-40ed-a933-b3421d7c7ab0 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:02.527517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3d4da-435c-40ed-a933-b3421d7c7ab0 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:02.527936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3d4da-435c-40ed-a933-b3421d7c7ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:02.556918 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-4af3d4da-435c-40ed-a933-b3421d7c7ab0 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:02.558910 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-4af3d4da-435c-40ed-a933-b3421d7c7ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:02.572381 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4357bf-51b1-4ed9-b54e-1d03ffedb3a8 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:02.615118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d8fe7-c423-44ab-bd31-3946bb1d5b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:02.615782 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8fe7-c423-44ab-bd31-3946bb1d5b27 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:02.616062 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8fe7-c423-44ab-bd31-3946bb1d5b27 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:02.616337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8fe7-c423-44ab-bd31-3946bb1d5b27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:02.689730 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 175/342] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:02.690519 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3d4da-435c-40ed-a933-b3421d7c7ab0 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:02.733270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d8fe7-c423-44ab-bd31-3946bb1d5b27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:02.734753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d8fe7-c423-44ab-bd31-3946bb1d5b27 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:02.857909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 168/343] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:02.858788 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d8fe7-c423-44ab-bd31-3946bb1d5b27 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:02.874042 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3d4da-435c-40ed-a933-b3421d7c7ab0 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:02.964897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d8fe7-c423-44ab-bd31-3946bb1d5b27 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:02.971766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f04f3b-6b64-49a4-8403-b61a0f319d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:02.972601 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f04f3b-6b64-49a4-8403-b61a0f319d16 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:02.972887 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f04f3b-6b64-49a4-8403-b61a0f319d16 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:02.973161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f04f3b-6b64-49a4-8403-b61a0f319d16 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:03.000073 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f04f3b-6b64-49a4-8403-b61a0f319d16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:03.007694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-22f04f3b-6b64-49a4-8403-b61a0f319d16 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:33:03.007694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:03.007694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:03.007694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:03.007694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:03.007694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:03.007694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:03.007694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:03.007694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:03.007694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:03.007694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:03.007694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:03.007694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:03.007694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:03.007694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:03.007694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:03.008578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:03.008578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:03.008578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:03.008578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:03.008578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:03.008578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:03.008578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:03.008578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:03.008578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:03.008578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:03.008578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:03.008578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:03.008578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:03.008578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:03.008578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:03.008578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:03.009408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:03.009408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:03.009408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:03.009408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:03.009408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:03.009408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:03.009408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:03.009408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:03.009408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:03.009408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:03.009408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:33:03.009408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:03.010643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 176/344] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:03.011725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda8aa7-6f05-47a1-bcc2-6c6ba0822e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:03.012176 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda8aa7-6f05-47a1-bcc2-6c6ba0822e8f None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:03.012455 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda8aa7-6f05-47a1-bcc2-6c6ba0822e8f None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:03.013221 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda8aa7-6f05-47a1-bcc2-6c6ba0822e8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:03.017776 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f04f3b-6b64-49a4-8403-b61a0f319d16 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:03.033178 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda8aa7-6f05-47a1-bcc2-6c6ba0822e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:03.041149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-3bda8aa7-6f05-47a1-bcc2-6c6ba0822e8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:33:03.041149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:03.041149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:03.041149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:03.041149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:03.041149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:03.041149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:03.041149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:03.041149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:03.041149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:03.041149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:03.041149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:03.041149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:03.041149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:03.041149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:03.041149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:03.043630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:03.043630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:03.043630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:03.043630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:03.043630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:03.043630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:03.043630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:03.043630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:03.043630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:03.043630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:03.043630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:03.043630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:03.043630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:03.043630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:03.043630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:03.043630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:03.045507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:03.045507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:03.045507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:03.045507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:03.045507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:03.045507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:03.045507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:03.045507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:03.045507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:03.045507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:03.045507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:33:03.045507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:03.045507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 169/345] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:33:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:03.047159 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda8aa7-6f05-47a1-bcc2-6c6ba0822e8f None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:03.146174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f04f3b-6b64-49a4-8403-b61a0f319d16 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:03.182043 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd94581-fbcb-4cb0-92ed-036ea9b1001f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:03.183138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd94581-fbcb-4cb0-92ed-036ea9b1001f None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:03.183426 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd94581-fbcb-4cb0-92ed-036ea9b1001f None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:03.183705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd94581-fbcb-4cb0-92ed-036ea9b1001f None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:03.184911 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd94581-fbcb-4cb0-92ed-036ea9b1001f None admin] RBAC: Authorizing `identity:get_project(project_id=b8a06ae2ea914e91922edccf3b59d6dc)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:03.186377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd94581-fbcb-4cb0-92ed-036ea9b1001f None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:03.188393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 177/346] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:33:03 2022] GET /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:03.189162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd94581-fbcb-4cb0-92ed-036ea9b1001f None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:03.216433 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda8aa7-6f05-47a1-bcc2-6c6ba0822e8f None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:03.251526 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a77f0-edf6-472c-a0da-263ccb8eb6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:03.252479 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a77f0-edf6-472c-a0da-263ccb8eb6f4 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:03.252770 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a77f0-edf6-472c-a0da-263ccb8eb6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:03.253195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a77f0-edf6-472c-a0da-263ccb8eb6f4 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:03.254003 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a77f0-edf6-472c-a0da-263ccb8eb6f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:03.254287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a77f0-edf6-472c-a0da-263ccb8eb6f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:03.256318 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a77f0-edf6-472c-a0da-263ccb8eb6f4 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:03.270936 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 170/347] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:33:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:03.272626 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f5f8a-8385-40bb-aeca-547029b5e0cf None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:03.273136 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f5f8a-8385-40bb-aeca-547029b5e0cf None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:03.273614 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f5f8a-8385-40bb-aeca-547029b5e0cf None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:03.275285 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 171/348] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:03.276400 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f5f8a-8385-40bb-aeca-547029b5e0cf None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:03.303302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd94581-fbcb-4cb0-92ed-036ea9b1001f None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:03.337711 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825ae4b-6327-4693-8aaf-41511dd6c3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:03.338425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825ae4b-6327-4693-8aaf-41511dd6c3ce None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:03.340151 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825ae4b-6327-4693-8aaf-41511dd6c3ce None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:03.340151 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825ae4b-6327-4693-8aaf-41511dd6c3ce None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:03.340151 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825ae4b-6327-4693-8aaf-41511dd6c3ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:03.340472 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825ae4b-6327-4693-8aaf-41511dd6c3ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:03.342216 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825ae4b-6327-4693-8aaf-41511dd6c3ce None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:03.353696 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 178/349] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:03.354809 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825ae4b-6327-4693-8aaf-41511dd6c3ce None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:03.385540 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f5f8a-8385-40bb-aeca-547029b5e0cf None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:03.424997 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a63b88-f459-46ac-a479-47f70079dfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:03.426282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a63b88-f459-46ac-a479-47f70079dfd4 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:03.426820 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a63b88-f459-46ac-a479-47f70079dfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:03.427349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a63b88-f459-46ac-a479-47f70079dfd4 None admin] PATH_INFO: `/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:03.436061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a63b88-f459-46ac-a479-47f70079dfd4 None admin] RBAC: Authorizing `identity:get_group(group_id=75f5d66fcc014c5dafac6abfc79aab4f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:03.437975 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a63b88-f459-46ac-a479-47f70079dfd4 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:03.440243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 172/350] 10.222.0.11 () {56 vars in 1180 bytes} [Wed May 4 21:33:03 2022] GET /identity/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:03.442044 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb494cd7-a971-4ee8-9034-93065f7f6b4e None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:03.442526 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb494cd7-a971-4ee8-9034-93065f7f6b4e None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:03.442998 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb494cd7-a971-4ee8-9034-93065f7f6b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:03.460159 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-cb494cd7-a971-4ee8-9034-93065f7f6b4e None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:03.461735 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-cb494cd7-a971-4ee8-9034-93065f7f6b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:03.475541 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825ae4b-6327-4693-8aaf-41511dd6c3ce None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:03.526241 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c5e7b-7ea3-48b2-80da-b1d99b8b0404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:03.527445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c5e7b-7ea3-48b2-80da-b1d99b8b0404 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:03.527732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c5e7b-7ea3-48b2-80da-b1d99b8b0404 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:03.528012 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c5e7b-7ea3-48b2-80da-b1d99b8b0404 None admin] PATH_INFO: `/v3/users/669c70854d614e03bf7fcaebb7f4c1c9` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:03.529991 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c5e7b-7ea3-48b2-80da-b1d99b8b0404 None admin] RBAC: Authorizing `identity:get_user(user_id=669c70854d614e03bf7fcaebb7f4c1c9)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:03.531739 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c5e7b-7ea3-48b2-80da-b1d99b8b0404 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:03.534831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 179/351] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:33:03 2022] GET /identity/v3/users/669c70854d614e03bf7fcaebb7f4c1c9 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:03.535943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c5e7b-7ea3-48b2-80da-b1d99b8b0404 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:03.540866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 173/352] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:03.542224 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb494cd7-a971-4ee8-9034-93065f7f6b4e None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:03.663545 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c5e7b-7ea3-48b2-80da-b1d99b8b0404 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:03.676820 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb494cd7-a971-4ee8-9034-93065f7f6b4e None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:03.707192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b252b-3eac-4c34-af46-9a44e683bc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:03.708165 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b252b-3eac-4c34-af46-9a44e683bc22 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:03.708456 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b252b-3eac-4c34-af46-9a44e683bc22 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:03.708742 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b252b-3eac-4c34-af46-9a44e683bc22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:03.713176 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81580573-45f2-417a-b3e7-ba249a8468c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:03.714182 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81580573-45f2-417a-b3e7-ba249a8468c6 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:03.714800 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81580573-45f2-417a-b3e7-ba249a8468c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:03.715306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81580573-45f2-417a-b3e7-ba249a8468c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:03.716330 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81580573-45f2-417a-b3e7-ba249a8468c6 None admin] RBAC: Adding query filter params (group.id=75f5d66fcc014c5dafac6abfc79aab4f, role.id=b03b07e63e164e6a8858592b025c8103, scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:03.716873 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81580573-45f2-417a-b3e7-ba249a8468c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:03.719518 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81580573-45f2-417a-b3e7-ba249a8468c6 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:03.725960 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 174/353] 10.222.0.11 () {56 vars in 1376 bytes} [Wed May 4 21:33:03 2022] GET /identity/v3/role_assignments?group.id=75f5d66fcc014c5dafac6abfc79aab4f&scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc&role.id=b03b07e63e164e6a8858592b025c8103 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:03.727100 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81580573-45f2-417a-b3e7-ba249a8468c6 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:03.802116 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b252b-3eac-4c34-af46-9a44e683bc22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:03.804002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b252b-3eac-4c34-af46-9a44e683bc22 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:03.861893 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81580573-45f2-417a-b3e7-ba249a8468c6 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:03.912890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d00ecf-e101-4048-8849-78188fe9f2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:03.913890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d00ecf-e101-4048-8849-78188fe9f2de None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:03.914185 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d00ecf-e101-4048-8849-78188fe9f2de None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:03.914472 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d00ecf-e101-4048-8849-78188fe9f2de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:03.915371 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d00ecf-e101-4048-8849-78188fe9f2de None admin] RBAC: Adding query filter params (role.id=cafece24a80f46f589a1ac3512d79cec, user.id=669c70854d614e03bf7fcaebb7f4c1c9, scope.system=all) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:03.915705 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d00ecf-e101-4048-8849-78188fe9f2de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:03.918601 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d00ecf-e101-4048-8849-78188fe9f2de None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:03.936122 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 175/354] 10.222.0.11 () {56 vars in 1308 bytes} [Wed May 4 21:33:03 2022] GET /identity/v3/role_assignments?user.id=669c70854d614e03bf7fcaebb7f4c1c9&scope.system=all&role.id=cafece24a80f46f589a1ac3512d79cec => generated 510 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:03.937365 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d00ecf-e101-4048-8849-78188fe9f2de None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:03.943392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 180/355] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:03.945488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750633d-bd8d-409a-8756-2a8ccbeb98b3 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:03.946135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750633d-bd8d-409a-8756-2a8ccbeb98b3 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:03.946608 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750633d-bd8d-409a-8756-2a8ccbeb98b3 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:03.948209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 181/356] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:03.949262 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750633d-bd8d-409a-8756-2a8ccbeb98b3 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:04.071074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750633d-bd8d-409a-8756-2a8ccbeb98b3 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:04.077003 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d00ecf-e101-4048-8849-78188fe9f2de None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:04.111248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f8b32-70ab-4071-80a3-729c4a1db694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:04.112906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f8b32-70ab-4071-80a3-729c4a1db694 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:04.113492 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f8b32-70ab-4071-80a3-729c4a1db694 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:04.114057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f8b32-70ab-4071-80a3-729c4a1db694 None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:04.115649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f8b32-70ab-4071-80a3-729c4a1db694 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a06ae2ea914e91922edccf3b59d6dc)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:04.117582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f8b32-70ab-4071-80a3-729c4a1db694 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:04.117740 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b1791-ddf3-4a21-8f05-47f00c533e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:04.118470 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b1791-ddf3-4a21-8f05-47f00c533e95 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:04.118762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b1791-ddf3-4a21-8f05-47f00c533e95 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:04.119063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b1791-ddf3-4a21-8f05-47f00c533e95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:04.121133 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 182/357] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:33:03 2022] GET /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:04.122682 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52818cc4-d123-42f8-8438-4b9c05313e42 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:04.123185 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52818cc4-d123-42f8-8438-4b9c05313e42 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:04.123676 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52818cc4-d123-42f8-8438-4b9c05313e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:04.132305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b1791-ddf3-4a21-8f05-47f00c533e95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:04.141636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-880b1791-ddf3-4a21-8f05-47f00c533e95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:33:04.141636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:04.141636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:04.141636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:04.141636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:04.141636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:04.141636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:04.141636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:04.141636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:04.141636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:04.141636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:04.141636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:04.141636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:04.141636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:04.141636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:04.141636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:04.142698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:04.142698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:04.142698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:04.142698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:04.142698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:04.142698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:04.142698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:04.142698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:04.142698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:04.142698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:04.142698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:04.142698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:04.142698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:04.142698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:04.142698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:04.142698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:04.143534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:04.143534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:04.143534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:04.143534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:04.143534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:04.143534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:04.143534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:04.143534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:04.143534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:04.143534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:04.143534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:33:04.143534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:04.143534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 176/358] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:04.144177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b1791-ddf3-4a21-8f05-47f00c533e95 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:04.145753 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-52818cc4-d123-42f8-8438-4b9c05313e42 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:04.147249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-52818cc4-d123-42f8-8438-4b9c05313e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:04.216924 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 183/359] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:04.218102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52818cc4-d123-42f8-8438-4b9c05313e42 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:04.253486 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b1791-ddf3-4a21-8f05-47f00c533e95 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:04.290435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2f42f-c29b-4d78-9b60-3bcacedd2c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:04.291343 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2f42f-c29b-4d78-9b60-3bcacedd2c7d None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:04.291628 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2f42f-c29b-4d78-9b60-3bcacedd2c7d None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:04.292583 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2f42f-c29b-4d78-9b60-3bcacedd2c7d None admin] PATH_INFO: `/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:04.293838 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2f42f-c29b-4d78-9b60-3bcacedd2c7d None admin] RBAC: Authorizing `identity:get_group(group_id=75f5d66fcc014c5dafac6abfc79aab4f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:04.295354 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2f42f-c29b-4d78-9b60-3bcacedd2c7d None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:04.297425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 177/360] 10.222.0.11 () {56 vars in 1180 bytes} [Wed May 4 21:33:04 2022] GET /identity/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:04.298407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2f42f-c29b-4d78-9b60-3bcacedd2c7d None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:04.319247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52818cc4-d123-42f8-8438-4b9c05313e42 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:04.356727 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621625d6-88d3-49e8-a9c4-ff26fc7da4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:04.357735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621625d6-88d3-49e8-a9c4-ff26fc7da4da None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:04.358232 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621625d6-88d3-49e8-a9c4-ff26fc7da4da None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:04.358711 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621625d6-88d3-49e8-a9c4-ff26fc7da4da None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:04.359679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621625d6-88d3-49e8-a9c4-ff26fc7da4da None admin] RBAC: Adding query filter params (name=member) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:04.360192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621625d6-88d3-49e8-a9c4-ff26fc7da4da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:04.361934 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621625d6-88d3-49e8-a9c4-ff26fc7da4da None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:04.370993 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 184/361] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:33:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:04.372700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621625d6-88d3-49e8-a9c4-ff26fc7da4da None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:04.405472 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2f42f-c29b-4d78-9b60-3bcacedd2c7d None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:04.442781 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575f5e2-b7df-4231-8993-b17efc42286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:04.444459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575f5e2-b7df-4231-8993-b17efc42286b None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:04.444756 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575f5e2-b7df-4231-8993-b17efc42286b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:04.445042 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575f5e2-b7df-4231-8993-b17efc42286b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:04.460825 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575f5e2-b7df-4231-8993-b17efc42286b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:04.466837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-b575f5e2-b7df-4231-8993-b17efc42286b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:33:04.466837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:04.466837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:04.466837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:04.466837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:04.466837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:04.466837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:04.466837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:04.466837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:04.466837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:04.466837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:04.466837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:04.466837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:04.466837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:04.466837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:04.466837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:04.467767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:04.467767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:04.467767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:04.467767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:04.467767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:04.467767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:04.467767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:04.467767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:04.467767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:04.467767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:04.467767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:04.467767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:04.467767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:04.467767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:04.467767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:04.467767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:04.468570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:04.468570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:04.468570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:04.468570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:04.468570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:04.468570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:04.468570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:04.468570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:04.468570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:04.468570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:04.468570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:33:04.468570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:04.468570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 178/362] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:33:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:04.469233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575f5e2-b7df-4231-8993-b17efc42286b None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:04.493555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621625d6-88d3-49e8-a9c4-ff26fc7da4da None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:04.543260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290caa88-6e2a-470e-8c06-a9dfb8335f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:04.543740 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290caa88-6e2a-470e-8c06-a9dfb8335f48 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:04.544024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290caa88-6e2a-470e-8c06-a9dfb8335f48 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:04.544301 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290caa88-6e2a-470e-8c06-a9dfb8335f48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:04.545152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290caa88-6e2a-470e-8c06-a9dfb8335f48 None admin] RBAC: Adding query filter params (group.id=75f5d66fcc014c5dafac6abfc79aab4f, role.id=c3d122a6c9c6478aa2dd7e5b8afe6471, scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:04.545468 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290caa88-6e2a-470e-8c06-a9dfb8335f48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:04.548808 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290caa88-6e2a-470e-8c06-a9dfb8335f48 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:04.555491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 185/363] 10.222.0.11 () {56 vars in 1376 bytes} [Wed May 4 21:33:04 2022] GET /identity/v3/role_assignments?group.id=75f5d66fcc014c5dafac6abfc79aab4f&scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc&role.id=c3d122a6c9c6478aa2dd7e5b8afe6471 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:04.556723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2e568-6cef-4395-ab05-d0fecb51d0ce None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:04.557017 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2e568-6cef-4395-ab05-d0fecb51d0ce None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:04.557343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2e568-6cef-4395-ab05-d0fecb51d0ce None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:04.558776 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 186/364] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:04.564023 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2e568-6cef-4395-ab05-d0fecb51d0ce None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:04.609306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575f5e2-b7df-4231-8993-b17efc42286b None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:04.646898 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a55f30-6076-48ad-a94a-e30057dea58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:04.647988 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a55f30-6076-48ad-a94a-e30057dea58f None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:04.648504 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a55f30-6076-48ad-a94a-e30057dea58f None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:04.648979 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a55f30-6076-48ad-a94a-e30057dea58f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:04.697246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2e568-6cef-4395-ab05-d0fecb51d0ce None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:04.724690 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a55f30-6076-48ad-a94a-e30057dea58f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:04.726581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a55f30-6076-48ad-a94a-e30057dea58f None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:04.733887 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72922a06-d292-4717-8b21-2529217cedb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:04.734574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72922a06-d292-4717-8b21-2529217cedb5 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:04.734858 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72922a06-d292-4717-8b21-2529217cedb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:04.735167 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72922a06-d292-4717-8b21-2529217cedb5 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:04.735929 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72922a06-d292-4717-8b21-2529217cedb5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:04.736241 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72922a06-d292-4717-8b21-2529217cedb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:04.738006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72922a06-d292-4717-8b21-2529217cedb5 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:04.746729 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 187/365] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:04.748355 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429afef8-b3e5-42ca-94c2-c05256fef586 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:04.748579 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429afef8-b3e5-42ca-94c2-c05256fef586 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:04.748838 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429afef8-b3e5-42ca-94c2-c05256fef586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:04.767086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-429afef8-b3e5-42ca-94c2-c05256fef586 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:04.768817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-429afef8-b3e5-42ca-94c2-c05256fef586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:04.842829 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 179/367] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:04.843225 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 188/367] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:04.844105 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429afef8-b3e5-42ca-94c2-c05256fef586 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:04.849494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a55f30-6076-48ad-a94a-e30057dea58f None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:04.949178 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a55f30-6076-48ad-a94a-e30057dea58f None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:04.958551 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429afef8-b3e5-42ca-94c2-c05256fef586 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:04.984665 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7d6a8-d221-424a-af02-04844226a244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:04.985968 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7d6a8-d221-424a-af02-04844226a244 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:04.986440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7d6a8-d221-424a-af02-04844226a244 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:04.986895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7d6a8-d221-424a-af02-04844226a244 None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:04.988283 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7d6a8-d221-424a-af02-04844226a244 None admin] RBAC: Authorizing `identity:get_project(project_id=70d15e4994bb4da4af477c7904278502)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:04.990033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7d6a8-d221-424a-af02-04844226a244 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:04.992802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 180/368] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:33:04 2022] GET /identity/v3/projects/70d15e4994bb4da4af477c7904278502 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:04.993281 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e010a41-ed2e-4a41-91c6-26f35412a398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:04.994036 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7d6a8-d221-424a-af02-04844226a244 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:04.994141 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e010a41-ed2e-4a41-91c6-26f35412a398 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:04.994329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e010a41-ed2e-4a41-91c6-26f35412a398 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:04.994660 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e010a41-ed2e-4a41-91c6-26f35412a398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:05.068413 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e010a41-ed2e-4a41-91c6-26f35412a398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:05.069894 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e010a41-ed2e-4a41-91c6-26f35412a398 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:05.095282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7d6a8-d221-424a-af02-04844226a244 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:05.131561 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276af28-be96-4fc6-bac9-395484823249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:05.132721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276af28-be96-4fc6-bac9-395484823249 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:05.133196 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276af28-be96-4fc6-bac9-395484823249 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:05.133680 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276af28-be96-4fc6-bac9-395484823249 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:05.144375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276af28-be96-4fc6-bac9-395484823249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:05.152298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-f276af28-be96-4fc6-bac9-395484823249 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:33:05.152298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:05.152298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:05.152298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:05.152298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:05.152298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:05.152298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:05.152298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:05.152298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:05.152298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:05.152298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:05.152298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:05.152298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:05.152298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:05.152298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:05.152298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:05.153195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:05.153195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:05.153195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:05.153195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:05.153195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:05.153195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:05.153195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:05.153195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:05.153195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:05.153195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:05.153195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:05.153195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:05.153195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:05.153195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:05.153195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:05.153195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:05.154060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:05.154060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:05.154060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:05.154060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:05.154060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:05.154060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:05.154060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:05.154060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:05.154060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:05.154060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:05.154060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:33:05.154060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:05.156729 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 181/369] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:33:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:05.157757 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276af28-be96-4fc6-bac9-395484823249 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:05.171303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 189/370] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:05.172394 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e010a41-ed2e-4a41-91c6-26f35412a398 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:05.260163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276af28-be96-4fc6-bac9-395484823249 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:05.272107 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e010a41-ed2e-4a41-91c6-26f35412a398 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:05.295418 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100bdc0-8dd1-410c-8236-413109663493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:05.296611 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100bdc0-8dd1-410c-8236-413109663493 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:05.297102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100bdc0-8dd1-410c-8236-413109663493 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:05.297561 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100bdc0-8dd1-410c-8236-413109663493 None admin] PATH_INFO: `/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:05.298904 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100bdc0-8dd1-410c-8236-413109663493 None admin] RBAC: Authorizing `identity:get_group(group_id=75f5d66fcc014c5dafac6abfc79aab4f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:05.300581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100bdc0-8dd1-410c-8236-413109663493 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:05.302689 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 182/371] 10.222.0.11 () {56 vars in 1180 bytes} [Wed May 4 21:33:05 2022] GET /identity/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:05.303906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100bdc0-8dd1-410c-8236-413109663493 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:05.306487 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce947864-dd18-4c9f-ab02-d1617cb64c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:05.307482 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce947864-dd18-4c9f-ab02-d1617cb64c3a None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:05.307986 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce947864-dd18-4c9f-ab02-d1617cb64c3a None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:05.308442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce947864-dd18-4c9f-ab02-d1617cb64c3a None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:05.309597 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce947864-dd18-4c9f-ab02-d1617cb64c3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:05.309597 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce947864-dd18-4c9f-ab02-d1617cb64c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:05.310868 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce947864-dd18-4c9f-ab02-d1617cb64c3a None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:05.323152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 190/372] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:05.324109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce947864-dd18-4c9f-ab02-d1617cb64c3a None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:05.407840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100bdc0-8dd1-410c-8236-413109663493 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:05.423206 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce947864-dd18-4c9f-ab02-d1617cb64c3a None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:05.441409 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991a417-1af0-4837-b083-a8f58d285661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:05.442643 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991a417-1af0-4837-b083-a8f58d285661 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:05.443173 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991a417-1af0-4837-b083-a8f58d285661 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:05.443660 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991a417-1af0-4837-b083-a8f58d285661 None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:05.445082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991a417-1af0-4837-b083-a8f58d285661 None admin] RBAC: Authorizing `identity:get_project(project_id=70d15e4994bb4da4af477c7904278502)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:05.446713 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991a417-1af0-4837-b083-a8f58d285661 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:05.449169 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 183/373] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:33:05 2022] GET /identity/v3/projects/70d15e4994bb4da4af477c7904278502 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:05.450162 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991a417-1af0-4837-b083-a8f58d285661 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:05.456945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d0f46-d7ab-4670-b025-1263528a43fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:05.457615 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d0f46-d7ab-4670-b025-1263528a43fd None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:05.457900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d0f46-d7ab-4670-b025-1263528a43fd None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:05.458177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d0f46-d7ab-4670-b025-1263528a43fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:05.459017 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d0f46-d7ab-4670-b025-1263528a43fd None admin] RBAC: Adding query filter params (group.id=75f5d66fcc014c5dafac6abfc79aab4f, role.id=b03b07e63e164e6a8858592b025c8103, scope.project.id=70d15e4994bb4da4af477c7904278502) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:05.459375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d0f46-d7ab-4670-b025-1263528a43fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:05.460815 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d0f46-d7ab-4670-b025-1263528a43fd None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:05.466653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 191/374] 10.222.0.11 () {56 vars in 1376 bytes} [Wed May 4 21:33:05 2022] GET /identity/v3/role_assignments?group.id=75f5d66fcc014c5dafac6abfc79aab4f&scope.project.id=70d15e4994bb4da4af477c7904278502&role.id=b03b07e63e164e6a8858592b025c8103 => generated 260 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:05.468271 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d0f46-d7ab-4670-b025-1263528a43fd None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:05.556696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991a417-1af0-4837-b083-a8f58d285661 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:05.573308 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d0f46-d7ab-4670-b025-1263528a43fd None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:05.606633 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eecc12-c4da-432a-86f4-64d407bfee6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:05.607831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eecc12-c4da-432a-86f4-64d407bfee6b None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:05.608392 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eecc12-c4da-432a-86f4-64d407bfee6b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:05.609034 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eecc12-c4da-432a-86f4-64d407bfee6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:05.610051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d3cca-3c49-4c76-90ca-0a68daca2386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:05.610919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d3cca-3c49-4c76-90ca-0a68daca2386 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:05.611253 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d3cca-3c49-4c76-90ca-0a68daca2386 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:05.611530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d3cca-3c49-4c76-90ca-0a68daca2386 None admin] PATH_INFO: `/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:05.612815 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d3cca-3c49-4c76-90ca-0a68daca2386 None admin] RBAC: Authorizing `identity:get_group(group_id=75f5d66fcc014c5dafac6abfc79aab4f)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:05.614457 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d3cca-3c49-4c76-90ca-0a68daca2386 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:05.616843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 192/375] 10.222.0.11 () {56 vars in 1180 bytes} [Wed May 4 21:33:05 2022] GET /identity/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:05.623847 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d3cca-3c49-4c76-90ca-0a68daca2386 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:05.684783 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eecc12-c4da-432a-86f4-64d407bfee6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:05.686671 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eecc12-c4da-432a-86f4-64d407bfee6b None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:05.729827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d3cca-3c49-4c76-90ca-0a68daca2386 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:05.764689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bd9b2-c8a6-4e52-8e7e-8609b1dbdbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:05.765178 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bd9b2-c8a6-4e52-8e7e-8609b1dbdbff None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:05.765465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bd9b2-c8a6-4e52-8e7e-8609b1dbdbff None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:05.765743 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bd9b2-c8a6-4e52-8e7e-8609b1dbdbff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:05.766603 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4bd9b2-c8a6-4e52-8e7e-8609b1dbdbff None admin] RBAC: Adding query filter params (group.id=75f5d66fcc014c5dafac6abfc79aab4f, role.id=c3d122a6c9c6478aa2dd7e5b8afe6471, scope.project.id=70d15e4994bb4da4af477c7904278502) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:05.766919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4bd9b2-c8a6-4e52-8e7e-8609b1dbdbff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:05.768495 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4bd9b2-c8a6-4e52-8e7e-8609b1dbdbff None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:05.779480 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 193/376] 10.222.0.11 () {56 vars in 1376 bytes} [Wed May 4 21:33:05 2022] GET /identity/v3/role_assignments?group.id=75f5d66fcc014c5dafac6abfc79aab4f&scope.project.id=70d15e4994bb4da4af477c7904278502&role.id=c3d122a6c9c6478aa2dd7e5b8afe6471 => generated 260 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:05.794396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 184/377] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:05.799926 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bd9b2-c8a6-4e52-8e7e-8609b1dbdbff None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:05.921373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bd9b2-c8a6-4e52-8e7e-8609b1dbdbff None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:05.957961 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abad21-2733-4a24-af1a-000edd0815dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:05.958858 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abad21-2733-4a24-af1a-000edd0815dd None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:05.959429 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abad21-2733-4a24-af1a-000edd0815dd None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:05.959429 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abad21-2733-4a24-af1a-000edd0815dd None admin] PATH_INFO: `/v3/projects/cf7f12f74dbe44d39ddca7448ef132f4` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:05.960665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abad21-2733-4a24-af1a-000edd0815dd None admin] RBAC: Authorizing `identity:get_project(project_id=cf7f12f74dbe44d39ddca7448ef132f4)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:05.962138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abad21-2733-4a24-af1a-000edd0815dd None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:05.968603 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 194/378] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:33:05 2022] GET /identity/v3/projects/cf7f12f74dbe44d39ddca7448ef132f4 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:05.970035 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eecc12-c4da-432a-86f4-64d407bfee6b None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:06.110296 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eecc12-c4da-432a-86f4-64d407bfee6b None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:06.144994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f7248-8574-4d99-93bb-9fd49c5fa74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:06.146240 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f7248-8574-4d99-93bb-9fd49c5fa74e None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:06.146732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f7248-8574-4d99-93bb-9fd49c5fa74e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:06.147223 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f7248-8574-4d99-93bb-9fd49c5fa74e None admin] PATH_INFO: `/v3/groups/f8c81ba1c4544699bb2a98371715d1b0` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:06.152546 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f7248-8574-4d99-93bb-9fd49c5fa74e None admin] RBAC: Authorizing `identity:get_group(group_id=f8c81ba1c4544699bb2a98371715d1b0)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:06.154229 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f7248-8574-4d99-93bb-9fd49c5fa74e None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:06.156426 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 185/379] 10.222.0.11 () {56 vars in 1180 bytes} [Wed May 4 21:33:05 2022] GET /identity/v3/groups/f8c81ba1c4544699bb2a98371715d1b0 => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:06.161984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abad21-2733-4a24-af1a-000edd0815dd None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:06.265420 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abad21-2733-4a24-af1a-000edd0815dd None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:06.302132 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5a674-77ed-4ab2-b134-fb907f86ea2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:06.303215 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5a674-77ed-4ab2-b134-fb907f86ea2c None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:06.303728 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5a674-77ed-4ab2-b134-fb907f86ea2c None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:06.304251 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5a674-77ed-4ab2-b134-fb907f86ea2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:06.305272 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5a674-77ed-4ab2-b134-fb907f86ea2c None admin] RBAC: Adding query filter params (group.id=f8c81ba1c4544699bb2a98371715d1b0, role.id=59778f07f0504e90a60212f460e8c774, scope.project.id=cf7f12f74dbe44d39ddca7448ef132f4) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:06.305772 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5a674-77ed-4ab2-b134-fb907f86ea2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:06.307464 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5a674-77ed-4ab2-b134-fb907f86ea2c None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:06.313569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 195/380] 10.222.0.11 () {56 vars in 1376 bytes} [Wed May 4 21:33:06 2022] GET /identity/v3/role_assignments?group.id=f8c81ba1c4544699bb2a98371715d1b0&scope.project.id=cf7f12f74dbe44d39ddca7448ef132f4&role.id=59778f07f0504e90a60212f460e8c774 => generated 260 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:06.653124 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7a4ad-fbf6-4cf8-b119-c794bf503b50 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:06.653767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7a4ad-fbf6-4cf8-b119-c794bf503b50 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:06.654235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7a4ad-fbf6-4cf8-b119-c794bf503b50 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:06.655819 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 186/381] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:06.661474 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f8b76-dc68-4222-a0c8-71a88a574325 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:06.662004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f8b76-dc68-4222-a0c8-71a88a574325 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:06.662471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f8b76-dc68-4222-a0c8-71a88a574325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:06.682986 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-b47f8b76-dc68-4222-a0c8-71a88a574325 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:06.684543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-b47f8b76-dc68-4222-a0c8-71a88a574325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:06.766933 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 196/382] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:06.801037 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7a4ad-fbf6-4cf8-b119-c794bf503b50 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:06.916333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7a4ad-fbf6-4cf8-b119-c794bf503b50 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:06.950968 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb9cdc-dd33-4166-9975-df9fd0fdc633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:06.952134 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb9cdc-dd33-4166-9975-df9fd0fdc633 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:06.952630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb9cdc-dd33-4166-9975-df9fd0fdc633 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:06.953089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb9cdc-dd33-4166-9975-df9fd0fdc633 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:06.965271 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb9cdc-dd33-4166-9975-df9fd0fdc633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:06.973177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-07cb9cdc-dd33-4166-9975-df9fd0fdc633 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:33:06.973177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:06.973177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:06.973177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:06.973177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:06.973177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:06.973177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:06.973177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:06.973177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:06.973177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:06.973177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:06.973177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:06.973177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:06.973177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:06.973177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:06.973177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:06.974396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:06.974396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:06.974396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:06.974396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:06.974396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:06.974396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:06.974396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:06.974396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:06.974396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:06.974396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:06.974396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:06.974396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:06.974396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:06.974396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:06.974396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:06.974396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:06.975232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:06.975232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:06.975232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:06.975232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:06.975232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:06.975232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:06.975232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:06.975232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:06.975232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:06.975232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:06.975232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:33:06.975232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:06.978052 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 187/383] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:06.983811 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f8b76-dc68-4222-a0c8-71a88a574325 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:07.091893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f8b76-dc68-4222-a0c8-71a88a574325 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:07.129085 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607dc5e-2094-4cc6-a3ae-d83fd581d5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:07.130098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607dc5e-2094-4cc6-a3ae-d83fd581d5c6 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:07.130608 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607dc5e-2094-4cc6-a3ae-d83fd581d5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:07.131232 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607dc5e-2094-4cc6-a3ae-d83fd581d5c6 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:07.132188 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607dc5e-2094-4cc6-a3ae-d83fd581d5c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:07.132722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607dc5e-2094-4cc6-a3ae-d83fd581d5c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:07.134282 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607dc5e-2094-4cc6-a3ae-d83fd581d5c6 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:07.146156 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 197/384] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:33:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:07.152177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb9cdc-dd33-4166-9975-df9fd0fdc633 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:07.287029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb9cdc-dd33-4166-9975-df9fd0fdc633 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:07.326285 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbacef1-1e49-4d03-9cf9-39208691beee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:07.327183 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbacef1-1e49-4d03-9cf9-39208691beee None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:07.327466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbacef1-1e49-4d03-9cf9-39208691beee None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:07.327741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbacef1-1e49-4d03-9cf9-39208691beee None admin] PATH_INFO: `/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:07.331766 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbacef1-1e49-4d03-9cf9-39208691beee None admin] RBAC: Authorizing `identity:get_group(group_id=75f5d66fcc014c5dafac6abfc79aab4f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:07.333248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbacef1-1e49-4d03-9cf9-39208691beee None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:07.335280 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 188/385] 10.222.0.11 () {56 vars in 1180 bytes} [Wed May 4 21:33:07 2022] GET /identity/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:07.341491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607dc5e-2094-4cc6-a3ae-d83fd581d5c6 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:07.485168 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607dc5e-2094-4cc6-a3ae-d83fd581d5c6 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:07.529473 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10a7e0-e465-4237-a12e-0eef000f8fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:07.530710 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10a7e0-e465-4237-a12e-0eef000f8fc9 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:07.531213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10a7e0-e465-4237-a12e-0eef000f8fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:07.531701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10a7e0-e465-4237-a12e-0eef000f8fc9 None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:07.533086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10a7e0-e465-4237-a12e-0eef000f8fc9 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a06ae2ea914e91922edccf3b59d6dc)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:07.534785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10a7e0-e465-4237-a12e-0eef000f8fc9 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:07.537205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 198/386] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:33:07 2022] GET /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:07.542919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbacef1-1e49-4d03-9cf9-39208691beee None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:07.662209 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbacef1-1e49-4d03-9cf9-39208691beee None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:07.698534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba060c-26f7-49cf-be53-7b11938a2734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:07.699819 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba060c-26f7-49cf-be53-7b11938a2734 None admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:07.700310 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba060c-26f7-49cf-be53-7b11938a2734 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:07.700803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba060c-26f7-49cf-be53-7b11938a2734 None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc/groups/75f5d66fcc014c5dafac6abfc79aab4f/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:07.702931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba060c-26f7-49cf-be53-7b11938a2734 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8a06ae2ea914e91922edccf3b59d6dc, group_id=75f5d66fcc014c5dafac6abfc79aab4f, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:07.704626 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba060c-26f7-49cf-be53-7b11938a2734 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:07.723626 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 189/387] 10.222.0.11 () {58 vars in 1442 bytes} [Wed May 4 21:33:07 2022] PUT /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc/groups/75f5d66fcc014c5dafac6abfc79aab4f/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:33:07.859720 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb029e-f11b-4a63-aa12-0a3f288addfc None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:07.860018 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb029e-f11b-4a63-aa12-0a3f288addfc None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:07.860178 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb029e-f11b-4a63-aa12-0a3f288addfc None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:07.861805 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 199/388] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:07.867519 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5cd11-d024-4ed4-bc09-fd15ae493b70 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:07.868181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5cd11-d024-4ed4-bc09-fd15ae493b70 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:07.868678 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5cd11-d024-4ed4-bc09-fd15ae493b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:07.892261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-20f5cd11-d024-4ed4-bc09-fd15ae493b70 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:07.893885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-20f5cd11-d024-4ed4-bc09-fd15ae493b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:07.972979 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 190/389] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:08.000193 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb029e-f11b-4a63-aa12-0a3f288addfc None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:08.124856 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb029e-f11b-4a63-aa12-0a3f288addfc None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:08.169766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a083b6-a4ee-4bd4-8404-81036a8c2325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:08.170600 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a083b6-a4ee-4bd4-8404-81036a8c2325 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:08.170882 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a083b6-a4ee-4bd4-8404-81036a8c2325 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:08.171185 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a083b6-a4ee-4bd4-8404-81036a8c2325 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:08.184981 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a083b6-a4ee-4bd4-8404-81036a8c2325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:08.193364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-24a083b6-a4ee-4bd4-8404-81036a8c2325 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:33:08.193364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:08.193364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:08.193364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:08.193364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:08.193364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:08.193364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:08.193364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:08.193364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:08.193364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:08.193364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:08.193364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:08.193364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:08.193364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:08.193364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:08.193364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:08.194338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:08.194338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:08.194338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:08.194338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:08.194338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:08.194338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:08.194338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:08.194338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:08.194338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:08.194338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:08.194338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:08.194338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:08.194338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:08.194338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:08.194338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:08.194338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:08.195140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:08.195140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:08.195140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:08.195140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:08.195140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:08.195140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:08.195140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:08.195140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:08.195140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:08.195140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:08.195140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:33:08.195140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:08.195140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 200/390] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:33:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:08.200848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5cd11-d024-4ed4-bc09-fd15ae493b70 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:08.337084 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5cd11-d024-4ed4-bc09-fd15ae493b70 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:08.376356 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad30a8b-09d7-43b8-954c-5f6865d04db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:08.377367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad30a8b-09d7-43b8-954c-5f6865d04db2 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:08.377838 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad30a8b-09d7-43b8-954c-5f6865d04db2 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:08.378334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad30a8b-09d7-43b8-954c-5f6865d04db2 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:08.379293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad30a8b-09d7-43b8-954c-5f6865d04db2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:08.379790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad30a8b-09d7-43b8-954c-5f6865d04db2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:08.381347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad30a8b-09d7-43b8-954c-5f6865d04db2 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:08.391801 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 191/391] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:08.397448 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a083b6-a4ee-4bd4-8404-81036a8c2325 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:08.535866 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a083b6-a4ee-4bd4-8404-81036a8c2325 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:08.584155 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f1bd6-f8f5-49ae-8249-aeb74d2a0dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:08.584997 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f1bd6-f8f5-49ae-8249-aeb74d2a0dcf None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:08.585266 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f1bd6-f8f5-49ae-8249-aeb74d2a0dcf None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:08.585544 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f1bd6-f8f5-49ae-8249-aeb74d2a0dcf None admin] PATH_INFO: `/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:08.588838 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f1bd6-f8f5-49ae-8249-aeb74d2a0dcf None admin] RBAC: Authorizing `identity:get_group(group_id=75f5d66fcc014c5dafac6abfc79aab4f)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:08.590452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f1bd6-f8f5-49ae-8249-aeb74d2a0dcf None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:08.592433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 201/392] 10.222.0.11 () {56 vars in 1180 bytes} [Wed May 4 21:33:08 2022] GET /identity/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:08.597725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad30a8b-09d7-43b8-954c-5f6865d04db2 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:08.672381 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1025f-3989-433c-926f-6e11d82d8480 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:08.672672 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1025f-3989-433c-926f-6e11d82d8480 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:08.672956 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1025f-3989-433c-926f-6e11d82d8480 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:08.674545 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 202/393] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:08.680530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c19dd-f5da-4763-b9d5-4d0290d127e9 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:08.680821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c19dd-f5da-4763-b9d5-4d0290d127e9 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:08.681104 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c19dd-f5da-4763-b9d5-4d0290d127e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:08.707744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-7c8c19dd-f5da-4763-b9d5-4d0290d127e9 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:08.708931 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-7c8c19dd-f5da-4763-b9d5-4d0290d127e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:08.737165 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad30a8b-09d7-43b8-954c-5f6865d04db2 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:08.783607 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 203/394] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:08.797969 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae526e-e821-4867-8628-3288357bbe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:08.798811 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae526e-e821-4867-8628-3288357bbe2c None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:08.799129 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae526e-e821-4867-8628-3288357bbe2c None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:08.799407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae526e-e821-4867-8628-3288357bbe2c None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:08.800581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae526e-e821-4867-8628-3288357bbe2c None admin] RBAC: Authorizing `identity:get_project(project_id=b8a06ae2ea914e91922edccf3b59d6dc)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:08.802028 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae526e-e821-4867-8628-3288357bbe2c None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:08.804061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 192/395] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:33:08 2022] GET /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:08.810031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c19dd-f5da-4763-b9d5-4d0290d127e9 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:08.819750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae526e-e821-4867-8628-3288357bbe2c None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:08.941422 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c19dd-f5da-4763-b9d5-4d0290d127e9 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:08.949688 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae526e-e821-4867-8628-3288357bbe2c None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:08.976670 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ef84b-c6e6-483e-bba7-eac2b327ece8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:08.977874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ef84b-c6e6-483e-bba7-eac2b327ece8 None admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:08.978349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ef84b-c6e6-483e-bba7-eac2b327ece8 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:08.978784 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ef84b-c6e6-483e-bba7-eac2b327ece8 None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc/groups/75f5d66fcc014c5dafac6abfc79aab4f/roles/c3d122a6c9c6478aa2dd7e5b8afe6471` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:08.981665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ef84b-c6e6-483e-bba7-eac2b327ece8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8a06ae2ea914e91922edccf3b59d6dc, group_id=75f5d66fcc014c5dafac6abfc79aab4f, role_id=c3d122a6c9c6478aa2dd7e5b8afe6471)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:08.983126 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f9f0a-923a-48fc-8c32-fa29d4048efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:08.983605 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ef84b-c6e6-483e-bba7-eac2b327ece8 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:08.983943 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f9f0a-923a-48fc-8c32-fa29d4048efc None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:08.984231 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f9f0a-923a-48fc-8c32-fa29d4048efc None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:08.984512 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f9f0a-923a-48fc-8c32-fa29d4048efc None admin] PATH_INFO: `/v3/roles/member` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:09.000900 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f9f0a-923a-48fc-8c32-fa29d4048efc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:09.002500 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 204/396] 10.222.0.11 () {58 vars in 1442 bytes} [Wed May 4 21:33:08 2022] PUT /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc/groups/75f5d66fcc014c5dafac6abfc79aab4f/roles/c3d122a6c9c6478aa2dd7e5b8afe6471 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:33:09.011068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1275f-b5e1-4cd2-b6b8-52be9cb345ab None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:09.011267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-117f9f0a-923a-48fc-8c32-fa29d4048efc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:33:09.011267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:09.011267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:09.011267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:09.011267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:09.011267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:09.011267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:09.011267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:09.011267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:09.011267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:09.011267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:09.011267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:09.011267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:09.011267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:09.011267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:09.011267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:09.012090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:09.012090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:09.012090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:09.012090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:09.012090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:09.012090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:09.012090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:09.012090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:09.012090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:09.012090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:09.012090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:09.012090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:09.012090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:09.012090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:09.012090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:09.012090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:09.012890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:09.012890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:09.012890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:09.012890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:09.012890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:09.012890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:09.012890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:09.012890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:09.012890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:09.012890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:09.012890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:33:09.012890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:09.012890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 193/397] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:33:09.014509 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1275f-b5e1-4cd2-b6b8-52be9cb345ab None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:09.014934 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1275f-b5e1-4cd2-b6b8-52be9cb345ab None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:09.016783 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 205/398] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:09 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:09.017075 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f9f0a-923a-48fc-8c32-fa29d4048efc None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:09.028392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33cc52-6f1b-4455-9e23-95668dcec205 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:09.028781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33cc52-6f1b-4455-9e23-95668dcec205 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:09.029124 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33cc52-6f1b-4455-9e23-95668dcec205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:09.057706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-dc33cc52-6f1b-4455-9e23-95668dcec205 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:09.059528 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-dc33cc52-6f1b-4455-9e23-95668dcec205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:09.145972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 206/399] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:33:09.192720 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33cc52-6f1b-4455-9e23-95668dcec205 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:09.233686 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f9f0a-923a-48fc-8c32-fa29d4048efc None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:09.274188 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5a0bf-bc02-4d84-a077-462679cf01bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:09.276361 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5a0bf-bc02-4d84-a077-462679cf01bb None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:09.276797 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5a0bf-bc02-4d84-a077-462679cf01bb None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:09.277212 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5a0bf-bc02-4d84-a077-462679cf01bb None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:09.278181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5a0bf-bc02-4d84-a077-462679cf01bb None admin] RBAC: Adding query filter params (name=member) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:09.278686 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5a0bf-bc02-4d84-a077-462679cf01bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:09.280299 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5a0bf-bc02-4d84-a077-462679cf01bb None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:09.293348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 194/400] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:33:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:09.295240 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14569891-f2e4-49e0-9ed8-22fb104b8eb0 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:09.295685 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14569891-f2e4-49e0-9ed8-22fb104b8eb0 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:09.296107 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14569891-f2e4-49e0-9ed8-22fb104b8eb0 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:09.298363 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 195/401] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:09.299369 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14569891-f2e4-49e0-9ed8-22fb104b8eb0 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:09.318133 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33cc52-6f1b-4455-9e23-95668dcec205 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:09.357018 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb949e0-bacf-41ba-9050-12604bb690f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:09.357834 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb949e0-bacf-41ba-9050-12604bb690f2 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:09.358116 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb949e0-bacf-41ba-9050-12604bb690f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:09.358388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb949e0-bacf-41ba-9050-12604bb690f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:09.371138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb949e0-bacf-41ba-9050-12604bb690f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:09.379639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-2bb949e0-bacf-41ba-9050-12604bb690f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:33:09.379639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:09.379639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:09.379639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:09.379639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:09.379639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:09.379639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:09.379639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:09.379639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:09.379639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:09.379639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:09.379639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:09.379639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:09.379639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:09.379639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:09.379639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:09.380558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:09.380558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:09.380558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:09.380558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:09.380558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:09.380558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:09.380558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:09.380558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:09.380558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:09.380558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:09.380558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:09.380558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:09.380558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:09.380558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:09.380558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:09.380558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:09.381345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:09.381345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:09.381345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:09.381345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:09.381345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:09.381345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:09.381345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:09.381345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:09.381345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:09.381345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:09.381345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:33:09.381345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:09.389232 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 207/402] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:33:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:33:09.390770 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c506a-e2ce-4b2e-856d-422649bfd6c7 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:09.391185 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c506a-e2ce-4b2e-856d-422649bfd6c7 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:09.391564 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c506a-e2ce-4b2e-856d-422649bfd6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:09.411452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-c55c506a-e2ce-4b2e-856d-422649bfd6c7 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:09.412781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c55c506a-e2ce-4b2e-856d-422649bfd6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:09.419651 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14569891-f2e4-49e0-9ed8-22fb104b8eb0 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:09.464118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c6d44-e301-4df7-a9a7-093e50b3c074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:09.465404 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c6d44-e301-4df7-a9a7-093e50b3c074 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:09.465824 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c6d44-e301-4df7-a9a7-093e50b3c074 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:09.466441 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c6d44-e301-4df7-a9a7-093e50b3c074 None admin] PATH_INFO: `/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:09.468904 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c6d44-e301-4df7-a9a7-093e50b3c074 None admin] RBAC: Authorizing `identity:get_group(group_id=75f5d66fcc014c5dafac6abfc79aab4f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:09.470998 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c6d44-e301-4df7-a9a7-093e50b3c074 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:09.473326 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 196/403] 10.222.0.11 () {56 vars in 1180 bytes} [Wed May 4 21:33:09 2022] GET /identity/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:09.475122 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c6d44-e301-4df7-a9a7-093e50b3c074 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:09.488443 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 208/404] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:09.491301 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c506a-e2ce-4b2e-856d-422649bfd6c7 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:09.618620 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c6d44-e301-4df7-a9a7-093e50b3c074 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:09.640463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c506a-e2ce-4b2e-856d-422649bfd6c7 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:09.653806 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475a8d4-6a54-469d-a0da-f9ae807ba324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:09.654680 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475a8d4-6a54-469d-a0da-f9ae807ba324 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:09.655120 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475a8d4-6a54-469d-a0da-f9ae807ba324 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:09.655532 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475a8d4-6a54-469d-a0da-f9ae807ba324 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:09.656422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475a8d4-6a54-469d-a0da-f9ae807ba324 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:09.656883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475a8d4-6a54-469d-a0da-f9ae807ba324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:09.658376 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475a8d4-6a54-469d-a0da-f9ae807ba324 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:09.667819 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 197/405] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:09.668834 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475a8d4-6a54-469d-a0da-f9ae807ba324 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:09.685087 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c35a03-f67b-4818-b037-3ec3972367f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:09.685976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c35a03-f67b-4818-b037-3ec3972367f4 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:09.686432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c35a03-f67b-4818-b037-3ec3972367f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:09.686742 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c35a03-f67b-4818-b037-3ec3972367f4 None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:09.688147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c35a03-f67b-4818-b037-3ec3972367f4 None admin] RBAC: Authorizing `identity:get_project(project_id=70d15e4994bb4da4af477c7904278502)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:09.689689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c35a03-f67b-4818-b037-3ec3972367f4 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:09.691959 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 209/406] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:33:09 2022] GET /identity/v3/projects/70d15e4994bb4da4af477c7904278502 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:09.692925 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c35a03-f67b-4818-b037-3ec3972367f4 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:09.772402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475a8d4-6a54-469d-a0da-f9ae807ba324 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:09.797994 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c35a03-f67b-4818-b037-3ec3972367f4 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:09.805368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad3988-d149-404b-8c82-e355343eafc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:09.806376 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad3988-d149-404b-8c82-e355343eafc7 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:09.806807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad3988-d149-404b-8c82-e355343eafc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:09.807305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad3988-d149-404b-8c82-e355343eafc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:09.817795 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad3988-d149-404b-8c82-e355343eafc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:09.825490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-bbad3988-d149-404b-8c82-e355343eafc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:33:09.825490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:09.825490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:09.825490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:09.825490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:09.825490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:09.825490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:09.825490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:09.825490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:09.825490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:09.825490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:09.825490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:09.825490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:09.825490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:09.825490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:09.825490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:09.826569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:09.826569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:09.826569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:09.826569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:09.826569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:09.826569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:09.826569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:09.826569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:09.826569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:09.826569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:09.826569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:09.826569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:09.826569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:09.826569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:09.826569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:09.826569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:09.827587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:09.827587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:09.827587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:09.827587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:09.827587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:09.827587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:09.827587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:09.827587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:09.827587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:09.827587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:09.827587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:33:09.827587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:09.829660 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 198/407] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:33:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:09.835451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad3988-d149-404b-8c82-e355343eafc7 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:09.837320 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3126651-a34a-45ff-9e88-8acaa6c38477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:09.838303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3126651-a34a-45ff-9e88-8acaa6c38477 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:09.838618 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3126651-a34a-45ff-9e88-8acaa6c38477 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:09.838885 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3126651-a34a-45ff-9e88-8acaa6c38477 None admin] PATH_INFO: `/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:09.840589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3126651-a34a-45ff-9e88-8acaa6c38477 None admin] RBAC: Authorizing `identity:get_group(group_id=75f5d66fcc014c5dafac6abfc79aab4f)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:09.841600 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3126651-a34a-45ff-9e88-8acaa6c38477 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:09.843591 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 210/408] 10.222.0.11 () {56 vars in 1180 bytes} [Wed May 4 21:33:09 2022] GET /identity/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:09.844359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3126651-a34a-45ff-9e88-8acaa6c38477 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:09.939832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad3988-d149-404b-8c82-e355343eafc7 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:09.945563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3126651-a34a-45ff-9e88-8acaa6c38477 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:09.973499 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ff82a-9a03-4c98-b645-a7e65ad52a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:09.975021 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff82a-9a03-4c98-b645-a7e65ad52a74 None admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:09.975497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff82a-9a03-4c98-b645-a7e65ad52a74 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:09.975935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff82a-9a03-4c98-b645-a7e65ad52a74 None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502/groups/75f5d66fcc014c5dafac6abfc79aab4f/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:09.978367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ff82a-9a03-4c98-b645-a7e65ad52a74 None admin] RBAC: Authorizing `identity:create_grant(project_id=70d15e4994bb4da4af477c7904278502, group_id=75f5d66fcc014c5dafac6abfc79aab4f, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:09.979644 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efb9d9-1fd0-41c7-9c56-6f27151dbd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:09.980377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efb9d9-1fd0-41c7-9c56-6f27151dbd23 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:09.980572 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ff82a-9a03-4c98-b645-a7e65ad52a74 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:09.980669 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efb9d9-1fd0-41c7-9c56-6f27151dbd23 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:09.980971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efb9d9-1fd0-41c7-9c56-6f27151dbd23 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:09.981777 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79efb9d9-1fd0-41c7-9c56-6f27151dbd23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:09.982087 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79efb9d9-1fd0-41c7-9c56-6f27151dbd23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:09.983474 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79efb9d9-1fd0-41c7-9c56-6f27151dbd23 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:09.998789 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 211/409] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:09.998789 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efb9d9-1fd0-41c7-9c56-6f27151dbd23 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:10.007305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 199/410] 10.222.0.11 () {58 vars in 1442 bytes} [Wed May 4 21:33:09 2022] PUT /identity/v3/projects/70d15e4994bb4da4af477c7904278502/groups/75f5d66fcc014c5dafac6abfc79aab4f/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:33:10.008490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ff82a-9a03-4c98-b645-a7e65ad52a74 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:10.151973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ff82a-9a03-4c98-b645-a7e65ad52a74 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:10.161290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efb9d9-1fd0-41c7-9c56-6f27151dbd23 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:10.188205 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb27d0f-e624-4a6f-a907-666cdccd3bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:10.189522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb27d0f-e624-4a6f-a907-666cdccd3bac None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:10.190024 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb27d0f-e624-4a6f-a907-666cdccd3bac None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:10.190495 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb27d0f-e624-4a6f-a907-666cdccd3bac None admin] PATH_INFO: `/v3/groups/f8c81ba1c4544699bb2a98371715d1b0` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:10.192017 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb27d0f-e624-4a6f-a907-666cdccd3bac None admin] RBAC: Authorizing `identity:get_group(group_id=f8c81ba1c4544699bb2a98371715d1b0)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:10.193713 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb27d0f-e624-4a6f-a907-666cdccd3bac None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:10.196046 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 200/411] 10.222.0.11 () {56 vars in 1180 bytes} [Wed May 4 21:33:10 2022] GET /identity/v3/groups/f8c81ba1c4544699bb2a98371715d1b0 => generated 229 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:10.200731 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6be90f-0337-449f-aab8-de3eb6cdaecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:10.201620 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6be90f-0337-449f-aab8-de3eb6cdaecd None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:10.201904 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6be90f-0337-449f-aab8-de3eb6cdaecd None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:10.202179 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6be90f-0337-449f-aab8-de3eb6cdaecd None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:10.203800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6be90f-0337-449f-aab8-de3eb6cdaecd None admin] RBAC: Authorizing `identity:get_project(project_id=70d15e4994bb4da4af477c7904278502)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:10.204543 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb27d0f-e624-4a6f-a907-666cdccd3bac None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:10.205270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6be90f-0337-449f-aab8-de3eb6cdaecd None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:10.207181 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 212/412] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:33:09 2022] GET /identity/v3/projects/70d15e4994bb4da4af477c7904278502 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:10.216120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6be90f-0337-449f-aab8-de3eb6cdaecd None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:10.308222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb27d0f-e624-4a6f-a907-666cdccd3bac None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:10.343857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cdd8e-64ef-4d87-b312-55bfe0041719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:10.344741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cdd8e-64ef-4d87-b312-55bfe0041719 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:10.345028 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cdd8e-64ef-4d87-b312-55bfe0041719 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:10.345310 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cdd8e-64ef-4d87-b312-55bfe0041719 None admin] PATH_INFO: `/v3/projects/cf7f12f74dbe44d39ddca7448ef132f4` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:10.346525 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cdd8e-64ef-4d87-b312-55bfe0041719 None admin] RBAC: Authorizing `identity:get_project(project_id=cf7f12f74dbe44d39ddca7448ef132f4)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:10.348467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cdd8e-64ef-4d87-b312-55bfe0041719 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:10.350855 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 201/413] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:33:10 2022] GET /identity/v3/projects/cf7f12f74dbe44d39ddca7448ef132f4 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:10.356671 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cdd8e-64ef-4d87-b312-55bfe0041719 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:10.386736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6be90f-0337-449f-aab8-de3eb6cdaecd None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:10.455212 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cdd8e-64ef-4d87-b312-55bfe0041719 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:10.466581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f30b74-50dd-4b69-ab8f-8c742fb61ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:10.467507 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f30b74-50dd-4b69-ab8f-8c742fb61ce8 None admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:10.467792 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f30b74-50dd-4b69-ab8f-8c742fb61ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:10.468077 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f30b74-50dd-4b69-ab8f-8c742fb61ce8 None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502/groups/75f5d66fcc014c5dafac6abfc79aab4f/roles/c3d122a6c9c6478aa2dd7e5b8afe6471` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:10.470281 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f30b74-50dd-4b69-ab8f-8c742fb61ce8 None admin] RBAC: Authorizing `identity:create_grant(project_id=70d15e4994bb4da4af477c7904278502, group_id=75f5d66fcc014c5dafac6abfc79aab4f, role_id=c3d122a6c9c6478aa2dd7e5b8afe6471)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:10.471778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f30b74-50dd-4b69-ab8f-8c742fb61ce8 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:10.490055 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e3ef0-ecf1-450e-9ff7-2267682f564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:10.490972 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e3ef0-ecf1-450e-9ff7-2267682f564b None admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:10.491291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e3ef0-ecf1-450e-9ff7-2267682f564b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:10.491564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e3ef0-ecf1-450e-9ff7-2267682f564b None admin] PATH_INFO: `/v3/projects/cf7f12f74dbe44d39ddca7448ef132f4/groups/f8c81ba1c4544699bb2a98371715d1b0/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:10.493728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e3ef0-ecf1-450e-9ff7-2267682f564b None admin] RBAC: Authorizing `identity:create_grant(project_id=cf7f12f74dbe44d39ddca7448ef132f4, group_id=f8c81ba1c4544699bb2a98371715d1b0, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:10.495626 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e3ef0-ecf1-450e-9ff7-2267682f564b None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:10.506113 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 213/414] 10.222.0.11 () {58 vars in 1442 bytes} [Wed May 4 21:33:10 2022] PUT /identity/v3/projects/70d15e4994bb4da4af477c7904278502/groups/75f5d66fcc014c5dafac6abfc79aab4f/roles/c3d122a6c9c6478aa2dd7e5b8afe6471 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:33:10.515659 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 202/415] 10.222.0.11 () {58 vars in 1442 bytes} [Wed May 4 21:33:10 2022] PUT /identity/v3/projects/cf7f12f74dbe44d39ddca7448ef132f4/groups/f8c81ba1c4544699bb2a98371715d1b0/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:33:10.699016 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9df7b4-d50d-495e-968f-605cb879dfc6 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:10.699378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9df7b4-d50d-495e-968f-605cb879dfc6 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:10.699614 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9df7b4-d50d-495e-968f-605cb879dfc6 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:10.701271 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 214/416] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:10.714709 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f47582-dd24-4bfe-aa60-b3bebd978721 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:10.715034 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f47582-dd24-4bfe-aa60-b3bebd978721 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:10.715300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f47582-dd24-4bfe-aa60-b3bebd978721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:10.736768 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-e8f47582-dd24-4bfe-aa60-b3bebd978721 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:10.737998 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e8f47582-dd24-4bfe-aa60-b3bebd978721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:10.810477 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 203/417] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:10.834021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9df7b4-d50d-495e-968f-605cb879dfc6 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:10.936710 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9df7b4-d50d-495e-968f-605cb879dfc6 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:10.970350 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0de769-347f-41a2-84e3-f417c01dcfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:10.971153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0de769-347f-41a2-84e3-f417c01dcfc3 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:10.971450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0de769-347f-41a2-84e3-f417c01dcfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:10.971715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0de769-347f-41a2-84e3-f417c01dcfc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:10.982666 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0de769-347f-41a2-84e3-f417c01dcfc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:10.990549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-4d0de769-347f-41a2-84e3-f417c01dcfc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:33:10.990549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:10.990549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:10.990549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:10.990549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:10.990549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:10.990549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:10.990549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:10.990549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:10.990549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:10.990549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:10.990549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:10.990549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:10.990549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:10.990549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:10.990549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:10.991491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:10.991491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:10.991491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:10.991491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:10.991491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:10.991491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:10.991491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:10.991491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:10.991491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:10.991491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:10.991491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:10.991491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:10.991491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:10.991491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:10.991491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:10.991491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:10.992280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:10.992280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:10.992280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:10.992280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:10.992280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:10.992280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:10.992280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:10.992280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:10.992280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:10.992280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:10.992280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:33:10.992280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:10.992280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 215/418] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:10.998012 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f47582-dd24-4bfe-aa60-b3bebd978721 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:11.105969 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f47582-dd24-4bfe-aa60-b3bebd978721 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:11.139999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb820e-ba68-4986-9583-5494d18d88d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:11.140676 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb820e-ba68-4986-9583-5494d18d88d1 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:11.140961 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb820e-ba68-4986-9583-5494d18d88d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:11.141238 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb820e-ba68-4986-9583-5494d18d88d1 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:11.141990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb820e-ba68-4986-9583-5494d18d88d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:11.142296 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb820e-ba68-4986-9583-5494d18d88d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:11.143712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb820e-ba68-4986-9583-5494d18d88d1 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:11.152246 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 204/419] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:33:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:11.157744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0de769-347f-41a2-84e3-f417c01dcfc3 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:11.257215 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0de769-347f-41a2-84e3-f417c01dcfc3 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:11.290495 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a7587-d5b5-4f90-8ccb-40cd37781c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:11.291232 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a7587-d5b5-4f90-8ccb-40cd37781c70 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:11.291562 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a7587-d5b5-4f90-8ccb-40cd37781c70 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:11.291844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a7587-d5b5-4f90-8ccb-40cd37781c70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:11.358443 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a7587-d5b5-4f90-8ccb-40cd37781c70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:11.359932 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a7587-d5b5-4f90-8ccb-40cd37781c70 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:11.456843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 216/420] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:11.462462 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb820e-ba68-4986-9583-5494d18d88d1 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:11.582183 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb820e-ba68-4986-9583-5494d18d88d1 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:11.637696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06d2ed-a6d2-43bd-9d2c-c58e67615b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:11.638913 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d2ed-a6d2-43bd-9d2c-c58e67615b95 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:11.639339 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d2ed-a6d2-43bd-9d2c-c58e67615b95 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:11.639799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d2ed-a6d2-43bd-9d2c-c58e67615b95 None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:11.641116 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06d2ed-a6d2-43bd-9d2c-c58e67615b95 None admin] RBAC: Authorizing `identity:get_project(project_id=b8a06ae2ea914e91922edccf3b59d6dc)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:11.642703 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06d2ed-a6d2-43bd-9d2c-c58e67615b95 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:11.644836 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 205/421] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:33:11 2022] GET /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:11.650320 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a7587-d5b5-4f90-8ccb-40cd37781c70 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:11.754045 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a7587-d5b5-4f90-8ccb-40cd37781c70 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:11.788742 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630fd67-9947-43d0-a771-78aae3a0f014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:11.789618 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630fd67-9947-43d0-a771-78aae3a0f014 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:11.789903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630fd67-9947-43d0-a771-78aae3a0f014 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:11.790179 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630fd67-9947-43d0-a771-78aae3a0f014 None admin] PATH_INFO: `/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:11.791384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630fd67-9947-43d0-a771-78aae3a0f014 None admin] RBAC: Authorizing `identity:get_group(group_id=75f5d66fcc014c5dafac6abfc79aab4f)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:11.792928 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630fd67-9947-43d0-a771-78aae3a0f014 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:11.794850 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 217/422] 10.222.0.11 () {56 vars in 1180 bytes} [Wed May 4 21:33:11 2022] GET /identity/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:11.800701 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06d2ed-a6d2-43bd-9d2c-c58e67615b95 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:11.925635 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06d2ed-a6d2-43bd-9d2c-c58e67615b95 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:11.963792 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cb62d-18ba-40ba-bf13-964d1bea86e9 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:11.964440 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cb62d-18ba-40ba-bf13-964d1bea86e9 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:11.964931 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cb62d-18ba-40ba-bf13-964d1bea86e9 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:11.966813 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 218/423] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:33:11.972493 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88d72b-c260-4cc9-bd7a-ad747a480b2e None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:11.972781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88d72b-c260-4cc9-bd7a-ad747a480b2e None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:11.973060 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88d72b-c260-4cc9-bd7a-ad747a480b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:11.978980 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67abca7-1c89-478d-a78b-e0b847579093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:11.979836 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67abca7-1c89-478d-a78b-e0b847579093 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:11.980125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67abca7-1c89-478d-a78b-e0b847579093 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:11.980402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67abca7-1c89-478d-a78b-e0b847579093 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:11.981242 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67abca7-1c89-478d-a78b-e0b847579093 None admin] RBAC: Adding query filter params (group.id=75f5d66fcc014c5dafac6abfc79aab4f, role.id=b03b07e63e164e6a8858592b025c8103, scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:11.981561 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67abca7-1c89-478d-a78b-e0b847579093 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:11.989410 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67abca7-1c89-478d-a78b-e0b847579093 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:12.000795 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 206/424] 10.222.0.11 () {56 vars in 1376 bytes} [Wed May 4 21:33:11 2022] GET /identity/v3/role_assignments?group.id=75f5d66fcc014c5dafac6abfc79aab4f&scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc&role.id=b03b07e63e164e6a8858592b025c8103 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:12.001395 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-cd88d72b-c260-4cc9-bd7a-ad747a480b2e None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:12.002600 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-cd88d72b-c260-4cc9-bd7a-ad747a480b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:12.078936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 219/425] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:12.112039 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67abca7-1c89-478d-a78b-e0b847579093 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:12.227251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67abca7-1c89-478d-a78b-e0b847579093 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:12.260470 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af4677-5e18-45ad-bce3-598d130f6bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:12.261288 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af4677-5e18-45ad-bce3-598d130f6bb8 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:12.261569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af4677-5e18-45ad-bce3-598d130f6bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:12.261841 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af4677-5e18-45ad-bce3-598d130f6bb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:12.271758 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af4677-5e18-45ad-bce3-598d130f6bb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:12.279712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-17af4677-5e18-45ad-bce3-598d130f6bb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:33:12.279712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:12.279712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:12.279712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:12.279712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:12.279712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:12.279712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:12.279712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:12.279712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:12.279712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:12.279712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:12.279712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:12.279712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:12.279712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:12.279712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:12.279712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:12.281672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:12.281672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:12.281672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:12.281672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:12.281672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:12.281672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:12.281672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:12.281672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:12.281672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:12.281672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:12.281672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:12.281672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:12.281672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:12.281672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:12.281672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:12.281672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:12.283567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:12.283567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:12.283567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:12.283567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:12.283567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:12.283567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:12.283567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:12.283567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:12.283567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:12.283567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:12.283567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:33:12.283567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:12.283567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 207/426] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:33:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:12.290861 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88d72b-c260-4cc9-bd7a-ad747a480b2e None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:12.403562 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88d72b-c260-4cc9-bd7a-ad747a480b2e None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:12.441255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d88c2-b71f-4c4d-8d5e-d72550348b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:12.441944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d88c2-b71f-4c4d-8d5e-d72550348b97 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:12.442228 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d88c2-b71f-4c4d-8d5e-d72550348b97 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:12.442506 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d88c2-b71f-4c4d-8d5e-d72550348b97 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:12.443386 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d88c2-b71f-4c4d-8d5e-d72550348b97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:12.443697 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d88c2-b71f-4c4d-8d5e-d72550348b97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:12.445091 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d88c2-b71f-4c4d-8d5e-d72550348b97 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:12.454033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 220/427] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:12.459954 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af4677-5e18-45ad-bce3-598d130f6bb8 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:12.585118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af4677-5e18-45ad-bce3-598d130f6bb8 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:12.621348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc72d4b-e6f6-428a-a23f-ac291809edf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:12.622005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc72d4b-e6f6-428a-a23f-ac291809edf8 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:12.622285 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc72d4b-e6f6-428a-a23f-ac291809edf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:12.622557 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc72d4b-e6f6-428a-a23f-ac291809edf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:12.697699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc72d4b-e6f6-428a-a23f-ac291809edf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:12.699284 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc72d4b-e6f6-428a-a23f-ac291809edf8 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:12.815585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 208/428] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:12.821404 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d88c2-b71f-4c4d-8d5e-d72550348b97 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:12.935309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d88c2-b71f-4c4d-8d5e-d72550348b97 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:12.970741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e98140-4674-4e83-8465-cd527f84ab0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:12.971643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e98140-4674-4e83-8465-cd527f84ab0d None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:12.971928 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e98140-4674-4e83-8465-cd527f84ab0d None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:12.972208 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e98140-4674-4e83-8465-cd527f84ab0d None admin] PATH_INFO: `/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:12.973394 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e98140-4674-4e83-8465-cd527f84ab0d None admin] RBAC: Authorizing `identity:get_project(project_id=b8a06ae2ea914e91922edccf3b59d6dc)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:12.975193 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e98140-4674-4e83-8465-cd527f84ab0d None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:12.977194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 221/429] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:33:12 2022] GET /identity/v3/projects/b8a06ae2ea914e91922edccf3b59d6dc => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:12.985348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc72d4b-e6f6-428a-a23f-ac291809edf8 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:13.100884 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc72d4b-e6f6-428a-a23f-ac291809edf8 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:13.106868 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6ea86-c777-4687-a999-11f3f9f27ebf None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:13.107182 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6ea86-c777-4687-a999-11f3f9f27ebf None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:13.107458 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6ea86-c777-4687-a999-11f3f9f27ebf None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:13.109119 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 222/430] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:13.114159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2dc96-df70-421d-95e7-8ac84fa004a4 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:13.114443 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2dc96-df70-421d-95e7-8ac84fa004a4 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:13.114722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2dc96-df70-421d-95e7-8ac84fa004a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:13.138336 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-09a2dc96-df70-421d-95e7-8ac84fa004a4 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:13.139570 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-09a2dc96-df70-421d-95e7-8ac84fa004a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:13.141334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdde08-a27a-4941-9189-7ae68c5975bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:13.142491 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdde08-a27a-4941-9189-7ae68c5975bd None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:13.143017 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdde08-a27a-4941-9189-7ae68c5975bd None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:13.143526 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdde08-a27a-4941-9189-7ae68c5975bd None admin] PATH_INFO: `/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:13.145194 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdde08-a27a-4941-9189-7ae68c5975bd None admin] RBAC: Authorizing `identity:get_group(group_id=75f5d66fcc014c5dafac6abfc79aab4f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:13.146675 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdde08-a27a-4941-9189-7ae68c5975bd None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:13.149247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 209/431] 10.222.0.11 () {56 vars in 1180 bytes} [Wed May 4 21:33:12 2022] GET /identity/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:13.160133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdde08-a27a-4941-9189-7ae68c5975bd None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:13.232527 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 223/432] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:13.239735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d0a46-0599-421b-84bd-1278c2b21c27 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:13.240608 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d0a46-0599-421b-84bd-1278c2b21c27 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:13.241079 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d0a46-0599-421b-84bd-1278c2b21c27 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:13.247176 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 224/433] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:13.248363 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dff865-2789-4680-b5f4-91fc80f08765 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:13.248703 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dff865-2789-4680-b5f4-91fc80f08765 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:13.248987 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dff865-2789-4680-b5f4-91fc80f08765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:13.265082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdde08-a27a-4941-9189-7ae68c5975bd None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:13.265375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-66dff865-2789-4680-b5f4-91fc80f08765 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:13.266496 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-66dff865-2789-4680-b5f4-91fc80f08765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:13.298386 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47032e5-762a-47f6-b0fc-8c8fc0e89d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:13.299060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47032e5-762a-47f6-b0fc-8c8fc0e89d0a None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:13.299501 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47032e5-762a-47f6-b0fc-8c8fc0e89d0a None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:13.299778 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47032e5-762a-47f6-b0fc-8c8fc0e89d0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:13.301410 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47032e5-762a-47f6-b0fc-8c8fc0e89d0a None admin] RBAC: Adding query filter params (group.id=75f5d66fcc014c5dafac6abfc79aab4f, role.id=c3d122a6c9c6478aa2dd7e5b8afe6471, scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:13.301736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47032e5-762a-47f6-b0fc-8c8fc0e89d0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:13.303199 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47032e5-762a-47f6-b0fc-8c8fc0e89d0a None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:13.315546 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 210/434] 10.222.0.11 () {56 vars in 1376 bytes} [Wed May 4 21:33:13 2022] GET /identity/v3/role_assignments?group.id=75f5d66fcc014c5dafac6abfc79aab4f&scope.project.id=b8a06ae2ea914e91922edccf3b59d6dc&role.id=c3d122a6c9c6478aa2dd7e5b8afe6471 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:13.316595 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47032e5-762a-47f6-b0fc-8c8fc0e89d0a None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:13.334895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 225/435] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:13.336923 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316bd35-b592-4d51-a077-eddb3d88c0ad None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:13.337240 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316bd35-b592-4d51-a077-eddb3d88c0ad None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:13.337499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316bd35-b592-4d51-a077-eddb3d88c0ad None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:13.338926 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 226/436] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:13.345128 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d49ad1-7ed6-4635-9bc5-bb4b5cd6a18e None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:13.345418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d49ad1-7ed6-4635-9bc5-bb4b5cd6a18e None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:13.345697 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d49ad1-7ed6-4635-9bc5-bb4b5cd6a18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:13.367849 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-75d49ad1-7ed6-4635-9bc5-bb4b5cd6a18e None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:13.369079 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-75d49ad1-7ed6-4635-9bc5-bb4b5cd6a18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:13.433839 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47032e5-762a-47f6-b0fc-8c8fc0e89d0a None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:13.434873 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 227/437] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:13.435904 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d49ad1-7ed6-4635-9bc5-bb4b5cd6a18e None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:13.472689 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554d49d-a6d1-43fd-ae1a-99290fb209dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:13.473529 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554d49d-a6d1-43fd-ae1a-99290fb209dd None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:13.474127 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554d49d-a6d1-43fd-ae1a-99290fb209dd None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:13.474403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554d49d-a6d1-43fd-ae1a-99290fb209dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:13.485748 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554d49d-a6d1-43fd-ae1a-99290fb209dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:13.493290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-c554d49d-a6d1-43fd-ae1a-99290fb209dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:33:13.493290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:13.493290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:13.493290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:13.493290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:13.493290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:13.493290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:13.493290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:13.493290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:13.493290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:13.493290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:13.493290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:13.493290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:13.493290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:13.493290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:13.493290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:13.499890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:13.499890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:13.499890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:13.499890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:13.499890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:13.499890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:13.499890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:13.499890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:13.499890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:13.499890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:13.499890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:13.499890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:13.499890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:13.499890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:13.499890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:13.499890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:13.500684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:13.500684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:13.500684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:13.500684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:13.500684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:13.500684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:13.500684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:13.500684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:13.500684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:13.500684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:13.500684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:33:13.500684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:13.500684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 211/438] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:13.500684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554d49d-a6d1-43fd-ae1a-99290fb209dd None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:13.553359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d49ad1-7ed6-4635-9bc5-bb4b5cd6a18e None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:13.591802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba8bb3-7799-4aed-8e26-9231ab942290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:13.592616 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba8bb3-7799-4aed-8e26-9231ab942290 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:13.593498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba8bb3-7799-4aed-8e26-9231ab942290 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:13.593498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba8bb3-7799-4aed-8e26-9231ab942290 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:13.604151 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554d49d-a6d1-43fd-ae1a-99290fb209dd None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:13.606988 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba8bb3-7799-4aed-8e26-9231ab942290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:13.615766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-78ba8bb3-7799-4aed-8e26-9231ab942290 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:33:13.615766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:13.615766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:13.615766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:13.615766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:13.615766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:13.615766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:13.615766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:13.615766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:13.615766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:13.615766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:13.615766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:13.615766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:13.615766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:13.615766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:13.615766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:13.616705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:13.616705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:13.616705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:13.616705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:13.616705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:13.616705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:13.616705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:13.616705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:13.616705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:13.616705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:13.616705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:13.616705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:13.616705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:13.616705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:13.616705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:13.616705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:13.617501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:13.617501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:13.617501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:13.617501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:13.617501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:13.617501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:13.617501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:13.617501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:13.617501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:13.617501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:13.617501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:33:13.617501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:13.618557 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 228/439] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:33:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:13.618952 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba8bb3-7799-4aed-8e26-9231ab942290 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:13.648910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91577392-ccf1-41ba-bd8b-83e183f26766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:13.649753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91577392-ccf1-41ba-bd8b-83e183f26766 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:13.650031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91577392-ccf1-41ba-bd8b-83e183f26766 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:13.650300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91577392-ccf1-41ba-bd8b-83e183f26766 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:13.661943 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91577392-ccf1-41ba-bd8b-83e183f26766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:13.670181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-91577392-ccf1-41ba-bd8b-83e183f26766 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:33:13.670181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:13.670181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:13.670181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:13.670181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:13.670181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:13.670181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:13.670181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:13.670181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:13.670181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:13.670181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:13.670181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:13.670181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:13.670181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:13.670181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:13.670181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:13.671174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:13.671174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:13.671174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:13.671174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:13.671174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:13.671174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:13.671174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:13.671174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:13.671174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:13.671174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:13.671174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:13.671174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:13.671174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:13.671174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:13.671174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:13.671174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:13.672081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:13.672081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:13.672081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:13.672081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:13.672081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:13.672081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:13.672081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:13.672081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:13.672081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:13.672081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:13.672081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:33:13.672081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:13.672081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 212/440] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:33:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:13.672734 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91577392-ccf1-41ba-bd8b-83e183f26766 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:13.740036 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba8bb3-7799-4aed-8e26-9231ab942290 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:13.771222 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0945a-0d1b-4ee6-a78c-840e30ec561c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:13.771893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0945a-0d1b-4ee6-a78c-840e30ec561c None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:13.772174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0945a-0d1b-4ee6-a78c-840e30ec561c None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:13.772458 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0945a-0d1b-4ee6-a78c-840e30ec561c None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:13.773200 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0945a-0d1b-4ee6-a78c-840e30ec561c None admin] RBAC: Adding query filter params (name=member) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:13.773504 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0945a-0d1b-4ee6-a78c-840e30ec561c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:13.774891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0945a-0d1b-4ee6-a78c-840e30ec561c None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:13.774989 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91577392-ccf1-41ba-bd8b-83e183f26766 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:13.782978 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 229/441] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:33:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:13.783783 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0945a-0d1b-4ee6-a78c-840e30ec561c None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:13.811777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6a26f-303e-464d-9bb3-476f3493d860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:13.812439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6a26f-303e-464d-9bb3-476f3493d860 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:13.812734 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6a26f-303e-464d-9bb3-476f3493d860 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:13.813017 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6a26f-303e-464d-9bb3-476f3493d860 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:13.813763 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6a26f-303e-464d-9bb3-476f3493d860 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:13.814061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6a26f-303e-464d-9bb3-476f3493d860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:13.815481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6a26f-303e-464d-9bb3-476f3493d860 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:13.823391 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 213/442] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:13.824175 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6a26f-303e-464d-9bb3-476f3493d860 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:13.878198 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0945a-0d1b-4ee6-a78c-840e30ec561c None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:13.912633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65857cab-8aac-4523-a97d-7090e94c5dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:13.913299 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65857cab-8aac-4523-a97d-7090e94c5dc9 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:13.913592 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65857cab-8aac-4523-a97d-7090e94c5dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:13.913867 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65857cab-8aac-4523-a97d-7090e94c5dc9 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:13.914615 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65857cab-8aac-4523-a97d-7090e94c5dc9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:13.914919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65857cab-8aac-4523-a97d-7090e94c5dc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:13.916320 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65857cab-8aac-4523-a97d-7090e94c5dc9 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:13.918089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6a26f-303e-464d-9bb3-476f3493d860 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:13.924496 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 230/443] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:13.925311 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65857cab-8aac-4523-a97d-7090e94c5dc9 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:13.950768 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33773df1-d47c-4f45-a5cb-597524d797c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:13.951447 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33773df1-d47c-4f45-a5cb-597524d797c1 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:13.951709 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33773df1-d47c-4f45-a5cb-597524d797c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:13.951980 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33773df1-d47c-4f45-a5cb-597524d797c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:14.014957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33773df1-d47c-4f45-a5cb-597524d797c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:14.016354 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33773df1-d47c-4f45-a5cb-597524d797c1 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:14.019017 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65857cab-8aac-4523-a97d-7090e94c5dc9 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:14.051180 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9609da-dd34-497c-b5ef-c3746664796c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:14.051824 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9609da-dd34-497c-b5ef-c3746664796c None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:14.052106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9609da-dd34-497c-b5ef-c3746664796c None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:14.052381 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9609da-dd34-497c-b5ef-c3746664796c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:14.111902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 214/444] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:14.112732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33773df1-d47c-4f45-a5cb-597524d797c1 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:14.120422 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9609da-dd34-497c-b5ef-c3746664796c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:14.121886 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9609da-dd34-497c-b5ef-c3746664796c None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:14.206537 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33773df1-d47c-4f45-a5cb-597524d797c1 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:14.227275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 231/445] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:14.228143 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9609da-dd34-497c-b5ef-c3746664796c None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:14.245029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce2265-5843-4337-8f84-4b170e075937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:14.245780 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce2265-5843-4337-8f84-4b170e075937 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:14.246063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce2265-5843-4337-8f84-4b170e075937 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:14.246338 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce2265-5843-4337-8f84-4b170e075937 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:14.311956 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce2265-5843-4337-8f84-4b170e075937 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:14.313337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce2265-5843-4337-8f84-4b170e075937 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:14.325131 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9609da-dd34-497c-b5ef-c3746664796c None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:14.358533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86070ec0-73a6-452a-b6c7-7d88856e26ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:14.359416 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86070ec0-73a6-452a-b6c7-7d88856e26ca None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:14.359696 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86070ec0-73a6-452a-b6c7-7d88856e26ca None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:14.359966 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86070ec0-73a6-452a-b6c7-7d88856e26ca None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:14.361152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86070ec0-73a6-452a-b6c7-7d88856e26ca None admin] RBAC: Authorizing `identity:get_project(project_id=70d15e4994bb4da4af477c7904278502)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:14.362575 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86070ec0-73a6-452a-b6c7-7d88856e26ca None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:14.364294 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 232/446] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:33:14 2022] GET /identity/v3/projects/70d15e4994bb4da4af477c7904278502 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:14.365032 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86070ec0-73a6-452a-b6c7-7d88856e26ca None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:14.409058 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 215/447] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:14.409891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce2265-5843-4337-8f84-4b170e075937 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:14.457456 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86070ec0-73a6-452a-b6c7-7d88856e26ca None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:14.490922 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc685cf-31c1-4641-a0b3-5c7757b3e6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:14.491923 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc685cf-31c1-4641-a0b3-5c7757b3e6a9 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:14.492274 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc685cf-31c1-4641-a0b3-5c7757b3e6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:14.492639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc685cf-31c1-4641-a0b3-5c7757b3e6a9 None admin] PATH_INFO: `/v3/projects/cf7f12f74dbe44d39ddca7448ef132f4` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:14.493906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc685cf-31c1-4641-a0b3-5c7757b3e6a9 None admin] RBAC: Authorizing `identity:get_project(project_id=cf7f12f74dbe44d39ddca7448ef132f4)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:14.495548 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc685cf-31c1-4641-a0b3-5c7757b3e6a9 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:14.497227 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 233/448] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:33:14 2022] GET /identity/v3/projects/cf7f12f74dbe44d39ddca7448ef132f4 => generated 344 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:14.498062 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc685cf-31c1-4641-a0b3-5c7757b3e6a9 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:14.504892 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce2265-5843-4337-8f84-4b170e075937 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:14.540489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130440fa-ed59-43d9-8c0f-969ac433e4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:14.541991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130440fa-ed59-43d9-8c0f-969ac433e4db None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:14.542459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130440fa-ed59-43d9-8c0f-969ac433e4db None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:14.542943 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130440fa-ed59-43d9-8c0f-969ac433e4db None admin] PATH_INFO: `/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:14.544696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130440fa-ed59-43d9-8c0f-969ac433e4db None admin] RBAC: Authorizing `identity:get_group(group_id=75f5d66fcc014c5dafac6abfc79aab4f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:14.546143 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130440fa-ed59-43d9-8c0f-969ac433e4db None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:14.547800 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 216/449] 10.222.0.11 () {56 vars in 1180 bytes} [Wed May 4 21:33:14 2022] GET /identity/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:14.548569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130440fa-ed59-43d9-8c0f-969ac433e4db None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:14.594452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc685cf-31c1-4641-a0b3-5c7757b3e6a9 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:14.626054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acc8ef-19c1-48b4-8675-52b1143ab1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:14.626912 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acc8ef-19c1-48b4-8675-52b1143ab1d0 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:14.627222 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acc8ef-19c1-48b4-8675-52b1143ab1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:14.627601 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acc8ef-19c1-48b4-8675-52b1143ab1d0 None admin] PATH_INFO: `/v3/projects/70d15e4994bb4da4af477c7904278502` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:14.628790 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acc8ef-19c1-48b4-8675-52b1143ab1d0 None admin] RBAC: Authorizing `identity:get_project(project_id=70d15e4994bb4da4af477c7904278502)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:14.630241 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acc8ef-19c1-48b4-8675-52b1143ab1d0 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:14.631937 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 234/450] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:33:14 2022] GET /identity/v3/projects/70d15e4994bb4da4af477c7904278502 => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:14.632682 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acc8ef-19c1-48b4-8675-52b1143ab1d0 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:14.645860 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130440fa-ed59-43d9-8c0f-969ac433e4db None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:14.679347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3e0ba-7581-4423-8017-0b1cc481ab05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:14.680186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3e0ba-7581-4423-8017-0b1cc481ab05 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:14.680464 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3e0ba-7581-4423-8017-0b1cc481ab05 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:14.680737 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3e0ba-7581-4423-8017-0b1cc481ab05 None admin] PATH_INFO: `/v3/groups/f8c81ba1c4544699bb2a98371715d1b0` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:14.681913 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3e0ba-7581-4423-8017-0b1cc481ab05 None admin] RBAC: Authorizing `identity:get_group(group_id=f8c81ba1c4544699bb2a98371715d1b0)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:14.683414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3e0ba-7581-4423-8017-0b1cc481ab05 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:14.685007 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 217/451] 10.222.0.11 () {56 vars in 1180 bytes} [Wed May 4 21:33:14 2022] GET /identity/v3/groups/f8c81ba1c4544699bb2a98371715d1b0 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:14.685747 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3e0ba-7581-4423-8017-0b1cc481ab05 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:14.728314 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acc8ef-19c1-48b4-8675-52b1143ab1d0 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:14.756039 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2133c8a-c03f-43b7-a281-434f416365dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:14.756699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2133c8a-c03f-43b7-a281-434f416365dc None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:14.756975 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2133c8a-c03f-43b7-a281-434f416365dc None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:14.757248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2133c8a-c03f-43b7-a281-434f416365dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:14.758072 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2133c8a-c03f-43b7-a281-434f416365dc None admin] RBAC: Adding query filter params (group.id=75f5d66fcc014c5dafac6abfc79aab4f, role.id=b03b07e63e164e6a8858592b025c8103, scope.project.id=70d15e4994bb4da4af477c7904278502) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:14.758384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2133c8a-c03f-43b7-a281-434f416365dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:14.759839 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2133c8a-c03f-43b7-a281-434f416365dc None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:14.765462 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 235/452] 10.222.0.11 () {56 vars in 1376 bytes} [Wed May 4 21:33:14 2022] GET /identity/v3/role_assignments?group.id=75f5d66fcc014c5dafac6abfc79aab4f&scope.project.id=70d15e4994bb4da4af477c7904278502&role.id=b03b07e63e164e6a8858592b025c8103 => generated 611 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:14.766230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2133c8a-c03f-43b7-a281-434f416365dc None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:14.781342 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3e0ba-7581-4423-8017-0b1cc481ab05 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:14.818127 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea4842-5a29-40f0-a77f-6e2b59c8372f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:14.818993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea4842-5a29-40f0-a77f-6e2b59c8372f None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:14.819300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea4842-5a29-40f0-a77f-6e2b59c8372f None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:14.819592 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea4842-5a29-40f0-a77f-6e2b59c8372f None admin] PATH_INFO: `/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:14.820842 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea4842-5a29-40f0-a77f-6e2b59c8372f None admin] RBAC: Authorizing `identity:get_group(group_id=75f5d66fcc014c5dafac6abfc79aab4f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:14.822324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea4842-5a29-40f0-a77f-6e2b59c8372f None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:14.824351 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 218/453] 10.222.0.11 () {56 vars in 1180 bytes} [Wed May 4 21:33:14 2022] GET /identity/v3/groups/75f5d66fcc014c5dafac6abfc79aab4f => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:14.830209 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea4842-5a29-40f0-a77f-6e2b59c8372f None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:14.868258 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2133c8a-c03f-43b7-a281-434f416365dc None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:14.902203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3ab8e-01fe-4217-82c3-631cfd1007e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:14.902881 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3ab8e-01fe-4217-82c3-631cfd1007e7 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:14.903202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3ab8e-01fe-4217-82c3-631cfd1007e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:14.903479 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3ab8e-01fe-4217-82c3-631cfd1007e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:14.904341 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3ab8e-01fe-4217-82c3-631cfd1007e7 None admin] RBAC: Adding query filter params (group.id=f8c81ba1c4544699bb2a98371715d1b0, role.id=59778f07f0504e90a60212f460e8c774, scope.project.id=cf7f12f74dbe44d39ddca7448ef132f4) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:14.904656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3ab8e-01fe-4217-82c3-631cfd1007e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:14.906130 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3ab8e-01fe-4217-82c3-631cfd1007e7 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:14.912838 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 236/454] 10.222.0.11 () {56 vars in 1376 bytes} [Wed May 4 21:33:14 2022] GET /identity/v3/role_assignments?group.id=f8c81ba1c4544699bb2a98371715d1b0&scope.project.id=cf7f12f74dbe44d39ddca7448ef132f4&role.id=59778f07f0504e90a60212f460e8c774 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:14.941488 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea4842-5a29-40f0-a77f-6e2b59c8372f None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:14.978777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d523c-fdf6-488b-a05d-68956e7ebf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:14.980010 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d523c-fdf6-488b-a05d-68956e7ebf59 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:14.980502 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d523c-fdf6-488b-a05d-68956e7ebf59 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:14.980776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d523c-fdf6-488b-a05d-68956e7ebf59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:14.981826 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d523c-fdf6-488b-a05d-68956e7ebf59 None admin] RBAC: Adding query filter params (group.id=75f5d66fcc014c5dafac6abfc79aab4f, role.id=c3d122a6c9c6478aa2dd7e5b8afe6471, scope.project.id=70d15e4994bb4da4af477c7904278502) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:14.982019 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d523c-fdf6-488b-a05d-68956e7ebf59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:14.983634 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d523c-fdf6-488b-a05d-68956e7ebf59 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:14.990151 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 219/455] 10.222.0.11 () {56 vars in 1376 bytes} [Wed May 4 21:33:14 2022] GET /identity/v3/role_assignments?group.id=75f5d66fcc014c5dafac6abfc79aab4f&scope.project.id=70d15e4994bb4da4af477c7904278502&role.id=c3d122a6c9c6478aa2dd7e5b8afe6471 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:18.019153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e362a3-9c9f-4b26-a8b0-9e6f08c29aee None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:18.019676 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e362a3-9c9f-4b26-a8b0-9e6f08c29aee None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:18.019784 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e362a3-9c9f-4b26-a8b0-9e6f08c29aee None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:18.021350 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 237/456] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:18.026817 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1cd94-8771-4cd9-81b4-b8f6c52a8cb0 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:18.027291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1cd94-8771-4cd9-81b4-b8f6c52a8cb0 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:18.027475 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1cd94-8771-4cd9-81b4-b8f6c52a8cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:18.048044 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-1ae1cd94-8771-4cd9-81b4-b8f6c52a8cb0 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:18.049251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-1ae1cd94-8771-4cd9-81b4-b8f6c52a8cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:18.138012 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 220/457] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:18.186023 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e362a3-9c9f-4b26-a8b0-9e6f08c29aee None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:18.214831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d88c83-04c6-4603-858f-36fe726edddb None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:18.215413 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d88c83-04c6-4603-858f-36fe726edddb None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:18.215691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d88c83-04c6-4603-858f-36fe726edddb None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:18.218043 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 221/458] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:33:18.224315 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d99f13-9cca-408d-8a15-b367b559e5fb None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:18.224604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d99f13-9cca-408d-8a15-b367b559e5fb None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:18.224879 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d99f13-9cca-408d-8a15-b367b559e5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:18.243953 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-a5d99f13-9cca-408d-8a15-b367b559e5fb None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:18.246114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a5d99f13-9cca-408d-8a15-b367b559e5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:18.332917 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 222/459] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:33:18.352628 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e362a3-9c9f-4b26-a8b0-9e6f08c29aee None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:18.396869 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53237c63-5e6b-4d2e-8af0-c47557cf42c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:18.397711 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53237c63-5e6b-4d2e-8af0-c47557cf42c7 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:18.397991 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53237c63-5e6b-4d2e-8af0-c47557cf42c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:18.398267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53237c63-5e6b-4d2e-8af0-c47557cf42c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:18.403166 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d99f13-9cca-408d-8a15-b367b559e5fb None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:18.421518 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53237c63-5e6b-4d2e-8af0-c47557cf42c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:18.423382 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53237c63-5e6b-4d2e-8af0-c47557cf42c7 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:18.447870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-53237c63-5e6b-4d2e-8af0-c47557cf42c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:18.447870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:18.447870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:18.447870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:18.447870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:18.447870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:18.447870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:18.447870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:18.447870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:18.447870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:18.447870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:18.447870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:18.447870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:18.447870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:18.447870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:18.448785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:18.448785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:18.448785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:18.448785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:18.448785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:18.448785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:18.448785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:18.448785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:18.448785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:18.448785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:18.448785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:18.448785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:18.448785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:18.448785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:18.448785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:18.448785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:18.448785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:18.449621 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:18.449621 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:18.449621 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:18.449621 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:18.457935 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 238/460] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:18.466725 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53237c63-5e6b-4d2e-8af0-c47557cf42c7 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:18.532846 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d99f13-9cca-408d-8a15-b367b559e5fb None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:18.566072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd4b1d-2314-4538-bee4-cacf3cb18133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:18.572090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd4b1d-2314-4538-bee4-cacf3cb18133 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:18.572380 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd4b1d-2314-4538-bee4-cacf3cb18133 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:18.572723 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd4b1d-2314-4538-bee4-cacf3cb18133 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:18.579099 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53237c63-5e6b-4d2e-8af0-c47557cf42c7 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:18.588777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd4b1d-2314-4538-bee4-cacf3cb18133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:18.590447 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd4b1d-2314-4538-bee4-cacf3cb18133 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:18.608712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-98bd4b1d-2314-4538-bee4-cacf3cb18133 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:18.608712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:18.608712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:18.608712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:18.608712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:18.608712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:18.608712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:18.608712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:18.608712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:18.608712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:18.608712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:18.608712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:18.608712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:18.608712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:18.608712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:18.609608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:18.609608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:18.609608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:18.609608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:18.609608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:18.609608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:18.609608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:18.609608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:18.609608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:18.609608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:18.609608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:18.609608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:18.609608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:18.609608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:18.609608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:18.609608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:18.609608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:18.610443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:18.610443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:18.610443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:18.610443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:18.610443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 223/461] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:18.611213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e5b4b-c6f7-4312-ac9a-a3b460cb9cd7 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:18.611495 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e5b4b-c6f7-4312-ac9a-a3b460cb9cd7 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:18.611766 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e5b4b-c6f7-4312-ac9a-a3b460cb9cd7 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:18.613149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 224/462] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:18.614156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867cde7-b1d5-45a9-be1d-7008d30d75bd None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:18.614560 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867cde7-b1d5-45a9-be1d-7008d30d75bd None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:18.615083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867cde7-b1d5-45a9-be1d-7008d30d75bd None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:18.616477 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 225/463] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:18.617677 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867cde7-b1d5-45a9-be1d-7008d30d75bd None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:18.623486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160016bf-b257-4686-82ec-5a92dd210625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:18.624167 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160016bf-b257-4686-82ec-5a92dd210625 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:18.624449 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160016bf-b257-4686-82ec-5a92dd210625 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:18.624724 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160016bf-b257-4686-82ec-5a92dd210625 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:18.625444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160016bf-b257-4686-82ec-5a92dd210625 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:18.625749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160016bf-b257-4686-82ec-5a92dd210625 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:18.627142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160016bf-b257-4686-82ec-5a92dd210625 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:18.638494 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 239/464] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:18.639594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75546f11-5416-48e1-b27e-b9851491bf82 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:18.639969 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75546f11-5416-48e1-b27e-b9851491bf82 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:18.640258 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75546f11-5416-48e1-b27e-b9851491bf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:18.655866 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-75546f11-5416-48e1-b27e-b9851491bf82 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:18.657042 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-75546f11-5416-48e1-b27e-b9851491bf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:18.723337 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 240/465] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:18.724341 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867cde7-b1d5-45a9-be1d-7008d30d75bd None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:18.725317 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b41c9-6eb2-4e98-9adb-8282d001e43b None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:18.725738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b41c9-6eb2-4e98-9adb-8282d001e43b None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:18.726191 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b41c9-6eb2-4e98-9adb-8282d001e43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:18.742089 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-767b41c9-6eb2-4e98-9adb-8282d001e43b None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:18.743324 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-767b41c9-6eb2-4e98-9adb-8282d001e43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:18.769030 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65aea5-32af-4949-a31c-faaebaf5bc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:18.769820 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65aea5-32af-4949-a31c-faaebaf5bc77 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:18.770107 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65aea5-32af-4949-a31c-faaebaf5bc77 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:18.770375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65aea5-32af-4949-a31c-faaebaf5bc77 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:18.771115 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65aea5-32af-4949-a31c-faaebaf5bc77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:18.771427 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65aea5-32af-4949-a31c-faaebaf5bc77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:18.772805 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65aea5-32af-4949-a31c-faaebaf5bc77 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:18.794088 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 226/466] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:18.794088 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65aea5-32af-4949-a31c-faaebaf5bc77 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:18.813622 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 241/467] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:18.814633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b41c9-6eb2-4e98-9adb-8282d001e43b None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:18.897113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65aea5-32af-4949-a31c-faaebaf5bc77 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:18.911828 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b41c9-6eb2-4e98-9adb-8282d001e43b None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:18.930439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20875d-6fbf-4208-8bc2-ccc486a3bb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:18.931128 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20875d-6fbf-4208-8bc2-ccc486a3bb18 None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:18.931426 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20875d-6fbf-4208-8bc2-ccc486a3bb18 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:18.931703 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20875d-6fbf-4208-8bc2-ccc486a3bb18 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:18.932702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20875d-6fbf-4208-8bc2-ccc486a3bb18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:18.934202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20875d-6fbf-4208-8bc2-ccc486a3bb18 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:18.948372 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d95a7-d3ff-4fc5-849b-24c95ca28aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:18.949271 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d95a7-d3ff-4fc5-849b-24c95ca28aa2 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:18.949586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d95a7-d3ff-4fc5-849b-24c95ca28aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:18.949890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d95a7-d3ff-4fc5-849b-24c95ca28aa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:18.954775 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 227/468] 10.222.0.11 () {60 vars in 1132 bytes} [Wed May 4 21:33:18 2022] POST /identity/v3/users => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:33:18.955593 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20875d-6fbf-4208-8bc2-ccc486a3bb18 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:18.960624 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d95a7-d3ff-4fc5-849b-24c95ca28aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:18.962128 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d95a7-d3ff-4fc5-849b-24c95ca28aa2 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:18.986589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-fa9d95a7-d3ff-4fc5-849b-24c95ca28aa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:18.986589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:18.986589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:18.986589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:18.986589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:18.986589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:18.986589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:18.986589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:18.986589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:18.986589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:18.986589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:18.986589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:18.986589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:18.986589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:18.986589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:18.987566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:18.987566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:18.987566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:18.987566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:18.987566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:18.987566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:18.987566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:18.987566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:18.987566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:18.987566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:18.987566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:18.987566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:18.987566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:18.987566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:18.987566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:18.987566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:18.987566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:18.988430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:18.988430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:18.988430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:18.988430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:18.988430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 242/469] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:18.989160 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d95a7-d3ff-4fc5-849b-24c95ca28aa2 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:19.083713 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20875d-6fbf-4208-8bc2-ccc486a3bb18 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:19.096727 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d95a7-d3ff-4fc5-849b-24c95ca28aa2 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:19.119184 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3c4ec-c14c-454b-85cf-7256abc533a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:19.119913 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3c4ec-c14c-454b-85cf-7256abc533a0 None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:19.120191 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3c4ec-c14c-454b-85cf-7256abc533a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:19.120466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3c4ec-c14c-454b-85cf-7256abc533a0 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:19.121179 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3c4ec-c14c-454b-85cf-7256abc533a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:19.122650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3c4ec-c14c-454b-85cf-7256abc533a0 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:19.138653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f03b5-2760-41f7-a11d-65583ede4b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:19.138653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f03b5-2760-41f7-a11d-65583ede4b56 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:19.138653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f03b5-2760-41f7-a11d-65583ede4b56 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:19.138653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f03b5-2760-41f7-a11d-65583ede4b56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:19.149159 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 228/470] 10.222.0.11 () {60 vars in 1132 bytes} [Wed May 4 21:33:18 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:33:19.150225 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb13205-fca4-4eb2-8eda-1d180f68a57c None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:19.150565 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f03b5-2760-41f7-a11d-65583ede4b56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:19.151009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb13205-fca4-4eb2-8eda-1d180f68a57c None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:19.151009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb13205-fca4-4eb2-8eda-1d180f68a57c None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:19.153381 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f03b5-2760-41f7-a11d-65583ede4b56 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:19.153514 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 229/471] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:19.153514 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb13205-fca4-4eb2-8eda-1d180f68a57c None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:19.171433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-2f1f03b5-2760-41f7-a11d-65583ede4b56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:19.171433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:19.171433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:19.171433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:19.171433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:19.171433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:19.171433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:19.171433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:19.171433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:19.171433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:19.171433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:19.171433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:19.171433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:19.171433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:19.171433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:19.172366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:19.172366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:19.172366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:19.172366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:19.172366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:19.172366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:19.172366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:19.172366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:19.172366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:19.172366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:19.172366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:19.172366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:19.172366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:19.172366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:19.172366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:19.172366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:19.172366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:19.173677 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:19.173677 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:19.173677 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:19.173677 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:19.173677 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 243/472] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:19.174167 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7dac8-97fc-4f3a-97ae-100c3155f975 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:19.174312 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7dac8-97fc-4f3a-97ae-100c3155f975 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:19.174987 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7dac8-97fc-4f3a-97ae-100c3155f975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:19.195383 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-7ba7dac8-97fc-4f3a-97ae-100c3155f975 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:19.196592 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-7ba7dac8-97fc-4f3a-97ae-100c3155f975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:19.289050 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 244/473] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:19.294004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7dac8-97fc-4f3a-97ae-100c3155f975 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:19.325183 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb13205-fca4-4eb2-8eda-1d180f68a57c None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:19.373929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fa3ec-7ea9-4208-a15b-0e26b672dcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:19.374493 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fa3ec-7ea9-4208-a15b-0e26b672dcf7 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:19.374775 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fa3ec-7ea9-4208-a15b-0e26b672dcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:19.375088 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fa3ec-7ea9-4208-a15b-0e26b672dcf7 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:19.375798 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fa3ec-7ea9-4208-a15b-0e26b672dcf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:19.376109 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fa3ec-7ea9-4208-a15b-0e26b672dcf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:19.377479 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fa3ec-7ea9-4208-a15b-0e26b672dcf7 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:19.395131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 230/474] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:19.396166 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fa3ec-7ea9-4208-a15b-0e26b672dcf7 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:19.422683 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7dac8-97fc-4f3a-97ae-100c3155f975 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:19.462076 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cdfce-8e8b-4968-985c-ae52f6545242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:19.462743 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cdfce-8e8b-4968-985c-ae52f6545242 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:19.463020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cdfce-8e8b-4968-985c-ae52f6545242 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:19.463453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cdfce-8e8b-4968-985c-ae52f6545242 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:19.464178 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cdfce-8e8b-4968-985c-ae52f6545242 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:19.464483 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cdfce-8e8b-4968-985c-ae52f6545242 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:19.465857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cdfce-8e8b-4968-985c-ae52f6545242 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:19.480939 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 245/475] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:19.481760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cdfce-8e8b-4968-985c-ae52f6545242 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:19.517504 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fa3ec-7ea9-4208-a15b-0e26b672dcf7 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:19.561841 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcba12-914e-40b7-9e70-f26c0b516721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:19.562539 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcba12-914e-40b7-9e70-f26c0b516721 None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:19.562875 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcba12-914e-40b7-9e70-f26c0b516721 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:19.563311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcba12-914e-40b7-9e70-f26c0b516721 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:19.564194 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcba12-914e-40b7-9e70-f26c0b516721 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:19.565992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcba12-914e-40b7-9e70-f26c0b516721 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:19.575683 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.sql.core [None req-2afcba12-914e-40b7-9e70-f26c0b516721 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 21:33:19.575683 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 21:33:19.575683 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [parameters: {'id': '1c95fed44f8b4f9ab1bfcba4a1e48aee', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 21:33:19.575683 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86614) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 21:33:19.590833 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cdfce-8e8b-4968-985c-ae52f6545242 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:19.596063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-2afcba12-914e-40b7-9e70-f26c0b516721 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 21:33:19.596063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:19.596063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 21:33:19.596063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 21:33:19.596063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 21:33:19.596063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 21:33:19.596063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 21:33:19.596063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application result = self._query(query) May 04 21:33:19.596063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 21:33:19.596063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application conn.query(q) May 04 21:33:19.596063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 21:33:19.596063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 21:33:19.596063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 21:33:19.596063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application result.read() May 04 21:33:19.596063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 21:33:19.597087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 21:33:19.597087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 21:33:19.597087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 21:33:19.597087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 21:33:19.597087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 21:33:19.597087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 21:33:19.597087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 21:33:19.597087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 21:33:19.597087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:19.597087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 21:33:19.597087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:19.597087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:19.597087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 21:33:19.597087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 21:33:19.597087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 04 21:33:19.597087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return ref.to_dict() May 04 21:33:19.597087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 21:33:19.597087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application next(self.gen) May 04 21:33:19.598102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 21:33:19.598102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application yield resource May 04 21:33:19.598102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 21:33:19.598102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application next(self.gen) May 04 21:33:19.598102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 21:33:19.598102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self.session.rollback() May 04 21:33:19.598102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 21:33:19.598102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self.force_reraise() May 04 21:33:19.598102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 21:33:19.598102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise self.value May 04 21:33:19.598102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 21:33:19.598102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 21:33:19.598102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 21:33:19.598102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application session.commit() May 04 21:33:19.598102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 21:33:19.598102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 21:33:19.598102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 21:33:19.599334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._prepare_impl() May 04 21:33:19.599334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 21:33:19.599334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self.session.flush() May 04 21:33:19.599334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 21:33:19.599334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._flush(objects) May 04 21:33:19.599334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 21:33:19.599334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 21:33:19.599334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 21:33:19.599334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application compat.raise_( May 04 21:33:19.599334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 21:33:19.599334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception May 04 21:33:19.599334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 21:33:19.599334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application flush_context.execute() May 04 21:33:19.599334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 21:33:19.599334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rec.execute(self) May 04 21:33:19.599334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 21:33:19.599334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 21:33:19.600266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 21:33:19.600266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 21:33:19.600266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 21:33:19.600266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 21:33:19.600266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 21:33:19.600266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 21:33:19.600266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 21:33:19.600266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 21:33:19.600266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 21:33:19.600266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 21:33:19.600266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 21:33:19.600266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 21:33:19.600266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 21:33:19.600266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 21:33:19.600266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 21:33:19.600266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception May 04 21:33:19.601071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 21:33:19.601071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 21:33:19.601071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 21:33:19.601071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 21:33:19.601071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 21:33:19.601071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application result = self._query(query) May 04 21:33:19.601071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 21:33:19.601071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application conn.query(q) May 04 21:33:19.601071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 21:33:19.601071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 21:33:19.601071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 21:33:19.601071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application result.read() May 04 21:33:19.601071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 21:33:19.601071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 21:33:19.601071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 21:33:19.601071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 21:33:19.601885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 21:33:19.601885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 21:33:19.601885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 21:33:19.601885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 21:33:19.601885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 21:33:19.601885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 21:33:19.601885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [parameters: {'id': '1c95fed44f8b4f9ab1bfcba4a1e48aee', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 21:33:19.601885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 21:33:19.601885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:19.601885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:33:19.601885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:19.601885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:19.601885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:19.601885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:19.601885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:19.601885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:19.602702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:19.602702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:19.602702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:19.602702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:19.602702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:19.602702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:19.602702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 04 21:33:19.602702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 04 21:33:19.602702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:19.602702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:19.602702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 04 21:33:19.602702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 04 21:33:19.602702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 21:33:19.602702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 21:33:19.602702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 21:33:19.602702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:19.610180 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 231/476] 10.222.0.11 () {60 vars in 1131 bytes} [Wed May 4 21:33:19 2022] POST /identity/v3/roles => generated 144 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:19.611358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcba12-914e-40b7-9e70-f26c0b516721 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:19.627073 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f4f79-82c3-4d65-ab7e-f90ad663fbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:19.627605 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f4f79-82c3-4d65-ab7e-f90ad663fbb6 None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:19.627889 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f4f79-82c3-4d65-ab7e-f90ad663fbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:19.628164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f4f79-82c3-4d65-ab7e-f90ad663fbb6 None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:19.628937 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f4f79-82c3-4d65-ab7e-f90ad663fbb6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:19.630438 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f4f79-82c3-4d65-ab7e-f90ad663fbb6 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:19.671197 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 246/477] 10.222.0.11 () {60 vars in 1132 bytes} [Wed May 4 21:33:19 2022] POST /identity/v3/users => generated 249 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:33:19.672933 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f4f79-82c3-4d65-ab7e-f90ad663fbb6 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:19.740095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcba12-914e-40b7-9e70-f26c0b516721 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:19.778596 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a5b00-7643-4dfb-9e67-888f5ee06179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:19.779549 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a5b00-7643-4dfb-9e67-888f5ee06179 None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:19.779972 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a5b00-7643-4dfb-9e67-888f5ee06179 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:19.780876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a5b00-7643-4dfb-9e67-888f5ee06179 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:19.781790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a5b00-7643-4dfb-9e67-888f5ee06179 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:19.783585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a5b00-7643-4dfb-9e67-888f5ee06179 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:19.814669 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 232/478] 10.222.0.11 () {60 vars in 1132 bytes} [Wed May 4 21:33:19 2022] POST /identity/v3/users => generated 248 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:33:19.884792 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f4f79-82c3-4d65-ab7e-f90ad663fbb6 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:19.920306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d25747-3f73-470a-a3bb-87b7022e59fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:19.921397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d25747-3f73-470a-a3bb-87b7022e59fd None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:19.921825 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d25747-3f73-470a-a3bb-87b7022e59fd None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:19.922241 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d25747-3f73-470a-a3bb-87b7022e59fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:19.935171 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d25747-3f73-470a-a3bb-87b7022e59fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:19.943883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-d5d25747-3f73-470a-a3bb-87b7022e59fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:33:19.943883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:19.943883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:19.943883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:19.943883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:19.943883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:19.943883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:19.943883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:19.943883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:19.943883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:19.943883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:19.943883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:19.943883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:19.943883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:19.943883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:19.943883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:19.945002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:19.945002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:19.945002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:19.945002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:19.945002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:19.945002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:19.945002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:19.945002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:19.945002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:19.945002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:19.945002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:19.945002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:19.945002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:19.945002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:19.945002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:19.945002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:19.945971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:19.945971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:19.945971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:19.945971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:19.945971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:19.945971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:19.945971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:19.945971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:19.945971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:19.945971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:19.945971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:33:19.945971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:19.948023 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 247/479] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:33:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:19.956922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a5b00-7643-4dfb-9e67-888f5ee06179 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:20.098344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a5b00-7643-4dfb-9e67-888f5ee06179 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:20.136551 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81681a50-21bc-487f-a982-33ab3d7f9d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:20.137472 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81681a50-21bc-487f-a982-33ab3d7f9d35 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:20.137898 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81681a50-21bc-487f-a982-33ab3d7f9d35 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:20.138339 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81681a50-21bc-487f-a982-33ab3d7f9d35 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:20.139272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81681a50-21bc-487f-a982-33ab3d7f9d35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:20.139721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81681a50-21bc-487f-a982-33ab3d7f9d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:20.141247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81681a50-21bc-487f-a982-33ab3d7f9d35 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:20.150175 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 233/480] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:21.840543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f1286-9711-4559-b820-87ba5680b7d7 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:21.841040 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f1286-9711-4559-b820-87ba5680b7d7 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:21.841269 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f1286-9711-4559-b820-87ba5680b7d7 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:21.843021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 248/481] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:21.849249 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cc8e4-0941-4c29-9e21-1b2ef906df7e None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:21.849727 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cc8e4-0941-4c29-9e21-1b2ef906df7e None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:21.850219 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cc8e4-0941-4c29-9e21-1b2ef906df7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:21.876068 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-316cc8e4-0941-4c29-9e21-1b2ef906df7e None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:21.877282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-316cc8e4-0941-4c29-9e21-1b2ef906df7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:21.887667 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdd66f-73d6-4877-bafc-47c5497e1a84 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:21.887961 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdd66f-73d6-4877-bafc-47c5497e1a84 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:21.888254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdd66f-73d6-4877-bafc-47c5497e1a84 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:21.889868 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 249/482] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:21.895775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a50b50-9cee-4a40-8c48-ad7822e64ca6 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:21.896584 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a50b50-9cee-4a40-8c48-ad7822e64ca6 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:21.897293 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a50b50-9cee-4a40-8c48-ad7822e64ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:21.920433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-95a50b50-9cee-4a40-8c48-ad7822e64ca6 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:21.922183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-95a50b50-9cee-4a40-8c48-ad7822e64ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:22.002144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 234/483] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:22.003971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 250/484] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:22.026397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a50b50-9cee-4a40-8c48-ad7822e64ca6 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:22.047548 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cc8e4-0941-4c29-9e21-1b2ef906df7e None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:22.158343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a50b50-9cee-4a40-8c48-ad7822e64ca6 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:22.206597 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a66084-15c2-4837-9af1-237f9d17dd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:22.207607 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a66084-15c2-4837-9af1-237f9d17dd78 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:22.207888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a66084-15c2-4837-9af1-237f9d17dd78 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:22.208159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a66084-15c2-4837-9af1-237f9d17dd78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:22.240116 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a66084-15c2-4837-9af1-237f9d17dd78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:22.249874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-57a66084-15c2-4837-9af1-237f9d17dd78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:22.249874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:22.249874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:22.249874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:22.249874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:22.249874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:22.249874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:22.249874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:22.249874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:22.249874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:22.249874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:22.249874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:22.249874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:22.249874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:22.249874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:22.249874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:22.250800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:22.250800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:22.250800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:22.250800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:22.250800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:22.250800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:22.250800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:22.250800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:22.250800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:22.250800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:22.250800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:22.250800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:22.250800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:22.250800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:22.250800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:22.250800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:22.251633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:22.251633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:22.251633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:22.251633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:22.251633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:22.251633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:22.251633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:22.251633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:22.251633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:22.251633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:22.251633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:22.251633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:22.259561 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 251/485] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:22.260753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cc8e4-0941-4c29-9e21-1b2ef906df7e None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:22.266760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a66084-15c2-4837-9af1-237f9d17dd78 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:22.332269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b4766-9fe9-4058-a0b7-61ee3bae5759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:22.333083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b4766-9fe9-4058-a0b7-61ee3bae5759 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:22.333359 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b4766-9fe9-4058-a0b7-61ee3bae5759 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:22.333631 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b4766-9fe9-4058-a0b7-61ee3bae5759 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:22.364243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b4766-9fe9-4058-a0b7-61ee3bae5759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:22.379718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-d84b4766-9fe9-4058-a0b7-61ee3bae5759 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:22.379718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:22.379718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:22.379718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:22.379718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:22.379718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:22.379718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:22.379718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:22.379718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:22.379718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:22.379718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:22.379718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:22.379718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:22.379718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:22.379718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:22.379718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:22.382031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:22.382031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:22.382031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:22.382031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:22.382031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:22.382031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:22.382031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:22.382031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:22.382031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:22.382031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:22.382031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:22.382031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:22.382031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:22.382031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:22.382031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:22.382031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:22.383990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:22.383990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:22.383990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:22.383990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:22.383990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:22.383990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:22.383990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:22.383990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:22.383990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:22.383990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:22.383990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:22.383990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:22.383990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 235/486] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:33:22.391064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b4766-9fe9-4058-a0b7-61ee3bae5759 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:22.422069 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a66084-15c2-4837-9af1-237f9d17dd78 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:22.462436 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18360364-e970-4cea-ae7a-3c15c0214094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:22.463225 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18360364-e970-4cea-ae7a-3c15c0214094 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:22.463512 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18360364-e970-4cea-ae7a-3c15c0214094 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:22.463786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18360364-e970-4cea-ae7a-3c15c0214094 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:22.464539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18360364-e970-4cea-ae7a-3c15c0214094 None admin] RBAC: Adding query filter params (name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:22.464846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18360364-e970-4cea-ae7a-3c15c0214094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:22.466321 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18360364-e970-4cea-ae7a-3c15c0214094 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:22.475529 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 252/487] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:33:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:22.481311 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18360364-e970-4cea-ae7a-3c15c0214094 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:22.540002 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b4766-9fe9-4058-a0b7-61ee3bae5759 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:22.573286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670f599-0bf4-4579-a87f-00f4dc67ae60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:22.573984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670f599-0bf4-4579-a87f-00f4dc67ae60 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:22.574268 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670f599-0bf4-4579-a87f-00f4dc67ae60 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:22.574647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670f599-0bf4-4579-a87f-00f4dc67ae60 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:22.576273 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670f599-0bf4-4579-a87f-00f4dc67ae60 None admin] RBAC: Adding query filter params (name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:22.576273 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670f599-0bf4-4579-a87f-00f4dc67ae60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:22.577062 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670f599-0bf4-4579-a87f-00f4dc67ae60 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:22.593668 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 236/488] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:33:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:22.595607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670f599-0bf4-4579-a87f-00f4dc67ae60 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:22.673984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18360364-e970-4cea-ae7a-3c15c0214094 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:22.725909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670f599-0bf4-4579-a87f-00f4dc67ae60 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:22.756761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24d005-0328-4593-893d-fd728be3c62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:22.757965 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24d005-0328-4593-893d-fd728be3c62b None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:22.758439 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24d005-0328-4593-893d-fd728be3c62b None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:22.758902 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24d005-0328-4593-893d-fd728be3c62b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:22.763060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8e7d4-8757-4552-8146-64f3d1f7ae94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:22.763060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8e7d4-8757-4552-8146-64f3d1f7ae94 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:22.763060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8e7d4-8757-4552-8146-64f3d1f7ae94 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:22.763060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8e7d4-8757-4552-8146-64f3d1f7ae94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:22.772647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8e7d4-8757-4552-8146-64f3d1f7ae94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:22.774135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8e7d4-8757-4552-8146-64f3d1f7ae94 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:22.780287 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24d005-0328-4593-893d-fd728be3c62b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:22.781900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24d005-0328-4593-893d-fd728be3c62b None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:22.796402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-1dc8e7d4-8757-4552-8146-64f3d1f7ae94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:22.796402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:22.796402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:22.796402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:22.796402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:22.796402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:22.796402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:22.796402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:22.796402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:22.796402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:22.796402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:22.796402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:22.796402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:22.796402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:22.796402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:22.797324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:22.797324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:22.797324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:22.797324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:22.797324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:22.797324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:22.797324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:22.797324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:22.797324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:22.797324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:22.797324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:22.797324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:22.797324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:22.797324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:22.797324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:22.797324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:22.797324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:22.798150 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:22.798150 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:22.798150 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:22.798150 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:22.799096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-4a24d005-0328-4593-893d-fd728be3c62b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:22.799096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:22.799096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:22.799096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:22.799096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:22.799096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:22.799096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:22.799096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:22.799096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:22.799096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:22.799096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:22.799096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:22.799096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:22.799096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:22.799096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:22.799899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:22.799899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:22.799899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:22.799899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:22.799899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:22.799899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:22.799899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:22.799899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:22.799899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:22.799899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:22.799899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:22.799899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:22.799899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:22.799899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:22.799899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:22.799899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:22.799899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:22.800728 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:22.800728 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:22.800728 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:22.800728 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:22.800728 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 253/489] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:22.802098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15298b-e840-4329-8bf7-db0069e1c2a4 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:22.802399 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15298b-e840-4329-8bf7-db0069e1c2a4 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:22.802678 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15298b-e840-4329-8bf7-db0069e1c2a4 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:22.804365 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 237/491] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:22.811093 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 254/491] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:22.811307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8e7d4-8757-4552-8146-64f3d1f7ae94 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:22.811386 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9971f9-2fbf-45ba-8996-a2dd83ca1bc4 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:22.811386 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9971f9-2fbf-45ba-8996-a2dd83ca1bc4 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:22.811507 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9971f9-2fbf-45ba-8996-a2dd83ca1bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:22.830442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-8c9971f9-2fbf-45ba-8996-a2dd83ca1bc4 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:22.831373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-8c9971f9-2fbf-45ba-8996-a2dd83ca1bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:22.905582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 255/492] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:22.906621 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9971f9-2fbf-45ba-8996-a2dd83ca1bc4 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:22.919337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8e7d4-8757-4552-8146-64f3d1f7ae94 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:22.953170 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de7c7d-273d-4a26-80a9-c9691edad61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:22.954192 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de7c7d-273d-4a26-80a9-c9691edad61b None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:22.954666 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de7c7d-273d-4a26-80a9-c9691edad61b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:22.955163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de7c7d-273d-4a26-80a9-c9691edad61b None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:22.956070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de7c7d-273d-4a26-80a9-c9691edad61b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:22.956577 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de7c7d-273d-4a26-80a9-c9691edad61b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:22.958146 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de7c7d-273d-4a26-80a9-c9691edad61b None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:22.970337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 238/493] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:22.971460 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de7c7d-273d-4a26-80a9-c9691edad61b None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:23.005932 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9971f9-2fbf-45ba-8996-a2dd83ca1bc4 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:23.039609 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9eeb9e-ca21-45ee-9838-aa604b6b2244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:23.040277 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eeb9e-ca21-45ee-9838-aa604b6b2244 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:23.040557 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eeb9e-ca21-45ee-9838-aa604b6b2244 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:23.040830 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eeb9e-ca21-45ee-9838-aa604b6b2244 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:23.041710 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9eeb9e-ca21-45ee-9838-aa604b6b2244 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:23.042013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9eeb9e-ca21-45ee-9838-aa604b6b2244 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:23.043416 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9eeb9e-ca21-45ee-9838-aa604b6b2244 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:23.054116 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 256/494] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:23.054884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9eeb9e-ca21-45ee-9838-aa604b6b2244 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:23.071590 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de7c7d-273d-4a26-80a9-c9691edad61b None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:23.104615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86962b-35c9-471e-9f6f-7ffb5a34cdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:23.105416 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86962b-35c9-471e-9f6f-7ffb5a34cdb2 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:23.105701 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86962b-35c9-471e-9f6f-7ffb5a34cdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:23.105982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86962b-35c9-471e-9f6f-7ffb5a34cdb2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:23.115557 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86962b-35c9-471e-9f6f-7ffb5a34cdb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:23.123230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-5c86962b-35c9-471e-9f6f-7ffb5a34cdb2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:23.123230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:23.123230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:23.123230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:23.123230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:23.123230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:23.123230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:23.123230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:23.123230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:23.123230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:23.123230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:23.123230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:23.123230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:23.123230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:23.123230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:23.123230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:23.124289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:23.124289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:23.124289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:23.124289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:23.124289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:23.124289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:23.124289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:23.124289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:23.124289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:23.124289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:23.124289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:23.124289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:23.124289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:23.124289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:23.124289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:23.124289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:23.125243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:23.125243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:23.125243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:23.125243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:23.125243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:23.125243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:23.125243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:23.125243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:23.125243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:23.125243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:23.125243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:23.125243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:23.125243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 239/495] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:23.126294 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde84455-4fd9-49e3-b0be-7b8c0667affe None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:23.126294 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde84455-4fd9-49e3-b0be-7b8c0667affe None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:23.126444 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde84455-4fd9-49e3-b0be-7b8c0667affe None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:23.127926 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 240/496] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:23.129007 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff2821-e280-4166-b0ce-0cde20c9cdb5 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:23.129646 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff2821-e280-4166-b0ce-0cde20c9cdb5 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:23.129646 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff2821-e280-4166-b0ce-0cde20c9cdb5 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:23.130992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 241/497] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:23.135555 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff2821-e280-4166-b0ce-0cde20c9cdb5 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:23.151920 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9eeb9e-ca21-45ee-9838-aa604b6b2244 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:23.186332 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d9794-e957-497e-b100-db2092c9cc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:23.187162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d9794-e957-497e-b100-db2092c9cc97 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:23.187444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d9794-e957-497e-b100-db2092c9cc97 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:23.187715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d9794-e957-497e-b100-db2092c9cc97 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:23.195571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d9794-e957-497e-b100-db2092c9cc97 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:23.197028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d9794-e957-497e-b100-db2092c9cc97 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:23.212761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-232d9794-e957-497e-b100-db2092c9cc97 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 21:33:23.212761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:23.212761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:23.212761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:23.212761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:23.212761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:23.212761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:23.212761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:23.212761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:23.212761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:23.212761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:23.212761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:23.212761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:23.212761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:23.212761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:23.212761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:23.213735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:23.213735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:23.213735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:23.213735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:23.213735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:23.213735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:23.213735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:23.213735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:23.213735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:23.213735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:23.213735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:23.213735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:23.213735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:23.213735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:23.213735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:23.213735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:23.213735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:23.213735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:23.214639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:23.214639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:23.214639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:23.214639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:23.214639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:23.214639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:23.214639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:23.214639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:23.214639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 21:33:23.214639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:23.214639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 257/498] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:23.215296 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d9794-e957-497e-b100-db2092c9cc97 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:23.240526 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff2821-e280-4166-b0ce-0cde20c9cdb5 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:23.277001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3854e5e-008a-48b5-a9c8-00e2a00391ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:23.277778 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3854e5e-008a-48b5-a9c8-00e2a00391ec None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:23.278056 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3854e5e-008a-48b5-a9c8-00e2a00391ec None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:23.278330 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3854e5e-008a-48b5-a9c8-00e2a00391ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:23.285870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3854e5e-008a-48b5-a9c8-00e2a00391ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:23.287363 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3854e5e-008a-48b5-a9c8-00e2a00391ec None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:23.302473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-c3854e5e-008a-48b5-a9c8-00e2a00391ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 21:33:23.302473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:23.302473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:23.302473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:23.302473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:23.302473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:23.302473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:23.302473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:23.302473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:23.302473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:23.302473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:23.302473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:23.302473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:23.302473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:23.302473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:23.302473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:23.303406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:23.303406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:23.303406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:23.303406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:23.303406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:23.303406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:23.303406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:23.303406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:23.303406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:23.303406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:23.303406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:23.303406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:23.303406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:23.303406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:23.303406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:23.303406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:23.303406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:23.303406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:23.304269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:23.304269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:23.304269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:23.304269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:23.304269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:23.304269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:23.304269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:23.304269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:23.304269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 21:33:23.304269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:23.304269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 242/499] 10.222.0.11 () {56 vars in 1093 bytes} [Wed May 4 21:33:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:23.305357 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674e749-8f7d-48fd-a927-ef958ac1a208 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:23.305357 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674e749-8f7d-48fd-a927-ef958ac1a208 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:23.305524 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674e749-8f7d-48fd-a927-ef958ac1a208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:23.316892 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d9794-e957-497e-b100-db2092c9cc97 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:23.321766 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-6674e749-8f7d-48fd-a927-ef958ac1a208 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:23.323076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-6674e749-8f7d-48fd-a927-ef958ac1a208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:23.350504 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d2de0-21b4-4ff2-9212-dfd0668c8422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:23.351213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d2de0-21b4-4ff2-9212-dfd0668c8422 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:23.351498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d2de0-21b4-4ff2-9212-dfd0668c8422 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:23.351769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d2de0-21b4-4ff2-9212-dfd0668c8422 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:23.352519 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d2de0-21b4-4ff2-9212-dfd0668c8422 None admin] RBAC: Adding query filter params (name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:23.352827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d2de0-21b4-4ff2-9212-dfd0668c8422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:23.354377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d2de0-21b4-4ff2-9212-dfd0668c8422 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:23.362761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 258/500] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:33:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:23.363892 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c491ab-abd1-4191-9a08-1b811282590e None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:23.364190 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c491ab-abd1-4191-9a08-1b811282590e None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:23.364470 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c491ab-abd1-4191-9a08-1b811282590e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:23.380480 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-90c491ab-abd1-4191-9a08-1b811282590e None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:23.381677 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-90c491ab-abd1-4191-9a08-1b811282590e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:23.387515 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 243/501] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:23.399178 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674e749-8f7d-48fd-a927-ef958ac1a208 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:23.447661 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 259/502] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:23.448593 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c491ab-abd1-4191-9a08-1b811282590e None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:23.498033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674e749-8f7d-48fd-a927-ef958ac1a208 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:23.533232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02367bd-af5b-44d6-8c9d-e2f2fd9b4415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:23.533905 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02367bd-af5b-44d6-8c9d-e2f2fd9b4415 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:23.534214 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02367bd-af5b-44d6-8c9d-e2f2fd9b4415 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:23.534483 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02367bd-af5b-44d6-8c9d-e2f2fd9b4415 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:23.535343 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02367bd-af5b-44d6-8c9d-e2f2fd9b4415 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:23.535639 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02367bd-af5b-44d6-8c9d-e2f2fd9b4415 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:23.537077 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02367bd-af5b-44d6-8c9d-e2f2fd9b4415 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:23.543821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c491ab-abd1-4191-9a08-1b811282590e None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:23.573605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 244/503] 10.222.0.11 () {56 vars in 1137 bytes} [Wed May 4 21:33:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:23.574425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02367bd-af5b-44d6-8c9d-e2f2fd9b4415 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:23.579575 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28dd0b3-8365-43ae-8bbf-9c244fe5e3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:23.580272 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dd0b3-8365-43ae-8bbf-9c244fe5e3e4 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:23.580555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dd0b3-8365-43ae-8bbf-9c244fe5e3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:23.580828 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dd0b3-8365-43ae-8bbf-9c244fe5e3e4 None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:23.581675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28dd0b3-8365-43ae-8bbf-9c244fe5e3e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:23.581983 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28dd0b3-8365-43ae-8bbf-9c244fe5e3e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:23.583502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28dd0b3-8365-43ae-8bbf-9c244fe5e3e4 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:23.620323 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 260/504] 10.222.0.11 () {56 vars in 1133 bytes} [Wed May 4 21:33:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:23.621148 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28dd0b3-8365-43ae-8bbf-9c244fe5e3e4 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:23.669313 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02367bd-af5b-44d6-8c9d-e2f2fd9b4415 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:23.701061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a74f4-f708-45a2-ad70-06bc6970f9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:23.701843 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a74f4-f708-45a2-ad70-06bc6970f9ab None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:23.702118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a74f4-f708-45a2-ad70-06bc6970f9ab None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:23.702381 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a74f4-f708-45a2-ad70-06bc6970f9ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:23.712711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a74f4-f708-45a2-ad70-06bc6970f9ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:23.714214 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a74f4-f708-45a2-ad70-06bc6970f9ab None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:23.728046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28dd0b3-8365-43ae-8bbf-9c244fe5e3e4 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:23.732886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-fb2a74f4-f708-45a2-ad70-06bc6970f9ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:23.732886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:23.732886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:23.732886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:23.732886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:23.732886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:23.732886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:23.732886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:23.732886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:23.732886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:23.732886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:23.732886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:23.732886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:23.732886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:23.732886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:23.733741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:23.733741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:23.733741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:23.733741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:23.733741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:23.733741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:23.733741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:23.733741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:23.733741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:23.733741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:23.733741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:23.733741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:23.733741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:23.733741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:23.733741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:23.733741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:23.733741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:23.734579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:23.734579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:23.734579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:23.734579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:23.734579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 245/505] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:23.734863 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a74f4-f708-45a2-ad70-06bc6970f9ab None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:23.762983 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948e71c-fd86-48b5-b148-74b955b61344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:23.763741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948e71c-fd86-48b5-b148-74b955b61344 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:23.764025 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948e71c-fd86-48b5-b148-74b955b61344 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:23.764302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948e71c-fd86-48b5-b148-74b955b61344 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:23.778612 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948e71c-fd86-48b5-b148-74b955b61344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:23.786226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-3948e71c-fd86-48b5-b148-74b955b61344 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:23.786226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:23.786226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:23.786226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:23.786226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:23.786226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:23.786226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:23.786226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:23.786226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:23.786226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:23.786226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:23.786226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:23.786226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:23.786226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:23.786226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:23.786226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:23.787177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:23.787177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:23.787177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:23.787177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:23.787177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:23.787177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:23.787177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:23.787177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:23.787177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:23.787177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:23.787177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:23.787177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:23.787177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:23.787177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:23.787177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:23.787177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:23.787982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:23.787982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:23.787982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:23.787982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:23.787982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:23.787982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:23.787982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:23.787982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:23.787982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:23.787982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:23.787982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:23.787982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:23.787982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 261/506] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:23.788652 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948e71c-fd86-48b5-b148-74b955b61344 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:23.833843 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a74f4-f708-45a2-ad70-06bc6970f9ab None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:23.866117 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef82412-b6dd-457c-b239-29e9c087a409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:23.866903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef82412-b6dd-457c-b239-29e9c087a409 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:23.867216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef82412-b6dd-457c-b239-29e9c087a409 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:23.867482 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef82412-b6dd-457c-b239-29e9c087a409 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:23.877384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef82412-b6dd-457c-b239-29e9c087a409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:23.878859 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef82412-b6dd-457c-b239-29e9c087a409 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:23.881056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948e71c-fd86-48b5-b148-74b955b61344 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:23.895745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-cef82412-b6dd-457c-b239-29e9c087a409 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:23.895745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:23.895745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:23.895745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:23.895745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:23.895745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:23.895745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:23.895745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:23.895745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:23.895745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:23.895745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:23.895745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:23.895745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:23.895745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:23.895745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:23.896772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:23.896772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:23.896772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:23.896772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:23.896772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:23.896772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:23.896772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:23.896772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:23.896772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:23.896772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:23.896772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:23.896772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:23.896772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:23.896772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:23.896772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:23.896772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:23.896772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:23.897753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:23.897753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:23.897753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:23.897753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:23.897753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 246/507] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:23.898013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef82412-b6dd-457c-b239-29e9c087a409 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:23.917136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df6c37-6cfe-4c35-8939-d9cd4ec2d865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:23.917898 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df6c37-6cfe-4c35-8939-d9cd4ec2d865 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:23.918235 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df6c37-6cfe-4c35-8939-d9cd4ec2d865 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:23.918562 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df6c37-6cfe-4c35-8939-d9cd4ec2d865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:23.981578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df6c37-6cfe-4c35-8939-d9cd4ec2d865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:23.983059 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df6c37-6cfe-4c35-8939-d9cd4ec2d865 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:23.997069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef82412-b6dd-457c-b239-29e9c087a409 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:24.029764 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00063ada-da12-4de2-8a31-57e78b8efd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:24.030348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00063ada-da12-4de2-8a31-57e78b8efd1c None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:24.030622 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00063ada-da12-4de2-8a31-57e78b8efd1c None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:24.030894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00063ada-da12-4de2-8a31-57e78b8efd1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:24.076023 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 262/508] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:24.076947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df6c37-6cfe-4c35-8939-d9cd4ec2d865 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:24.094877 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00063ada-da12-4de2-8a31-57e78b8efd1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:24.096364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00063ada-da12-4de2-8a31-57e78b8efd1c None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:24.173373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df6c37-6cfe-4c35-8939-d9cd4ec2d865 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:24.190004 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 247/509] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:24.190827 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00063ada-da12-4de2-8a31-57e78b8efd1c None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:24.210924 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685533a6-4b8c-4f40-ada9-9f941dd3d05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:24.211615 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685533a6-4b8c-4f40-ada9-9f941dd3d05b None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:24.211896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685533a6-4b8c-4f40-ada9-9f941dd3d05b None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:24.212168 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685533a6-4b8c-4f40-ada9-9f941dd3d05b None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:24.212888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685533a6-4b8c-4f40-ada9-9f941dd3d05b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:24.213266 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685533a6-4b8c-4f40-ada9-9f941dd3d05b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:24.214820 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685533a6-4b8c-4f40-ada9-9f941dd3d05b None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:24.225887 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 263/510] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:24.226661 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685533a6-4b8c-4f40-ada9-9f941dd3d05b None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:24.288949 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00063ada-da12-4de2-8a31-57e78b8efd1c None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:24.319383 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685533a6-4b8c-4f40-ada9-9f941dd3d05b None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:24.320298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819ba33-eec3-4901-b1f5-47eb615df722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:24.320948 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819ba33-eec3-4901-b1f5-47eb615df722 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:24.321232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819ba33-eec3-4901-b1f5-47eb615df722 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:24.321498 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819ba33-eec3-4901-b1f5-47eb615df722 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:24.322237 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819ba33-eec3-4901-b1f5-47eb615df722 None admin] RBAC: Adding query filter params (name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:24.322573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819ba33-eec3-4901-b1f5-47eb615df722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:24.323987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819ba33-eec3-4901-b1f5-47eb615df722 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:24.331584 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 248/511] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:33:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:24.332360 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819ba33-eec3-4901-b1f5-47eb615df722 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:24.353066 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4e57f-0dbc-4366-b96c-e27050404fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:24.353883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4e57f-0dbc-4366-b96c-e27050404fb4 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:24.354196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4e57f-0dbc-4366-b96c-e27050404fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:24.354469 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4e57f-0dbc-4366-b96c-e27050404fb4 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:24.355218 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4e57f-0dbc-4366-b96c-e27050404fb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:24.355520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4e57f-0dbc-4366-b96c-e27050404fb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:24.356881 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4e57f-0dbc-4366-b96c-e27050404fb4 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:24.367859 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 264/512] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:24.368699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4e57f-0dbc-4366-b96c-e27050404fb4 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:24.425932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819ba33-eec3-4901-b1f5-47eb615df722 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:24.457081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930b77e-5b8b-4c54-8d78-c13d36f9a2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:24.457866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930b77e-5b8b-4c54-8d78-c13d36f9a2dd None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:24.458148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930b77e-5b8b-4c54-8d78-c13d36f9a2dd None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:24.458420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930b77e-5b8b-4c54-8d78-c13d36f9a2dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:24.461509 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4e57f-0dbc-4366-b96c-e27050404fb4 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:24.469413 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930b77e-5b8b-4c54-8d78-c13d36f9a2dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:24.470854 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930b77e-5b8b-4c54-8d78-c13d36f9a2dd None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:24.488106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-b930b77e-5b8b-4c54-8d78-c13d36f9a2dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:24.488106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:24.488106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:24.488106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:24.488106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:24.488106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:24.488106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:24.488106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:24.488106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:24.488106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:24.488106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:24.488106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:24.488106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:24.488106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:24.488106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:24.488974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:24.488974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:24.488974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:24.488974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:24.488974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:24.488974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:24.488974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:24.488974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:24.488974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:24.488974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:24.488974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:24.488974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:24.488974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:24.488974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:24.488974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:24.488974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:24.488974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:24.489990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:24.489990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:24.489990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:24.489990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:24.489990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 249/513] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:24.489990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930b77e-5b8b-4c54-8d78-c13d36f9a2dd None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:24.499287 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97afa8-6f35-4239-a734-1817791970f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:24.500068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97afa8-6f35-4239-a734-1817791970f9 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:24.500346 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97afa8-6f35-4239-a734-1817791970f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:24.500618 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97afa8-6f35-4239-a734-1817791970f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:24.512134 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97afa8-6f35-4239-a734-1817791970f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:24.513618 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97afa8-6f35-4239-a734-1817791970f9 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:24.533453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-1f97afa8-6f35-4239-a734-1817791970f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:24.533453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:24.533453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:24.533453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:24.533453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:24.533453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:24.533453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:24.533453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:24.533453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:24.533453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:24.533453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:24.533453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:24.533453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:24.533453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:24.533453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:24.534376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:24.534376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:24.534376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:24.534376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:24.534376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:24.534376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:24.534376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:24.534376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:24.534376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:24.534376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:24.534376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:24.534376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:24.534376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:24.534376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:24.534376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:24.534376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:24.534376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:24.535238 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:24.535238 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:24.535238 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:24.535238 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:24.535238 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 265/514] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:24.535506 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97afa8-6f35-4239-a734-1817791970f9 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:24.620965 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930b77e-5b8b-4c54-8d78-c13d36f9a2dd None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:24.654438 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97afa8-6f35-4239-a734-1817791970f9 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:24.664082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d503f7c-a7be-4eed-9640-66c4e23e4551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:24.664883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d503f7c-a7be-4eed-9640-66c4e23e4551 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:24.665166 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d503f7c-a7be-4eed-9640-66c4e23e4551 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:24.665440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d503f7c-a7be-4eed-9640-66c4e23e4551 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:24.673111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d503f7c-a7be-4eed-9640-66c4e23e4551 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:24.674565 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d503f7c-a7be-4eed-9640-66c4e23e4551 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:24.687900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ac672-744e-4b88-b4f0-4bb72bac7334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:24.688564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-5d503f7c-a7be-4eed-9640-66c4e23e4551 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 21:33:24.688564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:24.688564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:24.688564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:24.688564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:24.688564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:24.688564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:24.688564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:24.688564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:24.688564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:24.688564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:24.688564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:24.688564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:24.688564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:24.688564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:24.688564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:24.689468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:24.689468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:24.689468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:24.689468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:24.689468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:24.689468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:24.689468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:24.689468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:24.689468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:24.689468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:24.689468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:24.689468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:24.689468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:24.689468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:24.689468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:24.689468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:24.689468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:24.689468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:24.695375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:24.695375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:24.695375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:24.695375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:24.695375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:24.695375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:24.695375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:24.695375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:24.695375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 21:33:24.695375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:24.695890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ac672-744e-4b88-b4f0-4bb72bac7334 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:24.695890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ac672-744e-4b88-b4f0-4bb72bac7334 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:24.695890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ac672-744e-4b88-b4f0-4bb72bac7334 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:24.696079 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 250/515] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:24.696079 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d503f7c-a7be-4eed-9640-66c4e23e4551 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:24.700014 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ac672-744e-4b88-b4f0-4bb72bac7334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:24.701478 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ac672-744e-4b88-b4f0-4bb72bac7334 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:24.718078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-a56ac672-744e-4b88-b4f0-4bb72bac7334 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:24.718078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:24.718078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:24.718078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:24.718078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:24.718078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:24.718078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:24.718078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:24.718078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:24.718078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:24.718078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:24.718078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:24.718078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:24.718078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:24.718078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:24.718906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:24.718906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:24.718906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:24.718906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:24.718906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:24.718906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:24.718906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:24.718906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:24.718906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:24.718906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:24.718906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:24.718906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:24.718906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:24.718906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:24.718906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:24.718906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:24.718906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:24.719827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:24.719827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:24.719827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:24.719827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:24.719827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 266/516] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:24.720079 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ac672-744e-4b88-b4f0-4bb72bac7334 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:24.791226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d503f7c-a7be-4eed-9640-66c4e23e4551 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:24.813750 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ac672-744e-4b88-b4f0-4bb72bac7334 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:24.824031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ddd58-7170-4047-8b70-e4e8c6dfb83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:24.824701 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ddd58-7170-4047-8b70-e4e8c6dfb83e None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:24.824980 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ddd58-7170-4047-8b70-e4e8c6dfb83e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:24.825243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ddd58-7170-4047-8b70-e4e8c6dfb83e None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:24.825944 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ddd58-7170-4047-8b70-e4e8c6dfb83e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:24.827417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ddd58-7170-4047-8b70-e4e8c6dfb83e None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:24.854400 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 251/517] 10.222.0.11 () {60 vars in 1132 bytes} [Wed May 4 21:33:24 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:33:24.854643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5b660-95d6-43b8-8b1b-81cc181cdbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:24.854771 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ddd58-7170-4047-8b70-e4e8c6dfb83e None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:24.854848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5b660-95d6-43b8-8b1b-81cc181cdbb8 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:24.854848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5b660-95d6-43b8-8b1b-81cc181cdbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:24.854848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5b660-95d6-43b8-8b1b-81cc181cdbb8 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:24.854848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5b660-95d6-43b8-8b1b-81cc181cdbb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:24.854848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5b660-95d6-43b8-8b1b-81cc181cdbb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:24.854848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5b660-95d6-43b8-8b1b-81cc181cdbb8 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:24.865033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 267/518] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:24.870693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5b660-95d6-43b8-8b1b-81cc181cdbb8 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:24.960080 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ddd58-7170-4047-8b70-e4e8c6dfb83e None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:24.973135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5b660-95d6-43b8-8b1b-81cc181cdbb8 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:24.995152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ac9c1-2e73-4dfe-9a00-855edf2c7c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:24.995835 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ac9c1-2e73-4dfe-9a00-855edf2c7c5f None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:24.996115 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ac9c1-2e73-4dfe-9a00-855edf2c7c5f None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:24.996389 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ac9c1-2e73-4dfe-9a00-855edf2c7c5f None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:24.997112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ac9c1-2e73-4dfe-9a00-855edf2c7c5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:24.997647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ac9c1-2e73-4dfe-9a00-855edf2c7c5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:24.999070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ac9c1-2e73-4dfe-9a00-855edf2c7c5f None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:25.009198 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a616b9-97d1-42f0-b61e-7845ff32e631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:25.009966 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a616b9-97d1-42f0-b61e-7845ff32e631 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:25.010253 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a616b9-97d1-42f0-b61e-7845ff32e631 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:25.010530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a616b9-97d1-42f0-b61e-7845ff32e631 None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:25.011426 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a616b9-97d1-42f0-b61e-7845ff32e631 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:25.011802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a616b9-97d1-42f0-b61e-7845ff32e631 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:25.013277 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a616b9-97d1-42f0-b61e-7845ff32e631 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:25.015903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 252/519] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:25.016999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ac9c1-2e73-4dfe-9a00-855edf2c7c5f None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:25.038453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 268/520] 10.222.0.11 () {56 vars in 1137 bytes} [Wed May 4 21:33:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:25.038453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a616b9-97d1-42f0-b61e-7845ff32e631 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:25.123018 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ac9c1-2e73-4dfe-9a00-855edf2c7c5f None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:25.148276 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a616b9-97d1-42f0-b61e-7845ff32e631 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:25.155295 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d0423-71d4-4f78-815d-df90fb515d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:25.155969 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d0423-71d4-4f78-815d-df90fb515d15 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:25.156253 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d0423-71d4-4f78-815d-df90fb515d15 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:25.156526 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d0423-71d4-4f78-815d-df90fb515d15 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:25.157243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d0423-71d4-4f78-815d-df90fb515d15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:25.157546 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d0423-71d4-4f78-815d-df90fb515d15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:25.158929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d0423-71d4-4f78-815d-df90fb515d15 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:25.174312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 253/521] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:25.174312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d0423-71d4-4f78-815d-df90fb515d15 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:25.195786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02ea60-e71d-408e-af72-eba6d23a8e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:25.196687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02ea60-e71d-408e-af72-eba6d23a8e2a None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:25.197013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02ea60-e71d-408e-af72-eba6d23a8e2a None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:25.197665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02ea60-e71d-408e-af72-eba6d23a8e2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:25.204675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02ea60-e71d-408e-af72-eba6d23a8e2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:25.206231 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02ea60-e71d-408e-af72-eba6d23a8e2a None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:25.220679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-fb02ea60-e71d-408e-af72-eba6d23a8e2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:25.220679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:25.220679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:25.220679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:25.220679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:25.220679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:25.220679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:25.220679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:25.220679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:25.220679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:25.220679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:25.220679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:25.220679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:25.220679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:25.220679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:25.221598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:25.221598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:25.221598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:25.221598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:25.221598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:25.221598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:25.221598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:25.221598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:25.221598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:25.221598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:25.221598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:25.221598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:25.221598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:25.221598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:25.221598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:25.221598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:25.221598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:25.222428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:25.222428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:25.222428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:25.222428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:25.222428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:25.222428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:25.222428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:25.222428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:25.222428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 269/522] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:25.222901 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02ea60-e71d-408e-af72-eba6d23a8e2a None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:25.275091 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d0423-71d4-4f78-815d-df90fb515d15 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:25.306726 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed6a3d-50c4-4b68-a029-fd7bf30e4939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:25.307565 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed6a3d-50c4-4b68-a029-fd7bf30e4939 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:25.307853 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed6a3d-50c4-4b68-a029-fd7bf30e4939 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:25.308121 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed6a3d-50c4-4b68-a029-fd7bf30e4939 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:25.315531 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed6a3d-50c4-4b68-a029-fd7bf30e4939 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:25.317133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed6a3d-50c4-4b68-a029-fd7bf30e4939 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:25.326248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02ea60-e71d-408e-af72-eba6d23a8e2a None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:25.331420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-23ed6a3d-50c4-4b68-a029-fd7bf30e4939 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:25.331420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:25.331420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:25.331420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:25.331420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:25.331420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:25.331420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:25.331420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:25.331420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:25.331420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:25.331420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:25.331420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:25.331420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:25.331420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:25.331420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:25.332403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:25.332403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:25.332403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:25.332403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:25.332403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:25.332403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:25.332403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:25.332403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:25.332403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:25.332403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:25.332403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:25.332403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:25.332403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:25.332403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:25.332403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:25.332403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:25.332403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:25.333436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:25.333436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:25.333436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:25.333436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:25.333436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:25.333436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:25.333436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:25.333436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:25.335374 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 254/523] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:25.336378 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed6a3d-50c4-4b68-a029-fd7bf30e4939 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:25.363418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e02536-ec10-47e4-ae51-71c0a5e97e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:25.364559 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e02536-ec10-47e4-ae51-71c0a5e97e2e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:25.365016 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e02536-ec10-47e4-ae51-71c0a5e97e2e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:25.365570 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e02536-ec10-47e4-ae51-71c0a5e97e2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:25.431782 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed6a3d-50c4-4b68-a029-fd7bf30e4939 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:25.432859 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e02536-ec10-47e4-ae51-71c0a5e97e2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:25.434424 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e02536-ec10-47e4-ae51-71c0a5e97e2e None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:25.466563 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080d673-929f-4f5b-829f-2cfa407f63ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:25.467576 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080d673-929f-4f5b-829f-2cfa407f63ff None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:25.467956 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080d673-929f-4f5b-829f-2cfa407f63ff None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:25.468328 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080d673-929f-4f5b-829f-2cfa407f63ff None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:25.475773 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080d673-929f-4f5b-829f-2cfa407f63ff None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:25.477216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080d673-929f-4f5b-829f-2cfa407f63ff None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:25.492414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-c080d673-929f-4f5b-829f-2cfa407f63ff None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 21:33:25.492414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:25.492414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:25.492414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:25.492414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:25.492414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:25.492414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:25.492414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:25.492414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:25.492414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:25.492414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:25.492414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:25.492414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:25.492414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:25.492414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:25.492414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:25.493494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:25.493494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:25.493494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:25.493494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:25.493494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:25.493494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:25.493494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:25.493494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:25.493494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:25.493494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:25.493494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:25.493494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:25.493494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:25.493494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:25.493494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:25.493494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:25.493494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:25.493494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:25.495187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:25.495187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:25.495187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:25.495187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:25.495187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:25.495187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:25.495187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:25.495187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:25.495187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 21:33:25.495187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:25.495187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 255/524] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:25.495187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080d673-929f-4f5b-829f-2cfa407f63ff None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:25.534767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 270/525] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:25.535849 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e02536-ec10-47e4-ae51-71c0a5e97e2e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:25.601681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080d673-929f-4f5b-829f-2cfa407f63ff None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:25.633403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c438f66-234d-4af8-a547-30a5d15aae66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:25.634063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c438f66-234d-4af8-a547-30a5d15aae66 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:25.634342 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c438f66-234d-4af8-a547-30a5d15aae66 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:25.634613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c438f66-234d-4af8-a547-30a5d15aae66 None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:25.635460 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c438f66-234d-4af8-a547-30a5d15aae66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:25.635801 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c438f66-234d-4af8-a547-30a5d15aae66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:25.636770 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e02536-ec10-47e4-ae51-71c0a5e97e2e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:25.637215 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c438f66-234d-4af8-a547-30a5d15aae66 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:25.659107 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 256/526] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:25.659107 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c438f66-234d-4af8-a547-30a5d15aae66 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:25.671150 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cc3ee-8d5d-4afd-9a1a-32d6d58f14bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:25.671833 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cc3ee-8d5d-4afd-9a1a-32d6d58f14bf None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:25.672107 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cc3ee-8d5d-4afd-9a1a-32d6d58f14bf None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:25.672384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cc3ee-8d5d-4afd-9a1a-32d6d58f14bf None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:25.673169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cc3ee-8d5d-4afd-9a1a-32d6d58f14bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:25.673488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cc3ee-8d5d-4afd-9a1a-32d6d58f14bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:25.674941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cc3ee-8d5d-4afd-9a1a-32d6d58f14bf None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:25.694585 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 271/527] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:25.694585 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cc3ee-8d5d-4afd-9a1a-32d6d58f14bf None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:25.758769 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c438f66-234d-4af8-a547-30a5d15aae66 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:25.792620 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26663e67-3c9e-405b-97db-ceaae46bc9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:25.793301 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26663e67-3c9e-405b-97db-ceaae46bc9f2 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:25.793588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26663e67-3c9e-405b-97db-ceaae46bc9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:25.793869 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26663e67-3c9e-405b-97db-ceaae46bc9f2 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:25.794715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26663e67-3c9e-405b-97db-ceaae46bc9f2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:25.795193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26663e67-3c9e-405b-97db-ceaae46bc9f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:25.796508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26663e67-3c9e-405b-97db-ceaae46bc9f2 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:25.797843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cc3ee-8d5d-4afd-9a1a-32d6d58f14bf None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:25.819828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 257/528] 10.222.0.11 () {56 vars in 1139 bytes} [Wed May 4 21:33:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:25.820983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26663e67-3c9e-405b-97db-ceaae46bc9f2 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:25.842850 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aad103-454f-4ae6-a540-4a0ed2d0e25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:25.843689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aad103-454f-4ae6-a540-4a0ed2d0e25f None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:25.843974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aad103-454f-4ae6-a540-4a0ed2d0e25f None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:25.844252 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aad103-454f-4ae6-a540-4a0ed2d0e25f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:25.854894 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aad103-454f-4ae6-a540-4a0ed2d0e25f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:25.856441 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aad103-454f-4ae6-a540-4a0ed2d0e25f None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:25.874723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-b6aad103-454f-4ae6-a540-4a0ed2d0e25f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:25.874723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:25.874723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:25.874723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:25.874723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:25.874723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:25.874723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:25.874723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:25.874723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:25.874723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:25.874723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:25.874723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:25.874723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:25.874723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:25.874723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:25.875645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:25.875645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:25.875645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:25.875645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:25.875645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:25.875645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:25.875645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:25.875645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:25.875645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:25.875645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:25.875645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:25.875645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:25.875645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:25.875645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:25.875645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:25.875645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:25.875645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:25.876481 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:25.876481 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:25.876481 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:25.876481 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:25.876481 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 272/529] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:25.877240 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aad103-454f-4ae6-a540-4a0ed2d0e25f None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:25.923467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26663e67-3c9e-405b-97db-ceaae46bc9f2 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:25.960608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b6e3a-2ece-4ad1-b699-83126a5d55d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:25.961187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b6e3a-2ece-4ad1-b699-83126a5d55d6 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:25.961472 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b6e3a-2ece-4ad1-b699-83126a5d55d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:25.961748 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b6e3a-2ece-4ad1-b699-83126a5d55d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:25.962605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b6e3a-2ece-4ad1-b699-83126a5d55d6 None admin] RBAC: Adding query filter params (role.id=c1ee07ef1a1f4986afc3af5a357e2c4c, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=b9a86016cde040e7b8a9eeaf34cf0715) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:25.963031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b6e3a-2ece-4ad1-b699-83126a5d55d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:25.964676 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b6e3a-2ece-4ad1-b699-83126a5d55d6 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:25.979305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 258/530] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:33:25 2022] GET /identity/v3/role_assignments?user.id=b9a86016cde040e7b8a9eeaf34cf0715&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=c1ee07ef1a1f4986afc3af5a357e2c4c => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:25.979305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b6e3a-2ece-4ad1-b699-83126a5d55d6 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:25.982140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aad103-454f-4ae6-a540-4a0ed2d0e25f None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:26.021045 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ca01f-840f-4b44-9ccd-c3cb44b66162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:26.021724 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ca01f-840f-4b44-9ccd-c3cb44b66162 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:26.022011 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ca01f-840f-4b44-9ccd-c3cb44b66162 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:26.022290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ca01f-840f-4b44-9ccd-c3cb44b66162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:26.023182 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ca01f-840f-4b44-9ccd-c3cb44b66162 None admin] RBAC: Adding query filter params (role.id=c1ee07ef1a1f4986afc3af5a357e2c4c, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=f4f207481ccb4cfcbbcffd9df73d2985) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:26.023500 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ca01f-840f-4b44-9ccd-c3cb44b66162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:26.024999 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ca01f-840f-4b44-9ccd-c3cb44b66162 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:26.039073 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 273/531] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:33:25 2022] GET /identity/v3/role_assignments?user.id=f4f207481ccb4cfcbbcffd9df73d2985&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=c1ee07ef1a1f4986afc3af5a357e2c4c => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:26.039073 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ca01f-840f-4b44-9ccd-c3cb44b66162 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:26.164902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b6e3a-2ece-4ad1-b699-83126a5d55d6 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:26.222918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f7ed1-6902-4217-89e6-d12ac6f59a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:26.223537 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f7ed1-6902-4217-89e6-d12ac6f59a21 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:26.224138 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f7ed1-6902-4217-89e6-d12ac6f59a21 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:26.224413 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f7ed1-6902-4217-89e6-d12ac6f59a21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:26.247285 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ca01f-840f-4b44-9ccd-c3cb44b66162 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:26.291442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb00f1-2a3c-4d78-ba95-08d67109c7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:26.292762 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb00f1-2a3c-4d78-ba95-08d67109c7c2 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:26.293226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb00f1-2a3c-4d78-ba95-08d67109c7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:26.293694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb00f1-2a3c-4d78-ba95-08d67109c7c2 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:26.294595 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb00f1-2a3c-4d78-ba95-08d67109c7c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:26.295508 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb00f1-2a3c-4d78-ba95-08d67109c7c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:26.297418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb00f1-2a3c-4d78-ba95-08d67109c7c2 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:26.313398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 274/532] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:26.314251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f7ed1-6902-4217-89e6-d12ac6f59a21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:26.315804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f7ed1-6902-4217-89e6-d12ac6f59a21 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:26.319223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb00f1-2a3c-4d78-ba95-08d67109c7c2 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:26.466572 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb00f1-2a3c-4d78-ba95-08d67109c7c2 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:26.512172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76c7ec-6c78-4771-ab35-d54fe5a5128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:26.512913 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76c7ec-6c78-4771-ab35-d54fe5a5128a None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:26.513200 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76c7ec-6c78-4771-ab35-d54fe5a5128a None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:26.513475 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76c7ec-6c78-4771-ab35-d54fe5a5128a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:26.516884 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 259/533] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:26.528284 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76c7ec-6c78-4771-ab35-d54fe5a5128a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:26.529760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76c7ec-6c78-4771-ab35-d54fe5a5128a None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:26.540527 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f7ed1-6902-4217-89e6-d12ac6f59a21 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:26.555571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-9e76c7ec-6c78-4771-ab35-d54fe5a5128a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:26.555571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:26.555571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:26.555571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:26.555571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:26.555571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:26.555571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:26.555571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:26.555571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:26.555571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:26.555571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:26.555571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:26.555571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:26.555571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:26.555571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:26.556466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:26.556466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:26.556466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:26.556466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:26.556466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:26.556466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:26.556466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:26.556466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:26.556466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:26.556466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:26.556466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:26.556466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:26.556466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:26.556466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:26.556466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:26.556466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:26.556466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:26.557502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:26.557502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:26.557502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:26.557502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:26.557502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:26.557502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:26.557502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:26.557502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:26.563939 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 275/534] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:33:26.570343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76c7ec-6c78-4771-ab35-d54fe5a5128a None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:26.681288 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76c7ec-6c78-4771-ab35-d54fe5a5128a None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:26.726082 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc782b4-a5f1-42f1-814f-dae1f5a28309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:26.726758 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc782b4-a5f1-42f1-814f-dae1f5a28309 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:26.727059 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc782b4-a5f1-42f1-814f-dae1f5a28309 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:26.727342 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc782b4-a5f1-42f1-814f-dae1f5a28309 None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:26.728573 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc782b4-a5f1-42f1-814f-dae1f5a28309 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:26.729465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc782b4-a5f1-42f1-814f-dae1f5a28309 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:26.730924 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc782b4-a5f1-42f1-814f-dae1f5a28309 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:26.750525 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f7ed1-6902-4217-89e6-d12ac6f59a21 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:26.754246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 276/535] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:26.759895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc782b4-a5f1-42f1-814f-dae1f5a28309 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:26.794719 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4de4c1-5b76-4ef4-a2d9-d9def4c0cfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:26.796847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4de4c1-5b76-4ef4-a2d9-d9def4c0cfc0 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:26.797688 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4de4c1-5b76-4ef4-a2d9-d9def4c0cfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:26.798873 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4de4c1-5b76-4ef4-a2d9-d9def4c0cfc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:26.820576 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4de4c1-5b76-4ef4-a2d9-d9def4c0cfc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:26.822445 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4de4c1-5b76-4ef4-a2d9-d9def4c0cfc0 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:26.864436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-dc4de4c1-5b76-4ef4-a2d9-d9def4c0cfc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:26.864436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:26.864436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:26.864436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:26.864436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:26.864436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:26.864436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:26.864436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:26.864436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:26.864436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:26.864436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:26.864436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:26.864436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:26.864436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:26.864436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:26.865358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:26.865358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:26.865358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:26.865358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:26.865358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:26.865358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:26.865358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:26.865358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:26.865358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:26.865358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:26.865358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:26.865358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:26.865358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:26.865358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:26.865358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:26.865358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:26.865358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:26.866295 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:26.866295 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:26.866295 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:26.866295 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:26.866295 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 260/536] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:33:26.872360 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4de4c1-5b76-4ef4-a2d9-d9def4c0cfc0 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:26.897517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc782b4-a5f1-42f1-814f-dae1f5a28309 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:26.932047 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3f23f-db9c-4558-8e4a-e8f7c4cc7623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:26.933110 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3f23f-db9c-4558-8e4a-e8f7c4cc7623 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:26.933611 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3f23f-db9c-4558-8e4a-e8f7c4cc7623 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:26.934104 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3f23f-db9c-4558-8e4a-e8f7c4cc7623 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:26.935169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3f23f-db9c-4558-8e4a-e8f7c4cc7623 None admin] RBAC: Adding query filter params (role.id=c1ee07ef1a1f4986afc3af5a357e2c4c, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=c61205d7e96f496ab9f8ca84ab9408b4) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:26.935697 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3f23f-db9c-4558-8e4a-e8f7c4cc7623 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:26.937396 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3f23f-db9c-4558-8e4a-e8f7c4cc7623 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:26.943978 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 277/537] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:33:26 2022] GET /identity/v3/role_assignments?user.id=c61205d7e96f496ab9f8ca84ab9408b4&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=c1ee07ef1a1f4986afc3af5a357e2c4c => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:26.985261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4de4c1-5b76-4ef4-a2d9-d9def4c0cfc0 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:27.020948 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19aa47-8c9d-4f53-a336-2a648cb7f9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:27.021621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19aa47-8c9d-4f53-a336-2a648cb7f9eb None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:27.021901 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19aa47-8c9d-4f53-a336-2a648cb7f9eb None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:27.022172 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19aa47-8c9d-4f53-a336-2a648cb7f9eb None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:27.022890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19aa47-8c9d-4f53-a336-2a648cb7f9eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:27.023224 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19aa47-8c9d-4f53-a336-2a648cb7f9eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:27.024614 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19aa47-8c9d-4f53-a336-2a648cb7f9eb None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:27.036605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 261/538] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:27.041848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3f23f-db9c-4558-8e4a-e8f7c4cc7623 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:27.191856 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3f23f-db9c-4558-8e4a-e8f7c4cc7623 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:27.232193 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709598b-fa4d-41f9-a2e0-ba3734c7fb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:27.233009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709598b-fa4d-41f9-a2e0-ba3734c7fb5a None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:27.233336 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709598b-fa4d-41f9-a2e0-ba3734c7fb5a None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:27.233616 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709598b-fa4d-41f9-a2e0-ba3734c7fb5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:27.240794 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709598b-fa4d-41f9-a2e0-ba3734c7fb5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:27.242245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709598b-fa4d-41f9-a2e0-ba3734c7fb5a None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:27.265169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-d709598b-fa4d-41f9-a2e0-ba3734c7fb5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:27.265169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:27.265169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:27.265169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:27.265169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:27.265169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:27.265169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:27.265169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:27.265169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:27.265169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:27.265169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:27.265169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:27.265169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:27.265169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:27.265169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:27.266061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:27.266061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:27.266061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:27.266061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:27.266061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:27.266061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:27.266061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:27.266061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:27.266061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:27.266061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:27.266061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:27.266061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:27.266061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:27.266061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:27.266061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:27.266061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:27.266061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:27.266900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:27.266900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:27.266900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:27.266900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:27.266900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:27.266900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:27.266900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:27.266900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:27.266900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 278/539] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:27.272012 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19aa47-8c9d-4f53-a336-2a648cb7f9eb None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:27.355070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403c4d-0653-4624-a419-9a74e24c8506 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:27.355397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403c4d-0653-4624-a419-9a74e24c8506 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:27.355659 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403c4d-0653-4624-a419-9a74e24c8506 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:27.357289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 279/540] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:27.362260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72010217-86b2-4fa1-bffd-0a4487477de1 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:27.362552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72010217-86b2-4fa1-bffd-0a4487477de1 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:27.362833 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72010217-86b2-4fa1-bffd-0a4487477de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:27.380220 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-72010217-86b2-4fa1-bffd-0a4487477de1 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:27.380674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19aa47-8c9d-4f53-a336-2a648cb7f9eb None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:27.381412 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-72010217-86b2-4fa1-bffd-0a4487477de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:27.434726 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a152ca7-d9db-42c2-9dc3-5953ac816f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:27.435436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a152ca7-d9db-42c2-9dc3-5953ac816f99 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:27.435762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a152ca7-d9db-42c2-9dc3-5953ac816f99 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:27.436039 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a152ca7-d9db-42c2-9dc3-5953ac816f99 None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:27.436892 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a152ca7-d9db-42c2-9dc3-5953ac816f99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:27.437203 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a152ca7-d9db-42c2-9dc3-5953ac816f99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:27.438655 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a152ca7-d9db-42c2-9dc3-5953ac816f99 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:27.451762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 262/541] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:27.457290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a152ca7-d9db-42c2-9dc3-5953ac816f99 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:27.488787 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 280/542] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:33:27.573395 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72010217-86b2-4fa1-bffd-0a4487477de1 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:27.575896 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a152ca7-d9db-42c2-9dc3-5953ac816f99 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:27.612796 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a55432-9583-49f3-a87a-71d4c248f2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:27.613628 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a55432-9583-49f3-a87a-71d4c248f2a2 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:27.613914 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a55432-9583-49f3-a87a-71d4c248f2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:27.614194 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a55432-9583-49f3-a87a-71d4c248f2a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:27.615098 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a55432-9583-49f3-a87a-71d4c248f2a2 None admin] RBAC: Adding query filter params (role.id=c1ee07ef1a1f4986afc3af5a357e2c4c, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=e4e5d4fe283447c59672398a26dea225) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:27.615558 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a55432-9583-49f3-a87a-71d4c248f2a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:27.617451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a55432-9583-49f3-a87a-71d4c248f2a2 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:27.627066 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 263/543] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:33:27 2022] GET /identity/v3/role_assignments?user.id=e4e5d4fe283447c59672398a26dea225&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=c1ee07ef1a1f4986afc3af5a357e2c4c => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:27.771701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72010217-86b2-4fa1-bffd-0a4487477de1 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:27.824944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a822ac-e594-4551-a0b4-b4dba74c707c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:27.825798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a822ac-e594-4551-a0b4-b4dba74c707c None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:27.826077 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a822ac-e594-4551-a0b4-b4dba74c707c None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:27.826346 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a822ac-e594-4551-a0b4-b4dba74c707c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:27.847960 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a822ac-e594-4551-a0b4-b4dba74c707c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:27.856158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-e6a822ac-e594-4551-a0b4-b4dba74c707c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:27.856158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:27.856158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:27.856158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:27.856158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:27.856158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:27.856158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:27.856158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:27.856158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:27.856158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:27.856158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:27.856158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:27.856158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:27.856158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:27.856158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:27.856158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:27.858202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:27.858202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:27.858202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:27.858202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:27.858202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:27.858202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:27.858202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:27.858202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:27.858202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:27.858202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:27.858202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:27.858202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:27.858202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:27.858202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:27.858202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:27.858202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:27.860139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:27.860139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:27.860139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:27.860139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:27.860139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:27.860139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:27.860139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:27.860139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:27.860139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:27.860139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:27.860139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:27.860139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:27.866043 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 281/544] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:27.867326 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a55432-9583-49f3-a87a-71d4c248f2a2 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:27.989363 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a55432-9583-49f3-a87a-71d4c248f2a2 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:28.023315 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed05cb-d570-4b25-b1d9-4e5272c48532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:28.023908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed05cb-d570-4b25-b1d9-4e5272c48532 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:28.024191 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed05cb-d570-4b25-b1d9-4e5272c48532 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:28.024468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed05cb-d570-4b25-b1d9-4e5272c48532 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:28.025217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed05cb-d570-4b25-b1d9-4e5272c48532 None admin] RBAC: Adding query filter params (name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:28.025587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed05cb-d570-4b25-b1d9-4e5272c48532 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:28.026952 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed05cb-d570-4b25-b1d9-4e5272c48532 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:28.036026 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 264/545] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:33:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:28.042294 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a822ac-e594-4551-a0b4-b4dba74c707c None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:28.158779 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a822ac-e594-4551-a0b4-b4dba74c707c None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:28.199285 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdac029-515a-4f72-bdca-b896163f43d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:28.200098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdac029-515a-4f72-bdca-b896163f43d7 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:28.200385 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdac029-515a-4f72-bdca-b896163f43d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:28.200668 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdac029-515a-4f72-bdca-b896163f43d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:28.211499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdac029-515a-4f72-bdca-b896163f43d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:28.213008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdac029-515a-4f72-bdca-b896163f43d7 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:28.241454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-0cdac029-515a-4f72-bdca-b896163f43d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:28.241454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:28.241454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:28.241454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:28.241454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:28.241454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:28.241454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:28.241454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:28.241454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:28.241454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:28.241454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:28.241454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:28.241454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:28.241454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:28.241454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:28.243560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:28.243560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:28.243560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:28.243560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:28.243560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:28.243560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:28.243560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:28.243560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:28.243560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:28.243560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:28.243560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:28.243560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:28.243560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:28.243560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:28.243560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:28.243560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:28.243560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:28.245602 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:28.245602 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:28.245602 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:28.245602 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:28.245602 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 282/546] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:28.251784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed05cb-d570-4b25-b1d9-4e5272c48532 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:28.425898 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed05cb-d570-4b25-b1d9-4e5272c48532 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:28.473607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9787e0e-982c-4d6a-be2a-7d61f7fd0f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:28.474600 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9787e0e-982c-4d6a-be2a-7d61f7fd0f30 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:28.474879 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9787e0e-982c-4d6a-be2a-7d61f7fd0f30 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:28.475177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9787e0e-982c-4d6a-be2a-7d61f7fd0f30 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:28.475911 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9787e0e-982c-4d6a-be2a-7d61f7fd0f30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:28.476214 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9787e0e-982c-4d6a-be2a-7d61f7fd0f30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:28.477614 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9787e0e-982c-4d6a-be2a-7d61f7fd0f30 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:28.497825 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 265/547] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:28.503466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdac029-515a-4f72-bdca-b896163f43d7 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:28.626745 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdac029-515a-4f72-bdca-b896163f43d7 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:28.670502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efb4bb-beef-4511-bfcf-fcd6c60b4e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:28.671338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efb4bb-beef-4511-bfcf-fcd6c60b4e37 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:28.671627 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efb4bb-beef-4511-bfcf-fcd6c60b4e37 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:28.671907 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efb4bb-beef-4511-bfcf-fcd6c60b4e37 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:28.679865 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74efb4bb-beef-4511-bfcf-fcd6c60b4e37 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:28.681259 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74efb4bb-beef-4511-bfcf-fcd6c60b4e37 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:28.698794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c9d5a-a3d1-4071-8bfb-00c1956527ed None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:28.699442 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c9d5a-a3d1-4071-8bfb-00c1956527ed None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:28.699931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c9d5a-a3d1-4071-8bfb-00c1956527ed None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:28.703068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-74efb4bb-beef-4511-bfcf-fcd6c60b4e37 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 21:33:28.703068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:28.703068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:28.703068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:28.703068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:28.703068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:28.703068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:28.703068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:28.703068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:28.703068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:28.703068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:28.703068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:28.703068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:28.703068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:28.703068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:28.703068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:28.704194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:28.704194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:28.704194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:28.704194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:28.704194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:28.704194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:28.704194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:28.704194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:28.704194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:28.704194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:28.704194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:28.704194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:28.704194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:28.704194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:28.704194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:28.704194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:28.704194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:28.704194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:28.708212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:28.708212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:28.708212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:28.708212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:28.708212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:28.708212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:28.708212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:28.708212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:28.708212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 21:33:28.708212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:28.708212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 283/549] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:33:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:28.708212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc57dc6-d2c8-4a34-80fb-3adc18947273 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:28.708212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc57dc6-d2c8-4a34-80fb-3adc18947273 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:28.708908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc57dc6-d2c8-4a34-80fb-3adc18947273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:28.708973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 266/549] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:33:28.709436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c9d5a-a3d1-4071-8bfb-00c1956527ed None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:28.741627 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-4dc57dc6-d2c8-4a34-80fb-3adc18947273 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:28.745267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-4dc57dc6-d2c8-4a34-80fb-3adc18947273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:28.881722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 284/550] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:28.904714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c9d5a-a3d1-4071-8bfb-00c1956527ed None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:28.920642 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5de6bd-5e87-4079-a8fc-8e31aa02b984 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:28.920959 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5de6bd-5e87-4079-a8fc-8e31aa02b984 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:28.921246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5de6bd-5e87-4079-a8fc-8e31aa02b984 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:28.923388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 285/551] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:33:28.929643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64447d1b-e455-4a18-9900-2fbe44d1d1bb None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:28.930131 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64447d1b-e455-4a18-9900-2fbe44d1d1bb None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:28.930360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64447d1b-e455-4a18-9900-2fbe44d1d1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:28.944085 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f4171-d395-48d6-8ad8-a0e6c5250466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:28.944775 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f4171-d395-48d6-8ad8-a0e6c5250466 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:28.945061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f4171-d395-48d6-8ad8-a0e6c5250466 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:28.945341 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f4171-d395-48d6-8ad8-a0e6c5250466 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:28.946190 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f4171-d395-48d6-8ad8-a0e6c5250466 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:28.946504 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f4171-d395-48d6-8ad8-a0e6c5250466 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:28.951689 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f4171-d395-48d6-8ad8-a0e6c5250466 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:28.956398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-64447d1b-e455-4a18-9900-2fbe44d1d1bb None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:28.957786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-64447d1b-e455-4a18-9900-2fbe44d1d1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:28.971135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 267/552] 10.222.0.11 () {56 vars in 1135 bytes} [Wed May 4 21:33:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:28.971948 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f4171-d395-48d6-8ad8-a0e6c5250466 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:29.043063 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 286/553] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:29.043063 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64447d1b-e455-4a18-9900-2fbe44d1d1bb None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:29.106257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f4171-d395-48d6-8ad8-a0e6c5250466 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:29.146874 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7070e9b-e94e-4bd5-aa21-c15e05750beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:29.147788 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7070e9b-e94e-4bd5-aa21-c15e05750beb None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:29.148072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7070e9b-e94e-4bd5-aa21-c15e05750beb None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:29.148489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7070e9b-e94e-4bd5-aa21-c15e05750beb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:29.152144 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64447d1b-e455-4a18-9900-2fbe44d1d1bb None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:29.161763 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7070e9b-e94e-4bd5-aa21-c15e05750beb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:29.172235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-e7070e9b-e94e-4bd5-aa21-c15e05750beb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:29.172235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:29.172235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:29.172235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:29.172235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:29.172235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:29.172235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:29.172235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:29.172235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:29.172235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:29.172235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:29.172235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:29.172235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:29.172235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:29.172235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:29.172235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:29.173118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:29.173118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:29.173118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:29.173118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:29.173118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:29.173118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:29.173118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:29.173118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:29.173118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:29.173118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:29.173118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:29.173118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:29.173118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:29.173118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:29.173118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:29.173118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:29.179009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:29.179009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:29.179009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:29.179009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:29.179009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:29.179009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:29.179009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:29.179009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:29.179009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:29.179009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:29.179009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:29.179009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:29.179009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 268/554] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:29.179009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7070e9b-e94e-4bd5-aa21-c15e05750beb None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:29.192686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3a157-b385-4166-ac7f-58d3b3b09de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:29.193639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3a157-b385-4166-ac7f-58d3b3b09de9 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:29.194107 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3a157-b385-4166-ac7f-58d3b3b09de9 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:29.194565 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3a157-b385-4166-ac7f-58d3b3b09de9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:29.276974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3a157-b385-4166-ac7f-58d3b3b09de9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:29.278741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3a157-b385-4166-ac7f-58d3b3b09de9 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:29.295270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7070e9b-e94e-4bd5-aa21-c15e05750beb None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:29.336534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b31974-27f5-4258-a87b-d6a096041093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:29.337699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b31974-27f5-4258-a87b-d6a096041093 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:29.338135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b31974-27f5-4258-a87b-d6a096041093 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:29.338363 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b31974-27f5-4258-a87b-d6a096041093 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:29.352404 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b31974-27f5-4258-a87b-d6a096041093 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:29.362857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-93b31974-27f5-4258-a87b-d6a096041093 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:29.362857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:29.362857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:29.362857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:29.362857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:29.362857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:29.362857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:29.362857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:29.362857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:29.362857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:29.362857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:29.362857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:29.362857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:29.362857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:29.362857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:29.362857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:29.363919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:29.363919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:29.363919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:29.363919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:29.363919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:29.363919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:29.363919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:29.363919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:29.363919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:29.363919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:29.363919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:29.363919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:29.363919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:29.363919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:29.363919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:29.363919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:29.364691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:29.364691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:29.364691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:29.364691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:29.364691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:29.364691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:29.364691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:29.364691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:29.364691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:29.364691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:29.364691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:29.364691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:29.369156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 269/555] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:29.370777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b31974-27f5-4258-a87b-d6a096041093 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:29.395665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 287/556] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:29.396930 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3a157-b385-4166-ac7f-58d3b3b09de9 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:29.497631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3a157-b385-4166-ac7f-58d3b3b09de9 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:29.499899 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b31974-27f5-4258-a87b-d6a096041093 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:29.531856 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3952e5-acdf-4ff4-8801-48641c11631e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:29.532907 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3952e5-acdf-4ff4-8801-48641c11631e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:29.533377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3952e5-acdf-4ff4-8801-48641c11631e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:29.533837 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3952e5-acdf-4ff4-8801-48641c11631e None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:29.534763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3952e5-acdf-4ff4-8801-48641c11631e None admin] RBAC: Adding query filter params (name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:29.535325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3952e5-acdf-4ff4-8801-48641c11631e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:29.537285 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3952e5-acdf-4ff4-8801-48641c11631e None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:29.539177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5737c11-d3e1-45cc-af0c-5529d45010eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:29.539854 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5737c11-d3e1-45cc-af0c-5529d45010eb None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:29.540135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5737c11-d3e1-45cc-af0c-5529d45010eb None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:29.540727 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5737c11-d3e1-45cc-af0c-5529d45010eb None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:29.541514 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5737c11-d3e1-45cc-af0c-5529d45010eb None admin] RBAC: Adding query filter params (name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:29.541825 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5737c11-d3e1-45cc-af0c-5529d45010eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:29.543236 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5737c11-d3e1-45cc-af0c-5529d45010eb None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:29.547987 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 288/557] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:33:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:29.549050 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3952e5-acdf-4ff4-8801-48641c11631e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:29.565628 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 270/558] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:33:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:29.565628 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5737c11-d3e1-45cc-af0c-5529d45010eb None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:29.667354 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5737c11-d3e1-45cc-af0c-5529d45010eb None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:29.668399 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3952e5-acdf-4ff4-8801-48641c11631e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:29.699570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebf396-4d4a-4321-a105-4a0f47529ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:29.700362 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebf396-4d4a-4321-a105-4a0f47529ac5 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:29.700595 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7907b81-5c02-48fc-9ed7-93cc654b2c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:29.700729 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebf396-4d4a-4321-a105-4a0f47529ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:29.700894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebf396-4d4a-4321-a105-4a0f47529ac5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:29.701383 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7907b81-5c02-48fc-9ed7-93cc654b2c00 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:29.701662 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7907b81-5c02-48fc-9ed7-93cc654b2c00 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:29.701930 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7907b81-5c02-48fc-9ed7-93cc654b2c00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:29.711552 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebf396-4d4a-4321-a105-4a0f47529ac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:29.712125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7907b81-5c02-48fc-9ed7-93cc654b2c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:29.713047 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebf396-4d4a-4321-a105-4a0f47529ac5 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:29.713599 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7907b81-5c02-48fc-9ed7-93cc654b2c00 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:29.731497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-c7ebf396-4d4a-4321-a105-4a0f47529ac5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:29.731497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:29.731497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:29.731497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:29.731497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:29.731497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:29.731497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:29.731497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:29.731497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:29.731497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:29.731497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:29.731497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:29.731497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:29.731497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:29.731497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:29.732459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:29.732459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:29.732459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:29.732459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:29.732459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:29.732459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:29.732459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:29.732459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:29.732459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:29.732459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:29.732459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:29.732459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:29.732459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:29.732459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:29.732459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:29.732459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:29.732459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:29.733314 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:29.733314 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:29.733314 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:29.733314 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:29.733534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-b7907b81-5c02-48fc-9ed7-93cc654b2c00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:29.733534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:29.733534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:29.733534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:29.733534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:29.733534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:29.733534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:29.733534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:29.733534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:29.733534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:29.733534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:29.733534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:29.733534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:29.733534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:29.733534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:29.734289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:29.734289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:29.734289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:29.734289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:29.734289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:29.734289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:29.734289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:29.734289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:29.734289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:29.734289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:29.734289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:29.734289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:29.734289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:29.734289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:29.734289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:29.734289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:29.734289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:29.735163 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:29.735163 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:29.735163 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:29.735163 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:29.735163 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 289/559] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:29.735163 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7907b81-5c02-48fc-9ed7-93cc654b2c00 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:29.737349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 271/560] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:29.738455 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6229909-35c9-4d60-ac71-95209d2425a3 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:29.738735 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6229909-35c9-4d60-ac71-95209d2425a3 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:29.739009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6229909-35c9-4d60-ac71-95209d2425a3 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:29.741359 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 272/561] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:29.741359 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6229909-35c9-4d60-ac71-95209d2425a3 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:29.835376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7907b81-5c02-48fc-9ed7-93cc654b2c00 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:29.847677 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6229909-35c9-4d60-ac71-95209d2425a3 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:29.868747 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d8e16-407d-4937-8f55-1bc98f8dd0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:29.869656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d8e16-407d-4937-8f55-1bc98f8dd0d1 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:29.869943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d8e16-407d-4937-8f55-1bc98f8dd0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:29.870223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d8e16-407d-4937-8f55-1bc98f8dd0d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:29.880506 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d8e16-407d-4937-8f55-1bc98f8dd0d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:29.881968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d8e16-407d-4937-8f55-1bc98f8dd0d1 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:29.882780 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6121ee9-cf70-454f-8b9d-0f98861f3f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:29.883549 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6121ee9-cf70-454f-8b9d-0f98861f3f36 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:29.883833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6121ee9-cf70-454f-8b9d-0f98861f3f36 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:29.884106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6121ee9-cf70-454f-8b9d-0f98861f3f36 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:29.884872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6121ee9-cf70-454f-8b9d-0f98861f3f36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:29.885182 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6121ee9-cf70-454f-8b9d-0f98861f3f36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:29.886521 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6121ee9-cf70-454f-8b9d-0f98861f3f36 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:29.903062 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 273/562] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:29.903223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-7f4d8e16-407d-4937-8f55-1bc98f8dd0d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:29.903223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:29.903223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:29.903223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:29.903223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:29.903223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:29.903223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:29.903223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:29.903223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:29.903223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:29.903223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:29.903223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:29.903223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:29.903223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:29.903223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:29.904445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:29.904445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:29.904445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:29.904445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:29.904445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:29.904445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:29.904445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:29.904445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:29.904445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:29.904445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:29.904445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:29.904445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:29.904445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:29.904445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:29.904445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:29.904445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:29.904445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:29.905445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:29.905445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:29.905445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:29.905445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:29.905742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6121ee9-cf70-454f-8b9d-0f98861f3f36 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:29.905810 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 290/563] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:29.905874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999784a7-559f-4f1b-a8f1-6f60ddcdea01 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:29.906415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999784a7-559f-4f1b-a8f1-6f60ddcdea01 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:29.906415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999784a7-559f-4f1b-a8f1-6f60ddcdea01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:29.922961 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-999784a7-559f-4f1b-a8f1-6f60ddcdea01 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:29.924207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-999784a7-559f-4f1b-a8f1-6f60ddcdea01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:30.004428 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6121ee9-cf70-454f-8b9d-0f98861f3f36 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:30.006989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 291/564] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:30.007861 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999784a7-559f-4f1b-a8f1-6f60ddcdea01 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:30.044326 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2937256-6d33-420e-9fe1-7667aaddb079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:30.045976 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2937256-6d33-420e-9fe1-7667aaddb079 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:30.046406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2937256-6d33-420e-9fe1-7667aaddb079 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:30.046844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2937256-6d33-420e-9fe1-7667aaddb079 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:30.047732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2937256-6d33-420e-9fe1-7667aaddb079 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:30.048178 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2937256-6d33-420e-9fe1-7667aaddb079 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:30.049715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2937256-6d33-420e-9fe1-7667aaddb079 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:30.061241 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 274/565] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:30.062116 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2937256-6d33-420e-9fe1-7667aaddb079 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:30.109726 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999784a7-559f-4f1b-a8f1-6f60ddcdea01 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:30.141929 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec28776-3db8-4d60-b511-62f6f7d38cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:30.142728 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec28776-3db8-4d60-b511-62f6f7d38cf9 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:30.143014 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec28776-3db8-4d60-b511-62f6f7d38cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:30.143310 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec28776-3db8-4d60-b511-62f6f7d38cf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:30.149673 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec28776-3db8-4d60-b511-62f6f7d38cf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:30.151524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec28776-3db8-4d60-b511-62f6f7d38cf9 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:30.156472 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2937256-6d33-420e-9fe1-7667aaddb079 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:30.164686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-2ec28776-3db8-4d60-b511-62f6f7d38cf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:30.164686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:30.164686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:30.164686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:30.164686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:30.164686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:30.164686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:30.164686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:30.164686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:30.164686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:30.164686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:30.164686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:30.164686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:30.164686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:30.164686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:30.165524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:30.165524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:30.165524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:30.165524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:30.165524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:30.165524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:30.165524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:30.165524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:30.165524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:30.165524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:30.165524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:30.165524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:30.165524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:30.165524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:30.165524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:30.165524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:30.165524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:30.166791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:30.166791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:30.166791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:30.166791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:30.166791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:30.166791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:30.166791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:30.166791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:30.166791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 292/566] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:30.167495 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec28776-3db8-4d60-b511-62f6f7d38cf9 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:30.195316 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a5da7-f573-4897-a68d-529b7c82e981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:30.195987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a5da7-f573-4897-a68d-529b7c82e981 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:30.196268 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a5da7-f573-4897-a68d-529b7c82e981 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:30.196546 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a5da7-f573-4897-a68d-529b7c82e981 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:30.197360 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a5da7-f573-4897-a68d-529b7c82e981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:30.197663 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a5da7-f573-4897-a68d-529b7c82e981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:30.199126 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a5da7-f573-4897-a68d-529b7c82e981 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:30.210437 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 275/567] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:30.211424 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a5da7-f573-4897-a68d-529b7c82e981 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:30.264298 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec28776-3db8-4d60-b511-62f6f7d38cf9 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:30.311770 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36164b-a891-415a-9f1c-094d2e787336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:30.312927 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36164b-a891-415a-9f1c-094d2e787336 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:30.313378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36164b-a891-415a-9f1c-094d2e787336 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:30.313829 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36164b-a891-415a-9f1c-094d2e787336 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:30.324788 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a5da7-f573-4897-a68d-529b7c82e981 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:30.328651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36164b-a891-415a-9f1c-094d2e787336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:30.342207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-cd36164b-a891-415a-9f1c-094d2e787336 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:30.342207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:30.342207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:30.342207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:30.342207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:30.342207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:30.342207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:30.342207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:30.342207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:30.342207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:30.342207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:30.342207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:30.342207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:30.342207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:30.342207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:30.342207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:30.343295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:30.343295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:30.343295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:30.343295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:30.343295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:30.343295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:30.343295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:30.343295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:30.343295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:30.343295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:30.343295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:30.343295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:30.343295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:30.343295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:30.343295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:30.343295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:30.344432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:30.344432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:30.344432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:30.344432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:30.344432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:30.344432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:30.344432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:30.344432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:30.344432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:30.344432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:30.344432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:30.344432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:30.344432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 293/568] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:30.345874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8129015-fbec-4abf-b10f-f934b1b1a75e None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:30.346353 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8129015-fbec-4abf-b10f-f934b1b1a75e None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:30.346794 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8129015-fbec-4abf-b10f-f934b1b1a75e None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:30.349596 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 294/569] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:30.350617 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8129015-fbec-4abf-b10f-f934b1b1a75e None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:30.377259 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd4995-10fa-4ea1-801b-b9e218d4e21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:30.378364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd4995-10fa-4ea1-801b-b9e218d4e21c None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:30.378898 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd4995-10fa-4ea1-801b-b9e218d4e21c None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:30.379340 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd4995-10fa-4ea1-801b-b9e218d4e21c None admin] PATH_INFO: `/v3/users/nova` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:30.390196 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd4995-10fa-4ea1-801b-b9e218d4e21c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:30.392482 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd4995-10fa-4ea1-801b-b9e218d4e21c None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:30.415226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-65fd4995-10fa-4ea1-801b-b9e218d4e21c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 21:33:30.415226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:30.415226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:30.415226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:30.415226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:30.415226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:30.415226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:30.415226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:30.415226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:30.415226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:30.415226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:30.415226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:30.415226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:30.415226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:30.415226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:30.415226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:30.416439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:30.416439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:30.416439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:30.416439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:30.416439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:30.416439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:30.416439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:30.416439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:30.416439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:30.416439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:30.416439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:30.416439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:30.416439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:30.416439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:30.416439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:30.416439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:30.416439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:30.416439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:30.417744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:30.417744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:30.417744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:30.417744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:30.417744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:30.417744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:30.417744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:30.417744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:30.417744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 21:33:30.417744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:30.417744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 276/570] 10.222.0.11 () {56 vars in 1093 bytes} [Wed May 4 21:33:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:30.419236 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd4995-10fa-4ea1-801b-b9e218d4e21c None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:30.478659 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8129015-fbec-4abf-b10f-f934b1b1a75e None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:30.509901 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e7aa3-7976-4ab4-9dc4-45940fe11fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:30.510562 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e7aa3-7976-4ab4-9dc4-45940fe11fb8 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:30.510843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e7aa3-7976-4ab4-9dc4-45940fe11fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:30.511143 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e7aa3-7976-4ab4-9dc4-45940fe11fb8 None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:30.511927 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e7aa3-7976-4ab4-9dc4-45940fe11fb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:30.512238 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e7aa3-7976-4ab4-9dc4-45940fe11fb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:30.513677 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e7aa3-7976-4ab4-9dc4-45940fe11fb8 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:30.520431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd4995-10fa-4ea1-801b-b9e218d4e21c None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:30.525195 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 295/571] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:30.526031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e7aa3-7976-4ab4-9dc4-45940fe11fb8 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:30.555274 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2270f6-0edf-43b7-bf7b-96dfab91129b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:30.556069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2270f6-0edf-43b7-bf7b-96dfab91129b None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:30.556350 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2270f6-0edf-43b7-bf7b-96dfab91129b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:30.556654 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2270f6-0edf-43b7-bf7b-96dfab91129b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:30.563655 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2270f6-0edf-43b7-bf7b-96dfab91129b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:30.565105 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2270f6-0edf-43b7-bf7b-96dfab91129b None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:30.579803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-3a2270f6-0edf-43b7-bf7b-96dfab91129b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 21:33:30.579803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:30.579803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:30.579803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:30.579803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:30.579803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:30.579803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:30.579803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:30.579803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:30.579803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:30.579803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:30.579803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:30.579803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:30.579803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:30.579803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:30.579803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:30.580777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:30.580777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:30.580777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:30.580777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:30.580777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:30.580777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:30.580777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:30.580777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:30.580777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:30.580777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:30.580777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:30.580777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:30.580777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:30.580777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:30.580777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:30.580777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:30.580777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:30.580777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:30.581794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:30.581794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:30.581794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:30.581794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:30.581794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:30.581794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:30.581794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:30.581794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:30.581794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 21:33:30.581794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:30.581794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 277/572] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:30.582369 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526969a8-c849-4839-abc0-f55a074e232b None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:30.582957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526969a8-c849-4839-abc0-f55a074e232b None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:30.582957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526969a8-c849-4839-abc0-f55a074e232b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:30.600348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-526969a8-c849-4839-abc0-f55a074e232b None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:30.601583 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-526969a8-c849-4839-abc0-f55a074e232b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:30.623574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e7aa3-7976-4ab4-9dc4-45940fe11fb8 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:30.654794 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037e70a-5580-40c2-89c1-251658000de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:30.655419 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e70a-5580-40c2-89c1-251658000de5 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:30.655695 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e70a-5580-40c2-89c1-251658000de5 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:30.655964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e70a-5580-40c2-89c1-251658000de5 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:30.656703 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037e70a-5580-40c2-89c1-251658000de5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:30.657005 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037e70a-5580-40c2-89c1-251658000de5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:30.658371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037e70a-5580-40c2-89c1-251658000de5 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:30.673896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 296/574] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:33:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:30.674061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 278/574] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:30.674141 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037e70a-5580-40c2-89c1-251658000de5 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:30.674210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526969a8-c849-4839-abc0-f55a074e232b None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:30.760128 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037e70a-5580-40c2-89c1-251658000de5 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:30.774692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526969a8-c849-4839-abc0-f55a074e232b None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:30.792400 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350bbbe-da61-4d68-9ce1-62a6094872eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:30.793065 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350bbbe-da61-4d68-9ce1-62a6094872eb None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:30.793348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350bbbe-da61-4d68-9ce1-62a6094872eb None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:30.793623 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350bbbe-da61-4d68-9ce1-62a6094872eb None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:30.794449 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350bbbe-da61-4d68-9ce1-62a6094872eb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:30.794761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350bbbe-da61-4d68-9ce1-62a6094872eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:30.796233 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350bbbe-da61-4d68-9ce1-62a6094872eb None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:30.808280 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934524a-d2ce-4a30-a637-78d717b19b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:30.808940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934524a-d2ce-4a30-a637-78d717b19b71 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:30.809203 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934524a-d2ce-4a30-a637-78d717b19b71 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:30.809492 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934524a-d2ce-4a30-a637-78d717b19b71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:30.810330 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934524a-d2ce-4a30-a637-78d717b19b71 None admin] RBAC: Adding query filter params (role.id=c1ee07ef1a1f4986afc3af5a357e2c4c, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=8358da535a104873ad9f5676989a9e21) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:30.810644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934524a-d2ce-4a30-a637-78d717b19b71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:30.812118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934524a-d2ce-4a30-a637-78d717b19b71 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:30.813504 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 297/575] 10.222.0.11 () {56 vars in 1133 bytes} [Wed May 4 21:33:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:30.814293 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350bbbe-da61-4d68-9ce1-62a6094872eb None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:30.817838 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 279/576] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:33:30 2022] GET /identity/v3/role_assignments?user.id=8358da535a104873ad9f5676989a9e21&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=c1ee07ef1a1f4986afc3af5a357e2c4c => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:30.819490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934524a-d2ce-4a30-a637-78d717b19b71 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:30.929133 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350bbbe-da61-4d68-9ce1-62a6094872eb None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:30.930449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934524a-d2ce-4a30-a637-78d717b19b71 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:30.965201 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147d824-6240-4f70-b057-8894f999229f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:30.965889 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147d824-6240-4f70-b057-8894f999229f None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:30.966178 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147d824-6240-4f70-b057-8894f999229f None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:30.966456 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147d824-6240-4f70-b057-8894f999229f None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:30.966735 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae607f-b035-4c66-b18c-1b51ab1539d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:30.967340 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147d824-6240-4f70-b057-8894f999229f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:30.967583 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae607f-b035-4c66-b18c-1b51ab1539d1 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:30.967692 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147d824-6240-4f70-b057-8894f999229f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:30.967862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae607f-b035-4c66-b18c-1b51ab1539d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:30.968131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae607f-b035-4c66-b18c-1b51ab1539d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:30.969093 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147d824-6240-4f70-b057-8894f999229f None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:30.979338 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae607f-b035-4c66-b18c-1b51ab1539d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:30.980823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae607f-b035-4c66-b18c-1b51ab1539d1 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:30.992765 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 298/577] 10.222.0.11 () {56 vars in 1137 bytes} [Wed May 4 21:33:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:30.992765 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147d824-6240-4f70-b057-8894f999229f None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:30.999994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-30ae607f-b035-4c66-b18c-1b51ab1539d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:30.999994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:30.999994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:30.999994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:30.999994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:30.999994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:30.999994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:30.999994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:30.999994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:30.999994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:30.999994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:30.999994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:30.999994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:30.999994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:30.999994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:31.000940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:31.000940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:31.000940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:31.000940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:31.000940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:31.000940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:31.000940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:31.000940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:31.000940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:31.000940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:31.000940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:31.000940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:31.000940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:31.000940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:31.000940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:31.000940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:31.000940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:31.003074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:31.003074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:31.003074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:31.003074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:31.003074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 280/578] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:31.003074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae607f-b035-4c66-b18c-1b51ab1539d1 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:31.097304 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147d824-6240-4f70-b057-8894f999229f None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:31.098291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae607f-b035-4c66-b18c-1b51ab1539d1 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:31.130617 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4dcd7-73cd-43d7-839d-588d35e4e138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:31.131447 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4dcd7-73cd-43d7-839d-588d35e4e138 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:31.131728 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4dcd7-73cd-43d7-839d-588d35e4e138 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:31.131994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19897128-c5c8-49b7-95f2-c1049023835c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:31.132122 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4dcd7-73cd-43d7-839d-588d35e4e138 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:31.132834 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19897128-c5c8-49b7-95f2-c1049023835c None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:31.133119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19897128-c5c8-49b7-95f2-c1049023835c None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:31.133393 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19897128-c5c8-49b7-95f2-c1049023835c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:31.142081 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4dcd7-73cd-43d7-839d-588d35e4e138 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:31.143414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19897128-c5c8-49b7-95f2-c1049023835c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:31.144865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19897128-c5c8-49b7-95f2-c1049023835c None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:31.149714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-cfe4dcd7-73cd-43d7-839d-588d35e4e138 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:31.149714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:31.149714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:31.149714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:31.149714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:31.149714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:31.149714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:31.149714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:31.149714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:31.149714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:31.149714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:31.149714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:31.149714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:31.149714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:31.149714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:31.149714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:31.150744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:31.150744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:31.150744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:31.150744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:31.150744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:31.150744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:31.150744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:31.150744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:31.150744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:31.150744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:31.150744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:31.150744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:31.150744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:31.150744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:31.150744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:31.150744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:31.156761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:31.156761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:31.156761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:31.156761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:31.156761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:31.156761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:31.156761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:31.156761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:31.156761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:31.156761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:31.156761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:31.156761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:31.156761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 299/579] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:31.156761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4dcd7-73cd-43d7-839d-588d35e4e138 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:31.171872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-19897128-c5c8-49b7-95f2-c1049023835c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:31.171872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:31.171872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:31.171872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:31.171872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:31.171872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:31.171872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:31.171872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:31.171872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:31.171872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:31.171872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:31.171872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:31.171872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:31.171872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:31.171872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:31.172779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:31.172779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:31.172779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:31.172779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:31.172779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:31.172779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:31.172779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:31.172779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:31.172779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:31.172779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:31.172779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:31.172779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:31.172779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:31.172779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:31.172779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:31.172779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:31.172779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:31.173657 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:31.173657 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:31.173657 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:31.173657 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:31.177010 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 281/580] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:31.177010 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19897128-c5c8-49b7-95f2-c1049023835c None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:31.251855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4dcd7-73cd-43d7-839d-588d35e4e138 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:31.272481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19897128-c5c8-49b7-95f2-c1049023835c None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:31.283787 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9215e-1d21-4f25-a5d0-d2b5b11c964c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:31.284594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9215e-1d21-4f25-a5d0-d2b5b11c964c None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:31.284863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9215e-1d21-4f25-a5d0-d2b5b11c964c None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:31.285156 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9215e-1d21-4f25-a5d0-d2b5b11c964c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:31.295787 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9215e-1d21-4f25-a5d0-d2b5b11c964c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:31.297234 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9215e-1d21-4f25-a5d0-d2b5b11c964c None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:31.305151 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379505f0-4e85-4777-b04d-d09f72e80563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:31.306331 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379505f0-4e85-4777-b04d-d09f72e80563 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:31.306871 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379505f0-4e85-4777-b04d-d09f72e80563 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:31.307482 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379505f0-4e85-4777-b04d-d09f72e80563 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:31.308399 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379505f0-4e85-4777-b04d-d09f72e80563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:31.308890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379505f0-4e85-4777-b04d-d09f72e80563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:31.310447 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379505f0-4e85-4777-b04d-d09f72e80563 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:31.313701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-efa9215e-1d21-4f25-a5d0-d2b5b11c964c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:31.313701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:31.313701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:31.313701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:31.313701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:31.313701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:31.313701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:31.313701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:31.313701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:31.313701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:31.313701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:31.313701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:31.313701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:31.313701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:31.313701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:31.314582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:31.314582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:31.314582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:31.314582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:31.314582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:31.314582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:31.314582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:31.314582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:31.314582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:31.314582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:31.314582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:31.314582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:31.314582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:31.314582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:31.314582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:31.314582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:31.314582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:31.315527 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:31.315527 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:31.315527 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:31.315527 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:31.315527 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 300/581] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:31.315814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9215e-1d21-4f25-a5d0-d2b5b11c964c None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:31.329335 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 282/582] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:31.330462 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379505f0-4e85-4777-b04d-d09f72e80563 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:31.413221 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9215e-1d21-4f25-a5d0-d2b5b11c964c None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:31.426229 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379505f0-4e85-4777-b04d-d09f72e80563 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:31.446399 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f7d08-ed51-4984-8d73-e218e8b8dfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:31.447178 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f7d08-ed51-4984-8d73-e218e8b8dfb7 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:31.447486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f7d08-ed51-4984-8d73-e218e8b8dfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:31.447765 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f7d08-ed51-4984-8d73-e218e8b8dfb7 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:31.448516 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f7d08-ed51-4984-8d73-e218e8b8dfb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:31.448837 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f7d08-ed51-4984-8d73-e218e8b8dfb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:31.450226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f7d08-ed51-4984-8d73-e218e8b8dfb7 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:31.458364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 301/583] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:33:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:31.458991 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f7d08-ed51-4984-8d73-e218e8b8dfb7 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:31.463985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079987eb-0a7b-4504-be85-80cf967aed7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:31.464659 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079987eb-0a7b-4504-be85-80cf967aed7e None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:31.464938 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079987eb-0a7b-4504-be85-80cf967aed7e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:31.465212 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079987eb-0a7b-4504-be85-80cf967aed7e None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:31.465931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079987eb-0a7b-4504-be85-80cf967aed7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:31.466234 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079987eb-0a7b-4504-be85-80cf967aed7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:31.467633 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079987eb-0a7b-4504-be85-80cf967aed7e None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:31.484151 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 283/584] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:31.484151 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079987eb-0a7b-4504-be85-80cf967aed7e None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:31.556369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f7d08-ed51-4984-8d73-e218e8b8dfb7 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:31.584867 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079987eb-0a7b-4504-be85-80cf967aed7e None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:31.595229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27ae23-43ed-4917-9815-ca77fcbb12d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:31.595906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27ae23-43ed-4917-9815-ca77fcbb12d2 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:31.596184 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27ae23-43ed-4917-9815-ca77fcbb12d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:31.596455 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27ae23-43ed-4917-9815-ca77fcbb12d2 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:31.597167 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27ae23-43ed-4917-9815-ca77fcbb12d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:31.597469 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27ae23-43ed-4917-9815-ca77fcbb12d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:31.599235 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27ae23-43ed-4917-9815-ca77fcbb12d2 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:31.613613 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 302/585] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:31.614513 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27ae23-43ed-4917-9815-ca77fcbb12d2 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:31.623913 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9996b64-552f-432d-a0f8-bc8d7e553116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:31.624720 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9996b64-552f-432d-a0f8-bc8d7e553116 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:31.625002 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9996b64-552f-432d-a0f8-bc8d7e553116 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:31.625277 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9996b64-552f-432d-a0f8-bc8d7e553116 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:31.633104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9996b64-552f-432d-a0f8-bc8d7e553116 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:31.634592 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9996b64-552f-432d-a0f8-bc8d7e553116 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:31.649384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-b9996b64-552f-432d-a0f8-bc8d7e553116 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 21:33:31.649384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:31.649384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:31.649384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:31.649384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:31.649384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:31.649384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:31.649384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:31.649384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:31.649384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:31.649384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:31.649384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:31.649384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:31.649384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:31.649384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:31.649384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:31.650496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:31.650496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:31.650496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:31.650496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:31.650496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:31.650496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:31.650496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:31.650496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:31.650496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:31.650496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:31.650496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:31.650496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:31.650496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:31.650496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:31.650496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:31.650496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:31.650496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:31.650496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:31.656306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:31.656306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:31.656306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:31.656306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:31.656306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:31.656306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:31.656306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:31.656306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:31.656306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 21:33:31.656306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:31.656306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 284/586] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:31.656306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9996b64-552f-432d-a0f8-bc8d7e553116 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:31.716334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27ae23-43ed-4917-9815-ca77fcbb12d2 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:31.744570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9996b64-552f-432d-a0f8-bc8d7e553116 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:31.749211 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194f536-b9cf-4472-a380-9ade3f1473cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:31.750013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194f536-b9cf-4472-a380-9ade3f1473cf None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:31.750296 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194f536-b9cf-4472-a380-9ade3f1473cf None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:31.750573 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194f536-b9cf-4472-a380-9ade3f1473cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:31.760663 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194f536-b9cf-4472-a380-9ade3f1473cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:31.762118 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194f536-b9cf-4472-a380-9ade3f1473cf None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:31.778480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759153e1-e540-4018-8200-362ee5eace30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:31.779310 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759153e1-e540-4018-8200-362ee5eace30 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:31.779601 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759153e1-e540-4018-8200-362ee5eace30 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:31.779873 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759153e1-e540-4018-8200-362ee5eace30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:31.780006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-8194f536-b9cf-4472-a380-9ade3f1473cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:31.780006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:31.780006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:31.780006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:31.780006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:31.780006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:31.780006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:31.780006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:31.780006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:31.780006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:31.780006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:31.780006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:31.780006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:31.780006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:31.780006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:31.780807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:31.780807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:31.780807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:31.780807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:31.780807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:31.780807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:31.780807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:31.780807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:31.780807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:31.780807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:31.780807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:31.780807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:31.780807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:31.780807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:31.780807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:31.780807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:31.780807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:31.781702 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:31.781702 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:31.781702 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:31.781702 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:31.781702 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 303/587] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:31.782595 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194f536-b9cf-4472-a380-9ade3f1473cf None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:31.790722 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759153e1-e540-4018-8200-362ee5eace30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:31.792236 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759153e1-e540-4018-8200-362ee5eace30 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:31.805909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-759153e1-e540-4018-8200-362ee5eace30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:31.805909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:31.805909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:31.805909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:31.805909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:31.805909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:31.805909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:31.805909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:31.805909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:31.805909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:31.805909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:31.805909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:31.805909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:31.805909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:31.805909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:31.807161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:31.807161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:31.807161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:31.807161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:31.807161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:31.807161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:31.807161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:31.807161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:31.807161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:31.807161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:31.807161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:31.807161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:31.807161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:31.807161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:31.807161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:31.807161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:31.807161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:31.808069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:31.808069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:31.808069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:31.808069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:31.808069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:31.808069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:31.808069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:31.808069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:31.808069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 285/588] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:31.808069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759153e1-e540-4018-8200-362ee5eace30 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:31.885283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194f536-b9cf-4472-a380-9ade3f1473cf None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:31.908639 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759153e1-e540-4018-8200-362ee5eace30 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:31.920473 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8e1c1-06fc-4403-937b-e60638de8259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:31.921302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8e1c1-06fc-4403-937b-e60638de8259 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:31.921588 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8e1c1-06fc-4403-937b-e60638de8259 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:31.921871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8e1c1-06fc-4403-937b-e60638de8259 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:31.929075 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8e1c1-06fc-4403-937b-e60638de8259 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:31.930538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8e1c1-06fc-4403-937b-e60638de8259 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:31.944290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-69c8e1c1-06fc-4403-937b-e60638de8259 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:31.944290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:31.944290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:31.944290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:31.944290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:31.944290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:31.944290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:31.944290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:31.944290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:31.944290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:31.944290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:31.944290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:31.944290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:31.944290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:31.944290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:31.945257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:31.945257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:31.945257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:31.945257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:31.945257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:31.945257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:31.945257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:31.945257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:31.945257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:31.945257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:31.945257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:31.945257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:31.945257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:31.945257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:31.945257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:31.945257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:31.945257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:31.946162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:31.946162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:31.946162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:31.946162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:31.946162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:31.946162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:31.946162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:31.946162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:31.946585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d39a6b-8fc2-4341-bb30-d90bc821c5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:31.946676 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 304/589] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:31.946676 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8e1c1-06fc-4403-937b-e60638de8259 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:31.950868 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d39a6b-8fc2-4341-bb30-d90bc821c5b1 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:31.951194 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d39a6b-8fc2-4341-bb30-d90bc821c5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:31.951474 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d39a6b-8fc2-4341-bb30-d90bc821c5b1 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:31.952329 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d39a6b-8fc2-4341-bb30-d90bc821c5b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:31.952643 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d39a6b-8fc2-4341-bb30-d90bc821c5b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:31.954083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d39a6b-8fc2-4341-bb30-d90bc821c5b1 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:31.976424 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 286/590] 10.222.0.11 () {56 vars in 1137 bytes} [Wed May 4 21:33:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:31.976424 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d39a6b-8fc2-4341-bb30-d90bc821c5b1 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:32.040385 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8e1c1-06fc-4403-937b-e60638de8259 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:32.072665 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d39a6b-8fc2-4341-bb30-d90bc821c5b1 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:32.073401 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ce3e8-fe3a-43fb-ba0a-3596edb3e716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:32.074277 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ce3e8-fe3a-43fb-ba0a-3596edb3e716 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:32.074768 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ce3e8-fe3a-43fb-ba0a-3596edb3e716 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:32.075067 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ce3e8-fe3a-43fb-ba0a-3596edb3e716 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:32.075866 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ce3e8-fe3a-43fb-ba0a-3596edb3e716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:32.076180 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ce3e8-fe3a-43fb-ba0a-3596edb3e716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:32.077591 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ce3e8-fe3a-43fb-ba0a-3596edb3e716 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:32.094022 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 305/591] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:32.094657 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ce3e8-fe3a-43fb-ba0a-3596edb3e716 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:32.106004 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19fa79-cd6d-49fa-836b-9916d3841618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:32.106665 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19fa79-cd6d-49fa-836b-9916d3841618 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:32.106948 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19fa79-cd6d-49fa-836b-9916d3841618 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:32.107249 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19fa79-cd6d-49fa-836b-9916d3841618 None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:32.108033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19fa79-cd6d-49fa-836b-9916d3841618 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:32.108343 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19fa79-cd6d-49fa-836b-9916d3841618 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:32.109775 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19fa79-cd6d-49fa-836b-9916d3841618 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:32.126155 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 287/592] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:32.126155 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19fa79-cd6d-49fa-836b-9916d3841618 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:32.192860 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ce3e8-fe3a-43fb-ba0a-3596edb3e716 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:32.222509 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19fa79-cd6d-49fa-836b-9916d3841618 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:32.226874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a5f3f-7e3a-4e72-9c20-8d67e2ce7206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:32.227715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a5f3f-7e3a-4e72-9c20-8d67e2ce7206 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:32.228022 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a5f3f-7e3a-4e72-9c20-8d67e2ce7206 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:32.228275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a5f3f-7e3a-4e72-9c20-8d67e2ce7206 None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:32.229265 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a5f3f-7e3a-4e72-9c20-8d67e2ce7206 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:32.229576 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a5f3f-7e3a-4e72-9c20-8d67e2ce7206 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:32.231315 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a5f3f-7e3a-4e72-9c20-8d67e2ce7206 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:32.244279 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 306/593] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:32.245110 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a5f3f-7e3a-4e72-9c20-8d67e2ce7206 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:32.258088 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd48ed-b320-4db1-ab04-28529db9d2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:32.258890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd48ed-b320-4db1-ab04-28529db9d2e8 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:32.259207 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd48ed-b320-4db1-ab04-28529db9d2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:32.259482 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd48ed-b320-4db1-ab04-28529db9d2e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:32.269893 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd48ed-b320-4db1-ab04-28529db9d2e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:32.271376 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd48ed-b320-4db1-ab04-28529db9d2e8 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:32.287908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-f5dd48ed-b320-4db1-ab04-28529db9d2e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:32.287908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:32.287908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:32.287908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:32.287908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:32.287908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:32.287908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:32.287908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:32.287908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:32.287908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:32.287908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:32.287908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:32.287908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:32.287908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:32.287908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:32.288832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:32.288832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:32.288832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:32.288832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:32.288832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:32.288832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:32.288832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:32.288832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:32.288832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:32.288832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:32.288832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:32.288832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:32.288832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:32.288832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:32.288832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:32.288832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:32.288832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:32.289725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:32.289725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:32.289725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:32.289725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:32.289725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 288/594] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:32.290017 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd48ed-b320-4db1-ab04-28529db9d2e8 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:32.350400 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a5f3f-7e3a-4e72-9c20-8d67e2ce7206 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:32.384461 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c521448-0326-4ac5-bca2-2969dd563b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:32.385630 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c521448-0326-4ac5-bca2-2969dd563b44 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:32.386085 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c521448-0326-4ac5-bca2-2969dd563b44 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:32.386535 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c521448-0326-4ac5-bca2-2969dd563b44 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:32.387958 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd48ed-b320-4db1-ab04-28529db9d2e8 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:32.394651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c521448-0326-4ac5-bca2-2969dd563b44 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:32.396178 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c521448-0326-4ac5-bca2-2969dd563b44 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:32.410719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-8c521448-0326-4ac5-bca2-2969dd563b44 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 21:33:32.410719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:32.410719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:32.410719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:32.410719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:32.410719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:32.410719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:32.410719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:32.410719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:32.410719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:32.410719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:32.410719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:32.410719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:32.410719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:32.410719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:32.410719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:32.411879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:32.411879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:32.411879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:32.411879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:32.411879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:32.411879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:32.411879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:32.411879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:32.411879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:32.411879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:32.411879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:32.411879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:32.411879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:32.411879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:32.411879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:32.411879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:32.411879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:32.411879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:32.412857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:32.412857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:32.412857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:32.412857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:32.412857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:32.412857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:32.412857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:32.412857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:32.412857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 21:33:32.412857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:32.415400 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 307/595] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:32.416250 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c521448-0326-4ac5-bca2-2969dd563b44 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:32.422884 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f60fb9-3d52-4f4b-80d6-591157dea488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:32.423853 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f60fb9-3d52-4f4b-80d6-591157dea488 None admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:32.424137 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f60fb9-3d52-4f4b-80d6-591157dea488 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:32.424413 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f60fb9-3d52-4f4b-80d6-591157dea488 None admin] PATH_INFO: `/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/f4f207481ccb4cfcbbcffd9df73d2985/roles/c1ee07ef1a1f4986afc3af5a357e2c4c` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:32.441511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f60fb9-3d52-4f4b-80d6-591157dea488 None admin] RBAC: Authorizing `identity:create_grant(project_id=3acb142d1aa34e18a018d3fdee8d7038, user_id=f4f207481ccb4cfcbbcffd9df73d2985, role_id=c1ee07ef1a1f4986afc3af5a357e2c4c)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:32.442955 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f60fb9-3d52-4f4b-80d6-591157dea488 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:32.463094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 289/596] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:33:32 2022] PUT /identity/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/f4f207481ccb4cfcbbcffd9df73d2985/roles/c1ee07ef1a1f4986afc3af5a357e2c4c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:33:32.463094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f60fb9-3d52-4f4b-80d6-591157dea488 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:32.520826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c521448-0326-4ac5-bca2-2969dd563b44 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:32.557688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52726f-f154-436e-8aca-a14e1fbcf518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:32.558602 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52726f-f154-436e-8aca-a14e1fbcf518 None admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:32.558880 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52726f-f154-436e-8aca-a14e1fbcf518 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:32.559198 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52726f-f154-436e-8aca-a14e1fbcf518 None admin] PATH_INFO: `/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/b9a86016cde040e7b8a9eeaf34cf0715/roles/c1ee07ef1a1f4986afc3af5a357e2c4c` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:32.592070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52726f-f154-436e-8aca-a14e1fbcf518 None admin] RBAC: Authorizing `identity:create_grant(project_id=3acb142d1aa34e18a018d3fdee8d7038, user_id=b9a86016cde040e7b8a9eeaf34cf0715, role_id=c1ee07ef1a1f4986afc3af5a357e2c4c)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:32.593553 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52726f-f154-436e-8aca-a14e1fbcf518 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:32.601725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f60fb9-3d52-4f4b-80d6-591157dea488 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:32.612510 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 308/597] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:33:32 2022] PUT /identity/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/b9a86016cde040e7b8a9eeaf34cf0715/roles/c1ee07ef1a1f4986afc3af5a357e2c4c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:33:32.613774 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52726f-f154-436e-8aca-a14e1fbcf518 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:32.663726 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056136ec-ffeb-422a-9e1d-27b2aca7c74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:32.664425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056136ec-ffeb-422a-9e1d-27b2aca7c74f None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:32.664710 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056136ec-ffeb-422a-9e1d-27b2aca7c74f None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:32.664988 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056136ec-ffeb-422a-9e1d-27b2aca7c74f None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:32.665752 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056136ec-ffeb-422a-9e1d-27b2aca7c74f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:32.666571 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056136ec-ffeb-422a-9e1d-27b2aca7c74f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:32.667562 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056136ec-ffeb-422a-9e1d-27b2aca7c74f None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:32.681223 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 290/598] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:32.686846 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056136ec-ffeb-422a-9e1d-27b2aca7c74f None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:32.748628 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52726f-f154-436e-8aca-a14e1fbcf518 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:32.786748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade51933-b429-4530-ae17-6217d2264f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:32.787716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade51933-b429-4530-ae17-6217d2264f60 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:32.788204 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade51933-b429-4530-ae17-6217d2264f60 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:32.788624 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade51933-b429-4530-ae17-6217d2264f60 None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:32.789670 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade51933-b429-4530-ae17-6217d2264f60 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:32.790149 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade51933-b429-4530-ae17-6217d2264f60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:32.791846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade51933-b429-4530-ae17-6217d2264f60 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:32.814949 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 309/599] 10.222.0.11 () {56 vars in 1139 bytes} [Wed May 4 21:33:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:32.820227 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade51933-b429-4530-ae17-6217d2264f60 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:32.822313 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056136ec-ffeb-422a-9e1d-27b2aca7c74f None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:32.874859 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a2d6d-98d1-4526-976f-cdee241bec2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:32.875990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2d6d-98d1-4526-976f-cdee241bec2f None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:32.876278 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2d6d-98d1-4526-976f-cdee241bec2f None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:32.876549 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2d6d-98d1-4526-976f-cdee241bec2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:32.892612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a2d6d-98d1-4526-976f-cdee241bec2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:32.894140 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a2d6d-98d1-4526-976f-cdee241bec2f None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:32.911114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-c06a2d6d-98d1-4526-976f-cdee241bec2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:32.911114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:32.911114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:32.911114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:32.911114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:32.911114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:32.911114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:32.911114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:32.911114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:32.911114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:32.911114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:32.911114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:32.911114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:32.911114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:32.911114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:32.912125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:32.912125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:32.912125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:32.912125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:32.912125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:32.912125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:32.912125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:32.912125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:32.912125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:32.912125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:32.912125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:32.912125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:32.912125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:32.912125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:32.912125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:32.912125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:32.912125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:32.913208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:32.913208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:32.913208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:32.913208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:32.913208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:32.913208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:32.913208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:32.913208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:32.915435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 291/600] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:33:32.922264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a2d6d-98d1-4526-976f-cdee241bec2f None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:32.954742 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade51933-b429-4530-ae17-6217d2264f60 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:32.990842 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa06dc4-3f00-459e-9719-cf1efccefa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:32.991947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa06dc4-3f00-459e-9719-cf1efccefa47 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:32.992373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa06dc4-3f00-459e-9719-cf1efccefa47 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:32.992790 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa06dc4-3f00-459e-9719-cf1efccefa47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:33.003539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa06dc4-3f00-459e-9719-cf1efccefa47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:33.005236 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa06dc4-3f00-459e-9719-cf1efccefa47 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:33.023454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-caa06dc4-3f00-459e-9719-cf1efccefa47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:33.023454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:33.023454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:33.023454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:33.023454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:33.023454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:33.023454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:33.023454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:33.023454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:33.023454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:33.023454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:33.023454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:33.023454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:33.023454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:33.023454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:33.024563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:33.024563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:33.024563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:33.024563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:33.024563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:33.024563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:33.024563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:33.024563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:33.024563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:33.024563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:33.024563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:33.024563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:33.024563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:33.024563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:33.024563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:33.024563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:33.024563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:33.025857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:33.025857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:33.025857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:33.025857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:33.027731 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 310/601] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:33.033094 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa06dc4-3f00-459e-9719-cf1efccefa47 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:33.072427 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a2d6d-98d1-4526-976f-cdee241bec2f None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:33.109027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f1947-5143-42ed-863b-187b356da754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:33.110087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f1947-5143-42ed-863b-187b356da754 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:33.110613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f1947-5143-42ed-863b-187b356da754 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:33.111139 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f1947-5143-42ed-863b-187b356da754 None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:33.112121 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f1947-5143-42ed-863b-187b356da754 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:33.112641 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f1947-5143-42ed-863b-187b356da754 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:33.114270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f1947-5143-42ed-863b-187b356da754 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:33.126633 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 292/602] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:33.128304 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf4905-506c-4054-b0a0-b96eed3d0bca None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:33.128811 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf4905-506c-4054-b0a0-b96eed3d0bca None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:33.129315 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf4905-506c-4054-b0a0-b96eed3d0bca None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:33.130995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 293/603] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:33.131899 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf4905-506c-4054-b0a0-b96eed3d0bca None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:33.155665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa06dc4-3f00-459e-9719-cf1efccefa47 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:33.188878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c0b2b-73b9-4fcc-b645-2a6cd7bd3f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:33.189303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c0b2b-73b9-4fcc-b645-2a6cd7bd3f64 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:33.189586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c0b2b-73b9-4fcc-b645-2a6cd7bd3f64 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:33.189862 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c0b2b-73b9-4fcc-b645-2a6cd7bd3f64 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:33.190583 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c0b2b-73b9-4fcc-b645-2a6cd7bd3f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:33.190900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c0b2b-73b9-4fcc-b645-2a6cd7bd3f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:33.192294 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c0b2b-73b9-4fcc-b645-2a6cd7bd3f64 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:33.204275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 311/604] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:33.205012 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63a5c9-48e3-456b-aca1-4b3c319a8e8a None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:33.205305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63a5c9-48e3-456b-aca1-4b3c319a8e8a None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:33.205582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63a5c9-48e3-456b-aca1-4b3c319a8e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:33.222136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-db63a5c9-48e3-456b-aca1-4b3c319a8e8a None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:33.223359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-db63a5c9-48e3-456b-aca1-4b3c319a8e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:33.236562 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf4905-506c-4054-b0a0-b96eed3d0bca None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:33.271248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef0996-6655-4f81-a8c7-4cd6c2b05d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:33.272526 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef0996-6655-4f81-a8c7-4cd6c2b05d9e None admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:33.273033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef0996-6655-4f81-a8c7-4cd6c2b05d9e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:33.273503 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef0996-6655-4f81-a8c7-4cd6c2b05d9e None admin] PATH_INFO: `/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/c61205d7e96f496ab9f8ca84ab9408b4/roles/c1ee07ef1a1f4986afc3af5a357e2c4c` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:33.289091 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef0996-6655-4f81-a8c7-4cd6c2b05d9e None admin] RBAC: Authorizing `identity:create_grant(project_id=3acb142d1aa34e18a018d3fdee8d7038, user_id=c61205d7e96f496ab9f8ca84ab9408b4, role_id=c1ee07ef1a1f4986afc3af5a357e2c4c)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:33.291066 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef0996-6655-4f81-a8c7-4cd6c2b05d9e None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:33.295166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 312/605] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:33.296375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63a5c9-48e3-456b-aca1-4b3c319a8e8a None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:33.314076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 294/606] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:33:33 2022] PUT /identity/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/c61205d7e96f496ab9f8ca84ab9408b4/roles/c1ee07ef1a1f4986afc3af5a357e2c4c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:33:33.315803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef0996-6655-4f81-a8c7-4cd6c2b05d9e None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:33.432399 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63a5c9-48e3-456b-aca1-4b3c319a8e8a None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:33.438572 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef0996-6655-4f81-a8c7-4cd6c2b05d9e None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:33.474473 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f12be7-9d20-46ae-8f3d-24641f942c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:33.475860 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f12be7-9d20-46ae-8f3d-24641f942c9a None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:33.476388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f12be7-9d20-46ae-8f3d-24641f942c9a None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:33.476876 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f12be7-9d20-46ae-8f3d-24641f942c9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:33.486009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f12be7-9d20-46ae-8f3d-24641f942c9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:33.487906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f12be7-9d20-46ae-8f3d-24641f942c9a None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:33.504780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-00f12be7-9d20-46ae-8f3d-24641f942c9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:33.504780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:33.504780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:33.504780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:33.504780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:33.504780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:33.504780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:33.504780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:33.504780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:33.504780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:33.504780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:33.504780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:33.504780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:33.504780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:33.504780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:33.505763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:33.505763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:33.505763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:33.505763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:33.505763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:33.505763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:33.505763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:33.505763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:33.505763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:33.505763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:33.505763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:33.505763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:33.505763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:33.505763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:33.505763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:33.505763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:33.505763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:33.506639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:33.506639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:33.506639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:33.506639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:33.506639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:33.506639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:33.506639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:33.506639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:33.509865 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 313/607] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:33.517922 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f12be7-9d20-46ae-8f3d-24641f942c9a None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:33.520995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d79a7-d749-403c-aa65-f13a936ca760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:33.521829 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d79a7-d749-403c-aa65-f13a936ca760 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:33.522112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d79a7-d749-403c-aa65-f13a936ca760 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:33.522389 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d79a7-d749-403c-aa65-f13a936ca760 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:33.541661 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d79a7-d749-403c-aa65-f13a936ca760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:33.554802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-898d79a7-d749-403c-aa65-f13a936ca760 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:33.554802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:33.554802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:33.554802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:33.554802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:33.554802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:33.554802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:33.554802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:33.554802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:33.554802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:33.554802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:33.554802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:33.554802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:33.554802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:33.554802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:33.554802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:33.555822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:33.555822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:33.555822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:33.555822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:33.555822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:33.555822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:33.555822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:33.555822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:33.555822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:33.555822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:33.555822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:33.555822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:33.555822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:33.555822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:33.555822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:33.555822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:33.556696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:33.556696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:33.556696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:33.556696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:33.556696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:33.556696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:33.556696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:33.556696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:33.556696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:33.556696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:33.556696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:33.556696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:33.556696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 295/608] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:33.565129 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d79a7-d749-403c-aa65-f13a936ca760 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:33.669806 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f12be7-9d20-46ae-8f3d-24641f942c9a None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:33.677767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d79a7-d749-403c-aa65-f13a936ca760 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:33.704806 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f45858-e62a-4fc6-a130-54d7258612e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:33.705552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f45858-e62a-4fc6-a130-54d7258612e4 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:33.705932 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f45858-e62a-4fc6-a130-54d7258612e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:33.706327 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f45858-e62a-4fc6-a130-54d7258612e4 None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:33.707248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f45858-e62a-4fc6-a130-54d7258612e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:33.707659 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f45858-e62a-4fc6-a130-54d7258612e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:33.709251 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f45858-e62a-4fc6-a130-54d7258612e4 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:33.715437 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc42eb-c77f-4cf1-9948-ab57cfa0bda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:33.716114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc42eb-c77f-4cf1-9948-ab57cfa0bda3 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:33.716393 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc42eb-c77f-4cf1-9948-ab57cfa0bda3 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:33.716666 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc42eb-c77f-4cf1-9948-ab57cfa0bda3 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:33.717414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc42eb-c77f-4cf1-9948-ab57cfa0bda3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:33.717720 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc42eb-c77f-4cf1-9948-ab57cfa0bda3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:33.719116 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc42eb-c77f-4cf1-9948-ab57cfa0bda3 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:33.724779 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 314/609] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:33.728051 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 296/610] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:33:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:33.730946 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f45858-e62a-4fc6-a130-54d7258612e4 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:33.733546 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc42eb-c77f-4cf1-9948-ab57cfa0bda3 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:33.831779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc42eb-c77f-4cf1-9948-ab57cfa0bda3 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:33.835836 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f45858-e62a-4fc6-a130-54d7258612e4 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:33.866922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd5392-5f68-4cbf-bee6-1a1dc421346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:33.867760 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd5392-5f68-4cbf-bee6-1a1dc421346d None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:33.868040 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd5392-5f68-4cbf-bee6-1a1dc421346d None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:33.868313 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd5392-5f68-4cbf-bee6-1a1dc421346d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:33.877918 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b9977-85b3-472a-85fc-7b74c6261cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:33.878957 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b9977-85b3-472a-85fc-7b74c6261cd9 None admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:33.879277 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd5392-5f68-4cbf-bee6-1a1dc421346d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:33.879433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b9977-85b3-472a-85fc-7b74c6261cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:33.879805 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b9977-85b3-472a-85fc-7b74c6261cd9 None admin] PATH_INFO: `/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/e4e5d4fe283447c59672398a26dea225/roles/c1ee07ef1a1f4986afc3af5a357e2c4c` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:33.880722 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd5392-5f68-4cbf-bee6-1a1dc421346d None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:33.895502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b9977-85b3-472a-85fc-7b74c6261cd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3acb142d1aa34e18a018d3fdee8d7038, user_id=e4e5d4fe283447c59672398a26dea225, role_id=c1ee07ef1a1f4986afc3af5a357e2c4c)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:33.897090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b9977-85b3-472a-85fc-7b74c6261cd9 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:33.897700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-7cbd5392-5f68-4cbf-bee6-1a1dc421346d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:33.897700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:33.897700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:33.897700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:33.897700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:33.897700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:33.897700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:33.897700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:33.897700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:33.897700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:33.897700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:33.897700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:33.897700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:33.897700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:33.897700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:33.898699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:33.898699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:33.898699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:33.898699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:33.898699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:33.898699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:33.898699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:33.898699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:33.898699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:33.898699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:33.898699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:33.898699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:33.898699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:33.898699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:33.898699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:33.898699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:33.898699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:33.899810 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:33.899810 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:33.899810 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:33.899810 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:33.903267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 297/611] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:33:33.905252 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd5392-5f68-4cbf-bee6-1a1dc421346d None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:33.913859 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 315/612] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:33:33 2022] PUT /identity/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/e4e5d4fe283447c59672398a26dea225/roles/c1ee07ef1a1f4986afc3af5a357e2c4c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:33:34.008938 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd5392-5f68-4cbf-bee6-1a1dc421346d None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:34.043459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c85d6-0ccf-4317-8a88-6ba861bd87ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:34.044128 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c85d6-0ccf-4317-8a88-6ba861bd87ad None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:34.044409 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c85d6-0ccf-4317-8a88-6ba861bd87ad None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:34.044680 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c85d6-0ccf-4317-8a88-6ba861bd87ad None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:34.045403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c85d6-0ccf-4317-8a88-6ba861bd87ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:34.045706 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c85d6-0ccf-4317-8a88-6ba861bd87ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:34.047121 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c85d6-0ccf-4317-8a88-6ba861bd87ad None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:34.060473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 298/613] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:34.066582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b9977-85b3-472a-85fc-7b74c6261cd9 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:34.171519 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b9977-85b3-472a-85fc-7b74c6261cd9 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:34.206020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c054d-28d7-43b2-a0a6-23c0058c43ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:34.206875 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c054d-28d7-43b2-a0a6-23c0058c43ea None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:34.207389 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c054d-28d7-43b2-a0a6-23c0058c43ea None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:34.207671 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c054d-28d7-43b2-a0a6-23c0058c43ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:34.215566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c054d-28d7-43b2-a0a6-23c0058c43ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:34.217021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c054d-28d7-43b2-a0a6-23c0058c43ea None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:34.232329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-943c054d-28d7-43b2-a0a6-23c0058c43ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 21:33:34.232329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:34.232329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:34.232329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:34.232329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:34.232329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:34.232329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:34.232329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:34.232329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:34.232329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:34.232329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:34.232329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:34.232329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:34.232329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:34.232329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:34.232329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:34.233330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:34.233330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:34.233330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:34.233330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:34.233330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:34.233330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:34.233330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:34.233330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:34.233330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:34.233330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:34.233330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:34.233330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:34.233330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:34.233330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:34.233330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:34.233330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:34.233330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:34.233330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:34.234251 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:34.234251 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:34.234251 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:34.234251 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:34.234251 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:34.234251 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:34.234251 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:34.234251 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:34.234251 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 21:33:34.234251 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:34.234251 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 316/614] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:33:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:34.239606 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c85d6-0ccf-4317-8a88-6ba861bd87ad None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:34.339440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c85d6-0ccf-4317-8a88-6ba861bd87ad None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:34.372842 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6725c0-ec59-470f-bd03-029783284a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:34.373512 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6725c0-ec59-470f-bd03-029783284a59 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:34.373788 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6725c0-ec59-470f-bd03-029783284a59 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:34.374054 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6725c0-ec59-470f-bd03-029783284a59 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:34.374892 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6725c0-ec59-470f-bd03-029783284a59 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:34.375272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6725c0-ec59-470f-bd03-029783284a59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:34.376735 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6725c0-ec59-470f-bd03-029783284a59 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:34.394348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 299/615] 10.222.0.11 () {56 vars in 1135 bytes} [Wed May 4 21:33:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:34.399822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c054d-28d7-43b2-a0a6-23c0058c43ea None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:34.498246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c054d-28d7-43b2-a0a6-23c0058c43ea None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:34.534633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c18f1-c778-41dc-9f0d-e4be7b92bc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:34.535468 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c18f1-c778-41dc-9f0d-e4be7b92bc24 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:34.535744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c18f1-c778-41dc-9f0d-e4be7b92bc24 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:34.536019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c18f1-c778-41dc-9f0d-e4be7b92bc24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:34.546306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c18f1-c778-41dc-9f0d-e4be7b92bc24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:34.547792 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c18f1-c778-41dc-9f0d-e4be7b92bc24 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:34.565329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-9d6c18f1-c778-41dc-9f0d-e4be7b92bc24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:34.565329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:34.565329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:34.565329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:34.565329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:34.565329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:34.565329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:34.565329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:34.565329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:34.565329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:34.565329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:34.565329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:34.565329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:34.565329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:34.565329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:34.567418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:34.567418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:34.567418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:34.567418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:34.567418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:34.567418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:34.567418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:34.567418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:34.567418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:34.567418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:34.567418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:34.567418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:34.567418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:34.567418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:34.567418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:34.567418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:34.567418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:34.569473 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:34.569473 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:34.569473 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:34.569473 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:34.569473 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 317/616] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:34.572889 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6725c0-ec59-470f-bd03-029783284a59 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:34.699193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6725c0-ec59-470f-bd03-029783284a59 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:34.732551 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5afb8-2c25-409e-8702-a96f27e1dd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:34.733264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5afb8-2c25-409e-8702-a96f27e1dd16 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:34.733545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5afb8-2c25-409e-8702-a96f27e1dd16 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:34.733819 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5afb8-2c25-409e-8702-a96f27e1dd16 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:34.734540 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5afb8-2c25-409e-8702-a96f27e1dd16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:34.734842 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5afb8-2c25-409e-8702-a96f27e1dd16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:34.736264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5afb8-2c25-409e-8702-a96f27e1dd16 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:34.748021 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 300/617] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:34.753551 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c18f1-c778-41dc-9f0d-e4be7b92bc24 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:34.851836 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c18f1-c778-41dc-9f0d-e4be7b92bc24 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:34.884648 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca47d4-2392-4165-b420-cc994bfa47de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:34.885627 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca47d4-2392-4165-b420-cc994bfa47de None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:34.885913 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca47d4-2392-4165-b420-cc994bfa47de None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:34.886184 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca47d4-2392-4165-b420-cc994bfa47de None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:34.894058 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca47d4-2392-4165-b420-cc994bfa47de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:34.895579 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca47d4-2392-4165-b420-cc994bfa47de None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:34.910803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-49ca47d4-2392-4165-b420-cc994bfa47de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:34.910803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:34.910803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:34.910803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:34.910803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:34.910803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:34.910803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:34.910803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:34.910803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:34.910803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:34.910803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:34.910803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:34.910803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:34.910803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:34.910803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:34.914024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:34.914024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:34.914024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:34.914024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:34.914024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:34.914024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:34.914024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:34.914024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:34.914024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:34.914024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:34.914024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:34.914024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:34.914024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:34.914024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:34.914024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:34.914024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:34.914024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:34.916290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:34.916290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:34.916290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:34.916290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:34.916290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:34.916290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:34.916290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:34.916290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:34.916290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 318/618] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:34.923186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5afb8-2c25-409e-8702-a96f27e1dd16 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:35.026843 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5afb8-2c25-409e-8702-a96f27e1dd16 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:35.065557 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bca01-48ba-45d2-b1f1-73da6539d7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:35.066359 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bca01-48ba-45d2-b1f1-73da6539d7ed None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:35.066548 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bca01-48ba-45d2-b1f1-73da6539d7ed None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:35.066803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bca01-48ba-45d2-b1f1-73da6539d7ed None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:35.067568 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bca01-48ba-45d2-b1f1-73da6539d7ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:35.067874 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bca01-48ba-45d2-b1f1-73da6539d7ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:35.069344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bca01-48ba-45d2-b1f1-73da6539d7ed None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:35.082690 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 301/619] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:35.088498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca47d4-2392-4165-b420-cc994bfa47de None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:35.114978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95084c-8eb3-4607-86f9-6ff65b88ed4e None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:35.114978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95084c-8eb3-4607-86f9-6ff65b88ed4e None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:35.114978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95084c-8eb3-4607-86f9-6ff65b88ed4e None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:35.116519 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 302/620] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:35.145165 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e94de-30d1-4dcf-9417-8a5b4bbe5eba None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:35.145501 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e94de-30d1-4dcf-9417-8a5b4bbe5eba None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:35.145692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e94de-30d1-4dcf-9417-8a5b4bbe5eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:35.176265 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-1c9e94de-30d1-4dcf-9417-8a5b4bbe5eba None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:35.177802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-1c9e94de-30d1-4dcf-9417-8a5b4bbe5eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:35.228580 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca47d4-2392-4165-b420-cc994bfa47de None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:35.264907 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 303/621] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:33:35.296899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cd12f-2649-4067-9f22-a5782a62c212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:35.298484 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cd12f-2649-4067-9f22-a5782a62c212 None admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:35.299153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cd12f-2649-4067-9f22-a5782a62c212 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:35.299814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cd12f-2649-4067-9f22-a5782a62c212 None admin] PATH_INFO: `/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/8358da535a104873ad9f5676989a9e21/roles/c1ee07ef1a1f4986afc3af5a357e2c4c` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:35.317108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e94de-30d1-4dcf-9417-8a5b4bbe5eba None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:35.329750 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cd12f-2649-4067-9f22-a5782a62c212 None admin] RBAC: Authorizing `identity:create_grant(project_id=3acb142d1aa34e18a018d3fdee8d7038, user_id=8358da535a104873ad9f5676989a9e21, role_id=c1ee07ef1a1f4986afc3af5a357e2c4c)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:35.331247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cd12f-2649-4067-9f22-a5782a62c212 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:35.351954 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 319/622] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:33:35 2022] PUT /identity/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/8358da535a104873ad9f5676989a9e21/roles/c1ee07ef1a1f4986afc3af5a357e2c4c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:33:35.458880 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e94de-30d1-4dcf-9417-8a5b4bbe5eba None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:35.501735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ecb0b-eea4-45bc-be0b-2762d389f087 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:35.502100 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ecb0b-eea4-45bc-be0b-2762d389f087 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:35.502292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ecb0b-eea4-45bc-be0b-2762d389f087 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:35.505155 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 320/623] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:33:35.505853 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc3a1c-b1c2-4598-9b95-1d3a2c4d8ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:35.506887 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc3a1c-b1c2-4598-9b95-1d3a2c4d8ce0 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:35.507379 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc3a1c-b1c2-4598-9b95-1d3a2c4d8ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:35.507825 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc3a1c-b1c2-4598-9b95-1d3a2c4d8ce0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:35.509837 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53a41b-0f13-4036-95f6-ce344bc4a7c9 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:35.510199 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53a41b-0f13-4036-95f6-ce344bc4a7c9 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:35.510560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53a41b-0f13-4036-95f6-ce344bc4a7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:35.520714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc3a1c-b1c2-4598-9b95-1d3a2c4d8ce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:35.529257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-19fc3a1c-b1c2-4598-9b95-1d3a2c4d8ce0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:35.529257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:35.529257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:35.529257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:35.529257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:35.529257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:35.529257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:35.529257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:35.529257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:35.529257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:35.529257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:35.529257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:35.529257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:35.529257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:35.529257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:35.529257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:35.530344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:35.530344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:35.530344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:35.530344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:35.530344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:35.530344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:35.530344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:35.530344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:35.530344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:35.530344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:35.530344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:35.530344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:35.530344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:35.530344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:35.530344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:35.530344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:35.531244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:35.531244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:35.531244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:35.531244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:35.531244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:35.531244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:35.531244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:35.531244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:35.531244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:35.531244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:35.531244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:35.531244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:35.534063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 304/624] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:35.542211 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc3a1c-b1c2-4598-9b95-1d3a2c4d8ce0 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:35.546308 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-1e53a41b-0f13-4036-95f6-ce344bc4a7c9 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:35.548872 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-1e53a41b-0f13-4036-95f6-ce344bc4a7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:35.668284 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 321/625] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:35.692962 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc3a1c-b1c2-4598-9b95-1d3a2c4d8ce0 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:35.693758 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53a41b-0f13-4036-95f6-ce344bc4a7c9 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:35.726374 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d72b9e-edaf-4ce4-8f88-9f1057477001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:35.727078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d72b9e-edaf-4ce4-8f88-9f1057477001 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:35.727361 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d72b9e-edaf-4ce4-8f88-9f1057477001 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:35.727637 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d72b9e-edaf-4ce4-8f88-9f1057477001 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:35.728435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d72b9e-edaf-4ce4-8f88-9f1057477001 None admin] RBAC: Adding query filter params (name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:35.728738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d72b9e-edaf-4ce4-8f88-9f1057477001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:35.730118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d72b9e-edaf-4ce4-8f88-9f1057477001 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:35.738570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 305/626] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:33:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:35.743878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d72b9e-edaf-4ce4-8f88-9f1057477001 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:35.822079 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53a41b-0f13-4036-95f6-ce344bc4a7c9 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:35.855164 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d72b9e-edaf-4ce4-8f88-9f1057477001 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:35.890934 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220559e-465a-4163-b0b0-031ef5189392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:35.892281 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220559e-465a-4163-b0b0-031ef5189392 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:35.892644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220559e-465a-4163-b0b0-031ef5189392 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:35.893115 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220559e-465a-4163-b0b0-031ef5189392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:35.905744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220559e-465a-4163-b0b0-031ef5189392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:35.907412 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756b1f6-4954-4c23-a5fe-ea23ae3b8889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:35.907747 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220559e-465a-4163-b0b0-031ef5189392 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:35.911074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756b1f6-4954-4c23-a5fe-ea23ae3b8889 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:35.911074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756b1f6-4954-4c23-a5fe-ea23ae3b8889 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:35.911074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756b1f6-4954-4c23-a5fe-ea23ae3b8889 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:35.927064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756b1f6-4954-4c23-a5fe-ea23ae3b8889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:35.931275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-0756b1f6-4954-4c23-a5fe-ea23ae3b8889 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:35.931275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:35.931275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:35.931275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:35.931275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:35.931275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:35.931275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:35.931275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:35.931275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:35.931275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:35.931275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:35.931275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:35.931275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:35.931275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:35.931275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:35.931275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:35.932402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:35.932402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:35.932402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:35.932402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:35.932402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:35.932402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:35.932402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:35.932402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:35.932402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:35.932402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:35.932402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:35.932402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:35.932402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:35.932402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:35.932402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:35.932402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:35.933414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:35.933414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:35.933414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:35.933414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:35.933414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:35.933414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:35.933414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:35.933414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:35.933414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:35.933414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:35.933414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:35.933414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:35.935418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 322/627] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:33:35.940803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756b1f6-4954-4c23-a5fe-ea23ae3b8889 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:35.955067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-e220559e-465a-4163-b0b0-031ef5189392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:35.955067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:35.955067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:35.955067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:35.955067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:35.955067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:35.955067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:35.955067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:35.955067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:35.955067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:35.955067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:35.955067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:35.955067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:35.955067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:35.955067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:35.956111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:35.956111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:35.956111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:35.956111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:35.956111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:35.956111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:35.956111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:35.956111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:35.956111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:35.956111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:35.956111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:35.956111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:35.956111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:35.956111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:35.956111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:35.956111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:35.956111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:35.957176 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:35.957176 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:35.957176 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:35.957176 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:35.959093 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 306/628] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:35.972561 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220559e-465a-4163-b0b0-031ef5189392 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:36.051957 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756b1f6-4954-4c23-a5fe-ea23ae3b8889 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:36.092082 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0049aa-aab7-48e7-9f5c-79c19603474a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:36.092682 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0049aa-aab7-48e7-9f5c-79c19603474a None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:36.092966 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0049aa-aab7-48e7-9f5c-79c19603474a None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:36.093243 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0049aa-aab7-48e7-9f5c-79c19603474a None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:36.093994 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0049aa-aab7-48e7-9f5c-79c19603474a None admin] RBAC: Adding query filter params (name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:36.094300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0049aa-aab7-48e7-9f5c-79c19603474a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:36.095716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0049aa-aab7-48e7-9f5c-79c19603474a None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:36.122353 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 323/629] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:33:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:36.140562 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0049aa-aab7-48e7-9f5c-79c19603474a None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:36.183574 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220559e-465a-4163-b0b0-031ef5189392 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:36.224063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17071078-8fec-419d-a3f0-fd74ecb3ce07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:36.224731 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17071078-8fec-419d-a3f0-fd74ecb3ce07 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:36.225012 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17071078-8fec-419d-a3f0-fd74ecb3ce07 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:36.225294 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17071078-8fec-419d-a3f0-fd74ecb3ce07 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:36.225996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17071078-8fec-419d-a3f0-fd74ecb3ce07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:36.226301 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17071078-8fec-419d-a3f0-fd74ecb3ce07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:36.231534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17071078-8fec-419d-a3f0-fd74ecb3ce07 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:36.256104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 307/630] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:36.262781 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17071078-8fec-419d-a3f0-fd74ecb3ce07 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:36.349718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0049aa-aab7-48e7-9f5c-79c19603474a None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:36.382974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17071078-8fec-419d-a3f0-fd74ecb3ce07 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:36.420374 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44abb8-715b-433e-a37b-39be55ed092e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:36.421315 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44abb8-715b-433e-a37b-39be55ed092e None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:36.421594 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44abb8-715b-433e-a37b-39be55ed092e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:36.421867 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44abb8-715b-433e-a37b-39be55ed092e None admin] PATH_INFO: `/v3/users/nova` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:36.430365 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44abb8-715b-433e-a37b-39be55ed092e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:36.432174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44abb8-715b-433e-a37b-39be55ed092e None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:36.432978 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf4a51-ccaf-4cc1-9404-e615d8b13f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:36.434011 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf4a51-ccaf-4cc1-9404-e615d8b13f54 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:36.434602 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf4a51-ccaf-4cc1-9404-e615d8b13f54 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:36.435104 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf4a51-ccaf-4cc1-9404-e615d8b13f54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:36.447830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-6d44abb8-715b-433e-a37b-39be55ed092e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 21:33:36.447830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:36.447830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:36.447830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:36.447830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:36.447830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:36.447830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:36.447830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:36.447830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:36.447830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:36.447830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:36.447830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:36.447830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:36.447830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:36.447830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:36.447830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:36.448830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:36.448830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:36.448830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:36.448830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:36.448830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:36.448830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:36.448830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:36.448830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:36.448830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:36.448830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:36.448830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:36.448830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:36.448830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:36.448830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:36.448830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:36.448830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:36.448830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:36.448830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:36.449815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:36.449815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:36.449815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:36.449815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:36.449815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:36.449815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:36.449815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:36.449815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:36.449815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 21:33:36.449815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:36.449815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 308/631] 10.222.0.11 () {56 vars in 1093 bytes} [Wed May 4 21:33:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:36.456503 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44abb8-715b-433e-a37b-39be55ed092e None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:36.463666 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf4a51-ccaf-4cc1-9404-e615d8b13f54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:36.466105 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf4a51-ccaf-4cc1-9404-e615d8b13f54 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:36.493760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-fbaf4a51-ccaf-4cc1-9404-e615d8b13f54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:36.493760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:36.493760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:36.493760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:36.493760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:36.493760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:36.493760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:36.493760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:36.493760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:36.493760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:36.493760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:36.493760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:36.493760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:36.493760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:36.493760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:36.494738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:36.494738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:36.494738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:36.494738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:36.494738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:36.494738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:36.494738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:36.494738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:36.494738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:36.494738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:36.494738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:36.494738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:36.494738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:36.494738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:36.494738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:36.494738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:36.494738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:36.495749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:36.495749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:36.495749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:36.495749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:36.506461 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 324/632] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:33:36.511663 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf4a51-ccaf-4cc1-9404-e615d8b13f54 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:36.602870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44abb8-715b-433e-a37b-39be55ed092e None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:36.638692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23bc96-1778-428e-98c5-445cc6266854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:36.639713 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23bc96-1778-428e-98c5-445cc6266854 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:36.640168 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23bc96-1778-428e-98c5-445cc6266854 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:36.640631 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23bc96-1778-428e-98c5-445cc6266854 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:36.641653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23bc96-1778-428e-98c5-445cc6266854 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:36.642130 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23bc96-1778-428e-98c5-445cc6266854 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:36.643760 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23bc96-1778-428e-98c5-445cc6266854 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:36.647945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf4a51-ccaf-4cc1-9404-e615d8b13f54 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:36.661937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 309/633] 10.222.0.11 () {56 vars in 1133 bytes} [Wed May 4 21:33:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:36.663591 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633bc5c-9fa6-40d3-a430-e7b46335f40c None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:36.664071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633bc5c-9fa6-40d3-a430-e7b46335f40c None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:36.664514 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633bc5c-9fa6-40d3-a430-e7b46335f40c None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:36.670064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 310/634] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:36.671109 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633bc5c-9fa6-40d3-a430-e7b46335f40c None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:36.685716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f991e-d883-4629-8425-cc2684ab25c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:36.686389 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f991e-d883-4629-8425-cc2684ab25c7 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:36.686671 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f991e-d883-4629-8425-cc2684ab25c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:36.686947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f991e-d883-4629-8425-cc2684ab25c7 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:36.687868 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f991e-d883-4629-8425-cc2684ab25c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:36.688183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f991e-d883-4629-8425-cc2684ab25c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:36.690176 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f991e-d883-4629-8425-cc2684ab25c7 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:36.707118 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 325/635] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:36.708670 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891b320-124b-4a3e-b08d-09c96dabb9e6 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:36.709126 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891b320-124b-4a3e-b08d-09c96dabb9e6 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:36.709582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891b320-124b-4a3e-b08d-09c96dabb9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:36.735536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-b891b320-124b-4a3e-b08d-09c96dabb9e6 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:36.736988 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-b891b320-124b-4a3e-b08d-09c96dabb9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:36.779429 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633bc5c-9fa6-40d3-a430-e7b46335f40c None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:36.812705 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b24b8-4d3b-4592-b561-da0abeaad86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:36.813367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b24b8-4d3b-4592-b561-da0abeaad86e None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:36.813647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b24b8-4d3b-4592-b561-da0abeaad86e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:36.813920 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b24b8-4d3b-4592-b561-da0abeaad86e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:36.822105 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 326/636] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:36.822105 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891b320-124b-4a3e-b08d-09c96dabb9e6 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:36.888402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b24b8-4d3b-4592-b561-da0abeaad86e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:36.889757 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b24b8-4d3b-4592-b561-da0abeaad86e None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:36.928918 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891b320-124b-4a3e-b08d-09c96dabb9e6 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:36.961094 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33bb4da-9d77-4137-be1a-ebc300fb7e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:36.961891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bb4da-9d77-4137-be1a-ebc300fb7e94 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:36.962168 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bb4da-9d77-4137-be1a-ebc300fb7e94 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:36.962432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bb4da-9d77-4137-be1a-ebc300fb7e94 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:36.969261 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33bb4da-9d77-4137-be1a-ebc300fb7e94 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:36.970749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33bb4da-9d77-4137-be1a-ebc300fb7e94 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:36.984962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-a33bb4da-9d77-4137-be1a-ebc300fb7e94 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 21:33:36.984962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:36.984962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:36.984962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:36.984962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:36.984962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:36.984962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:36.984962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:36.984962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:36.984962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:36.984962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:36.984962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:36.984962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:36.984962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:36.984962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:36.984962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:36.986095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:36.986095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:36.986095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:36.986095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:36.986095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:36.986095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:36.986095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:36.986095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:36.986095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:36.986095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:36.986095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:36.986095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:36.986095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:36.986095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:36.986095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:36.986095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:36.986095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:36.986095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:36.987004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:36.987004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:36.987004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:36.987004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:36.987004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:36.987004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:36.987004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:36.987004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:36.987004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 21:33:36.987004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:36.987004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 327/637] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:36.988026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15d1b1-5c27-4a89-bdd5-763d8915fde5 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:36.988026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15d1b1-5c27-4a89-bdd5-763d8915fde5 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:36.988026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15d1b1-5c27-4a89-bdd5-763d8915fde5 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:36.989273 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 328/638] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:36.989744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15d1b1-5c27-4a89-bdd5-763d8915fde5 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:36.997498 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 311/639] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:36.998393 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b24b8-4d3b-4592-b561-da0abeaad86e None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:37.093047 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15d1b1-5c27-4a89-bdd5-763d8915fde5 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:37.093980 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b24b8-4d3b-4592-b561-da0abeaad86e None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:37.125830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f5932-b63b-4277-8945-164be0cfeb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:37.126243 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa987d-3a6c-4e05-a8f8-799349f0857d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:37.126502 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f5932-b63b-4277-8945-164be0cfeb26 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:37.126807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f5932-b63b-4277-8945-164be0cfeb26 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:37.127065 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa987d-3a6c-4e05-a8f8-799349f0857d None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:37.127163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f5932-b63b-4277-8945-164be0cfeb26 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:37.127353 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa987d-3a6c-4e05-a8f8-799349f0857d None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:37.127765 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa987d-3a6c-4e05-a8f8-799349f0857d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:37.127941 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f5932-b63b-4277-8945-164be0cfeb26 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:37.128232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f5932-b63b-4277-8945-164be0cfeb26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:37.129653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f5932-b63b-4277-8945-164be0cfeb26 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:37.137839 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa987d-3a6c-4e05-a8f8-799349f0857d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:37.145631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-28fa987d-3a6c-4e05-a8f8-799349f0857d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:37.145631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:37.145631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:37.145631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:37.145631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:37.145631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:37.145631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:37.145631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:37.145631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:37.145631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:37.145631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:37.145631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:37.145631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:37.145631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:37.145631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:37.145631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:37.146517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:37.146517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:37.146517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:37.146517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:37.146517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:37.146517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:37.146517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:37.146517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:37.146517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:37.146517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:37.146517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:37.146517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:37.146517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:37.146517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:37.146517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:37.146517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:37.152786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:37.152786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:37.152786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:37.152786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:37.152786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:37.152786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:37.152786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:37.152786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:37.152786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:37.152786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:37.152786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:37.152786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:37.152786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 329/640] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:37.153723 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 312/641] 10.222.0.11 () {56 vars in 1137 bytes} [Wed May 4 21:33:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:37.153723 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f5932-b63b-4277-8945-164be0cfeb26 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:37.153860 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b9e4d-c64d-4f6d-9ad9-01572a4693a7 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:37.153860 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b9e4d-c64d-4f6d-9ad9-01572a4693a7 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:37.153860 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b9e4d-c64d-4f6d-9ad9-01572a4693a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:37.169795 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-d37b9e4d-c64d-4f6d-9ad9-01572a4693a7 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:37.171027 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-d37b9e4d-c64d-4f6d-9ad9-01572a4693a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:37.234959 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 330/642] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:37.235821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b9e4d-c64d-4f6d-9ad9-01572a4693a7 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:37.253835 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f5932-b63b-4277-8945-164be0cfeb26 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:37.287582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf77b2f-8852-4ac2-bfa4-c783d953c8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:37.288672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf77b2f-8852-4ac2-bfa4-c783d953c8b0 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:37.288954 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf77b2f-8852-4ac2-bfa4-c783d953c8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:37.289231 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf77b2f-8852-4ac2-bfa4-c783d953c8b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:37.299731 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf77b2f-8852-4ac2-bfa4-c783d953c8b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:37.301156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf77b2f-8852-4ac2-bfa4-c783d953c8b0 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:37.318099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-3bf77b2f-8852-4ac2-bfa4-c783d953c8b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:37.318099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:37.318099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:37.318099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:37.318099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:37.318099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:37.318099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:37.318099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:37.318099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:37.318099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:37.318099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:37.318099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:37.318099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:37.318099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:37.318099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:37.319233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:37.319233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:37.319233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:37.319233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:37.319233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:37.319233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:37.319233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:37.319233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:37.319233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:37.319233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:37.319233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:37.319233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:37.319233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:37.319233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:37.319233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:37.319233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:37.319233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:37.320144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:37.320144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:37.320144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:37.320144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:37.320144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 313/643] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:37.320144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf77b2f-8852-4ac2-bfa4-c783d953c8b0 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:37.344802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b9e4d-c64d-4f6d-9ad9-01572a4693a7 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:37.379713 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8bd5c-045b-49e9-9fd3-0e98b4619a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:37.380478 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8bd5c-045b-49e9-9fd3-0e98b4619a43 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:37.381056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8bd5c-045b-49e9-9fd3-0e98b4619a43 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:37.381056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8bd5c-045b-49e9-9fd3-0e98b4619a43 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:37.381669 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8bd5c-045b-49e9-9fd3-0e98b4619a43 None admin] RBAC: Adding query filter params (name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:37.381975 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8bd5c-045b-49e9-9fd3-0e98b4619a43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:37.383382 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8bd5c-045b-49e9-9fd3-0e98b4619a43 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:37.396712 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 331/644] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:33:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:37.396712 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8bd5c-045b-49e9-9fd3-0e98b4619a43 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:37.427459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf77b2f-8852-4ac2-bfa4-c783d953c8b0 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:37.462056 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7c0bc-61e8-4891-8817-caae9efadddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:37.462773 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7c0bc-61e8-4891-8817-caae9efadddc None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:37.463082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7c0bc-61e8-4891-8817-caae9efadddc None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:37.463389 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7c0bc-61e8-4891-8817-caae9efadddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:37.491829 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8bd5c-045b-49e9-9fd3-0e98b4619a43 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:37.524706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa5192-da0b-4931-be38-170a0c942daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:37.525919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa5192-da0b-4931-be38-170a0c942daa None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:37.526299 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa5192-da0b-4931-be38-170a0c942daa None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:37.526582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa5192-da0b-4931-be38-170a0c942daa None admin] PATH_INFO: `/v3/roles/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:37.529542 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7c0bc-61e8-4891-8817-caae9efadddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:37.531010 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7c0bc-61e8-4891-8817-caae9efadddc None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:37.536810 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa5192-da0b-4931-be38-170a0c942daa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:37.544539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-f0fa5192-da0b-4931-be38-170a0c942daa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:37.544539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:37.544539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:37.544539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:37.544539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:37.544539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:37.544539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:37.544539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:37.544539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:37.544539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:37.544539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:37.544539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:37.544539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:37.544539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:37.544539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:37.544539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:37.545514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:37.545514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:37.545514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:37.545514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:37.545514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:37.545514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:37.545514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:37.545514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:37.545514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:37.545514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:37.545514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:37.545514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:37.545514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:37.545514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:37.545514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:37.545514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:37.546398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:37.546398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:37.546398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:37.546398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:37.546398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:37.546398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:37.546398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:37.546398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:37.546398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:37.546398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:37.546398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:37.546398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:37.546398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 332/645] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:37.547155 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa5192-da0b-4931-be38-170a0c942daa None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:37.648837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 314/646] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:37.648837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7c0bc-61e8-4891-8817-caae9efadddc None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:37.663386 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa5192-da0b-4931-be38-170a0c942daa None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:37.697628 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390726d7-2460-4835-b4ef-15ae7bfc4c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:37.698290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390726d7-2460-4835-b4ef-15ae7bfc4c26 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:37.698576 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390726d7-2460-4835-b4ef-15ae7bfc4c26 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:37.698846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390726d7-2460-4835-b4ef-15ae7bfc4c26 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:37.699603 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390726d7-2460-4835-b4ef-15ae7bfc4c26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:37.699913 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390726d7-2460-4835-b4ef-15ae7bfc4c26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:37.701289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390726d7-2460-4835-b4ef-15ae7bfc4c26 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:37.717856 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 333/647] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:37.717856 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390726d7-2460-4835-b4ef-15ae7bfc4c26 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:37.750246 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7c0bc-61e8-4891-8817-caae9efadddc None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:37.784943 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4757bd-2af1-4f77-a1d8-dd563c5a76bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:37.785761 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4757bd-2af1-4f77-a1d8-dd563c5a76bf None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:37.786025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4757bd-2af1-4f77-a1d8-dd563c5a76bf None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:37.786308 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4757bd-2af1-4f77-a1d8-dd563c5a76bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:37.798545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4757bd-2af1-4f77-a1d8-dd563c5a76bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:37.800324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4757bd-2af1-4f77-a1d8-dd563c5a76bf None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:37.816433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390726d7-2460-4835-b4ef-15ae7bfc4c26 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:37.817724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-2a4757bd-2af1-4f77-a1d8-dd563c5a76bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:37.817724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:37.817724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:37.817724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:37.817724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:37.817724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:37.817724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:37.817724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:37.817724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:37.817724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:37.817724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:37.817724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:37.817724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:37.817724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:37.817724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:37.818816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:37.818816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:37.818816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:37.818816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:37.818816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:37.818816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:37.818816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:37.818816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:37.818816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:37.818816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:37.818816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:37.818816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:37.818816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:37.818816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:37.818816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:37.818816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:37.818816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:37.819896 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:37.819896 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:37.819896 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:37.819896 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:37.819896 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 315/648] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:37.821622 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4757bd-2af1-4f77-a1d8-dd563c5a76bf None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:37.861447 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb2831-55be-4708-93b9-9c2dbb3c193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:37.862164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb2831-55be-4708-93b9-9c2dbb3c193d None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:37.862453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb2831-55be-4708-93b9-9c2dbb3c193d None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:37.862735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb2831-55be-4708-93b9-9c2dbb3c193d None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:37.863533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb2831-55be-4708-93b9-9c2dbb3c193d None admin] RBAC: Adding query filter params (name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:37.863846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb2831-55be-4708-93b9-9c2dbb3c193d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:37.865236 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb2831-55be-4708-93b9-9c2dbb3c193d None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:37.875335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 334/649] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:33:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:37.875335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb2831-55be-4708-93b9-9c2dbb3c193d None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:37.923984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4757bd-2af1-4f77-a1d8-dd563c5a76bf None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:37.956421 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1204c8f-9c6e-4289-8e32-781db4be10f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:37.957304 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1204c8f-9c6e-4289-8e32-781db4be10f7 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:37.957654 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1204c8f-9c6e-4289-8e32-781db4be10f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:37.957989 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1204c8f-9c6e-4289-8e32-781db4be10f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:37.967929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1204c8f-9c6e-4289-8e32-781db4be10f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:37.969466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1204c8f-9c6e-4289-8e32-781db4be10f7 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:37.972424 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb2831-55be-4708-93b9-9c2dbb3c193d None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:37.987156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-c1204c8f-9c6e-4289-8e32-781db4be10f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:37.987156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:37.987156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:37.987156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:37.987156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:37.987156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:37.987156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:37.987156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:37.987156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:37.987156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:37.987156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:37.987156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:37.987156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:37.987156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:37.987156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:37.988272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:37.988272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:37.988272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:37.988272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:37.988272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:37.988272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:37.988272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:37.988272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:37.988272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:37.988272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:37.988272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:37.988272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:37.988272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:37.988272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:37.988272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:37.988272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:37.988272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:37.989381 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:37.989381 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:37.989381 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:37.989381 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:37.994814 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 316/650] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:37.994814 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1204c8f-9c6e-4289-8e32-781db4be10f7 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:38.011605 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b55ea-c156-4342-9206-14837a68af6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:38.012411 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b55ea-c156-4342-9206-14837a68af6d None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:38.012696 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b55ea-c156-4342-9206-14837a68af6d None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:38.012972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b55ea-c156-4342-9206-14837a68af6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:38.019575 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b55ea-c156-4342-9206-14837a68af6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:38.021022 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b55ea-c156-4342-9206-14837a68af6d None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:38.035108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-d15b55ea-c156-4342-9206-14837a68af6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:38.035108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:38.035108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:38.035108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:38.035108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:38.035108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:38.035108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:38.035108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:38.035108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:38.035108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:38.035108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:38.035108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:38.035108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:38.035108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:38.035108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:38.036086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:38.036086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:38.036086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:38.036086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:38.036086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:38.036086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:38.036086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:38.036086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:38.036086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:38.036086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:38.036086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:38.036086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:38.036086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:38.036086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:38.036086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:38.036086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:38.036086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:38.037095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:38.037095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:38.037095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:38.037095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:38.037095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:38.037095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:38.037095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:38.037095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:38.037783 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 335/651] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:38.038589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b55ea-c156-4342-9206-14837a68af6d None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:38.086885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1204c8f-9c6e-4289-8e32-781db4be10f7 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:38.120184 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a3c2b-62db-4166-b20f-f4554e00727d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:38.120849 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a3c2b-62db-4166-b20f-f4554e00727d None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:38.121129 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a3c2b-62db-4166-b20f-f4554e00727d None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:38.121410 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a3c2b-62db-4166-b20f-f4554e00727d None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:38.122129 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a3c2b-62db-4166-b20f-f4554e00727d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:38.122445 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a3c2b-62db-4166-b20f-f4554e00727d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:38.123854 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a3c2b-62db-4166-b20f-f4554e00727d None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:38.129676 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b55ea-c156-4342-9206-14837a68af6d None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:38.135007 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 317/652] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:38.135822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a3c2b-62db-4166-b20f-f4554e00727d None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:38.161789 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd189d-16e8-472b-b98d-0f1e957e0808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:38.162583 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd189d-16e8-472b-b98d-0f1e957e0808 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:38.162864 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd189d-16e8-472b-b98d-0f1e957e0808 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:38.163164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd189d-16e8-472b-b98d-0f1e957e0808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:38.172708 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd189d-16e8-472b-b98d-0f1e957e0808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:38.174200 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd189d-16e8-472b-b98d-0f1e957e0808 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:38.191375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-20bd189d-16e8-472b-b98d-0f1e957e0808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:38.191375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:38.191375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:38.191375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:38.191375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:38.191375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:38.191375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:38.191375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:38.191375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:38.191375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:38.191375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:38.191375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:38.191375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:38.191375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:38.191375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:38.192425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:38.192425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:38.192425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:38.192425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:38.192425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:38.192425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:38.192425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:38.192425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:38.192425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:38.192425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:38.192425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:38.192425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:38.192425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:38.192425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:38.192425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:38.192425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:38.192425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:38.193307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:38.193307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:38.193307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:38.193307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:38.193307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 336/653] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:38.194067 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce894b-fe1e-4b60-82c1-7420d7b49475 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:38.194313 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce894b-fe1e-4b60-82c1-7420d7b49475 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:38.194587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce894b-fe1e-4b60-82c1-7420d7b49475 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:38.195978 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 337/654] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:38.196520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce894b-fe1e-4b60-82c1-7420d7b49475 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:38.238807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a3c2b-62db-4166-b20f-f4554e00727d None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:38.270951 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2c064-8ef9-4506-8bcb-8c4eb154e166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:38.271665 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2c064-8ef9-4506-8bcb-8c4eb154e166 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:38.271949 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2c064-8ef9-4506-8bcb-8c4eb154e166 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:38.272230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2c064-8ef9-4506-8bcb-8c4eb154e166 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:38.272954 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2c064-8ef9-4506-8bcb-8c4eb154e166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:38.273267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2c064-8ef9-4506-8bcb-8c4eb154e166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:38.274639 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2c064-8ef9-4506-8bcb-8c4eb154e166 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:38.286152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 318/655] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:38.286925 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2c064-8ef9-4506-8bcb-8c4eb154e166 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:38.295600 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce894b-fe1e-4b60-82c1-7420d7b49475 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:38.329509 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e529139-8093-44b2-881b-959cf907196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:38.330198 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e529139-8093-44b2-881b-959cf907196a None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:38.330480 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e529139-8093-44b2-881b-959cf907196a None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:38.330749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e529139-8093-44b2-881b-959cf907196a None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:38.331559 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e529139-8093-44b2-881b-959cf907196a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:38.331877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e529139-8093-44b2-881b-959cf907196a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:38.333326 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e529139-8093-44b2-881b-959cf907196a None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:38.344629 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 338/656] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:38.345248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e529139-8093-44b2-881b-959cf907196a None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:38.384005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2c064-8ef9-4506-8bcb-8c4eb154e166 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:38.417445 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d6eec-d4c2-4978-b72a-eadc9d0deca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:38.418255 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d6eec-d4c2-4978-b72a-eadc9d0deca9 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:38.418525 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d6eec-d4c2-4978-b72a-eadc9d0deca9 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:38.418822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d6eec-d4c2-4978-b72a-eadc9d0deca9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:38.426029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d6eec-d4c2-4978-b72a-eadc9d0deca9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:38.427415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d6eec-d4c2-4978-b72a-eadc9d0deca9 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:38.439549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e529139-8093-44b2-881b-959cf907196a None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:38.441983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-f06d6eec-d4c2-4978-b72a-eadc9d0deca9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 21:33:38.441983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:38.441983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:38.441983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:38.441983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:38.441983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:38.441983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:38.441983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:38.441983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:38.441983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:38.441983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:38.441983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:38.441983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:38.441983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:38.441983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:38.441983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:38.442957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:38.442957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:38.442957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:38.442957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:38.442957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:38.442957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:38.442957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:38.442957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:38.442957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:38.442957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:38.442957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:38.442957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:38.442957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:38.442957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:38.442957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:38.442957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:38.442957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:38.442957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:38.443929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:38.443929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:38.443929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:38.443929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:38.443929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:38.443929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:38.443929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:38.443929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:38.443929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 21:33:38.443929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:38.443929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 319/657] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:38.444881 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94feb85-6096-4f5d-8f77-37305cb31f8a None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:38.444881 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94feb85-6096-4f5d-8f77-37305cb31f8a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:38.444881 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94feb85-6096-4f5d-8f77-37305cb31f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:38.461302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-a94feb85-6096-4f5d-8f77-37305cb31f8a None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:38.462653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a94feb85-6096-4f5d-8f77-37305cb31f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:38.473299 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd507d1c-cefe-42a2-9e2c-cfe2f38527ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:38.474287 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd507d1c-cefe-42a2-9e2c-cfe2f38527ab None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:38.474571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd507d1c-cefe-42a2-9e2c-cfe2f38527ab None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:38.474845 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd507d1c-cefe-42a2-9e2c-cfe2f38527ab None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:38.475596 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd507d1c-cefe-42a2-9e2c-cfe2f38527ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:38.475902 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd507d1c-cefe-42a2-9e2c-cfe2f38527ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:38.477272 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd507d1c-cefe-42a2-9e2c-cfe2f38527ab None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:38.489201 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 339/658] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:38.489374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd507d1c-cefe-42a2-9e2c-cfe2f38527ab None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:38.531660 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 320/659] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:38.532736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94feb85-6096-4f5d-8f77-37305cb31f8a None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:38.582178 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd507d1c-cefe-42a2-9e2c-cfe2f38527ab None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:38.614740 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8884af5-919d-427f-9599-86a11cab3671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:38.615568 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8884af5-919d-427f-9599-86a11cab3671 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:38.615882 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8884af5-919d-427f-9599-86a11cab3671 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:38.616159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8884af5-919d-427f-9599-86a11cab3671 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:38.622930 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8884af5-919d-427f-9599-86a11cab3671 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:38.624347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94feb85-6096-4f5d-8f77-37305cb31f8a None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:38.624485 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8884af5-919d-427f-9599-86a11cab3671 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:38.637998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-c8884af5-919d-427f-9599-86a11cab3671 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:38.637998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:38.637998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:38.637998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:38.637998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:38.637998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:38.637998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:38.637998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:38.637998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:38.637998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:38.637998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:38.637998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:38.637998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:38.637998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:38.637998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:38.638878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:38.638878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:38.638878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:38.638878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:38.638878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:38.638878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:38.638878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:38.638878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:38.638878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:38.638878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:38.638878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:38.638878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:38.638878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:38.638878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:38.638878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:38.638878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:38.638878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:38.639775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:38.639775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:38.639775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:38.639775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:38.639775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:38.639775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:38.639775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:38.639775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:38.639775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 340/660] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:38.640395 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8884af5-919d-427f-9599-86a11cab3671 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:38.664160 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11af8a-1f9d-43bf-b28c-d17175c83aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:38.664823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11af8a-1f9d-43bf-b28c-d17175c83aae None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:38.665103 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11af8a-1f9d-43bf-b28c-d17175c83aae None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:38.665373 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11af8a-1f9d-43bf-b28c-d17175c83aae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:38.666262 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11af8a-1f9d-43bf-b28c-d17175c83aae None admin] RBAC: Adding query filter params (role.id=c1ee07ef1a1f4986afc3af5a357e2c4c, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=f4f207481ccb4cfcbbcffd9df73d2985) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:38.666573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11af8a-1f9d-43bf-b28c-d17175c83aae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:38.668043 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11af8a-1f9d-43bf-b28c-d17175c83aae None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:38.673624 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 321/661] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:33:38 2022] GET /identity/v3/role_assignments?user.id=f4f207481ccb4cfcbbcffd9df73d2985&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=c1ee07ef1a1f4986afc3af5a357e2c4c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:38.674369 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11af8a-1f9d-43bf-b28c-d17175c83aae None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:38.747503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8884af5-919d-427f-9599-86a11cab3671 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:38.784205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89456e5d-5f8c-4f91-8b47-9e0d18d21656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:38.784892 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89456e5d-5f8c-4f91-8b47-9e0d18d21656 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:38.785173 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89456e5d-5f8c-4f91-8b47-9e0d18d21656 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:38.785454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89456e5d-5f8c-4f91-8b47-9e0d18d21656 None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:38.786296 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89456e5d-5f8c-4f91-8b47-9e0d18d21656 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:38.786623 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89456e5d-5f8c-4f91-8b47-9e0d18d21656 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:38.788088 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89456e5d-5f8c-4f91-8b47-9e0d18d21656 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:38.789456 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11af8a-1f9d-43bf-b28c-d17175c83aae None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:38.807195 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 341/662] 10.222.0.11 () {56 vars in 1137 bytes} [Wed May 4 21:33:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:38.808450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89456e5d-5f8c-4f91-8b47-9e0d18d21656 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:38.830437 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc37102-bf9e-487e-9460-e306e90b0476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:38.831387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc37102-bf9e-487e-9460-e306e90b0476 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:38.831667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc37102-bf9e-487e-9460-e306e90b0476 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:38.831940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc37102-bf9e-487e-9460-e306e90b0476 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:38.840416 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc37102-bf9e-487e-9460-e306e90b0476 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:38.841888 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc37102-bf9e-487e-9460-e306e90b0476 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:38.857921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-7cc37102-bf9e-487e-9460-e306e90b0476 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 21:33:38.857921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:38.857921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:38.857921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:38.857921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:38.857921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:38.857921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:38.857921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:38.857921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:38.857921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:38.857921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:38.857921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:38.857921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:38.857921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:38.857921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:38.857921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:38.858957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:38.858957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:38.858957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:38.858957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:38.858957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:38.858957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:38.858957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:38.858957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:38.858957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:38.858957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:38.858957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:38.858957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:38.858957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:38.858957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:38.858957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:38.858957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:38.858957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:38.858957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:38.860263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:38.860263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:38.860263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:38.860263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:38.860263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:38.860263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:38.860263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:38.860263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:38.860263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 21:33:38.860263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:38.860263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 322/663] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:38.860263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc37102-bf9e-487e-9460-e306e90b0476 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:38.916166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89456e5d-5f8c-4f91-8b47-9e0d18d21656 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:38.951305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c81ba2-e8ab-45c0-80f9-dd2048bd3bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:38.952118 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c81ba2-e8ab-45c0-80f9-dd2048bd3bdf None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:38.952397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c81ba2-e8ab-45c0-80f9-dd2048bd3bdf None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:38.952672 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c81ba2-e8ab-45c0-80f9-dd2048bd3bdf None admin] PATH_INFO: `/v3/roles/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:38.962313 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c81ba2-e8ab-45c0-80f9-dd2048bd3bdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:38.968537 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc37102-bf9e-487e-9460-e306e90b0476 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:38.970098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-b6c81ba2-e8ab-45c0-80f9-dd2048bd3bdf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:38.970098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:38.970098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:38.970098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:38.970098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:38.970098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:38.970098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:38.970098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:38.970098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:38.970098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:38.970098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:38.970098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:38.970098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:38.970098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:38.970098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:38.970098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:38.971056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:38.971056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:38.971056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:38.971056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:38.971056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:38.971056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:38.971056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:38.971056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:38.971056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:38.971056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:38.971056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:38.971056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:38.971056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:38.971056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:38.971056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:38.971056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:38.971925 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:38.971925 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:38.971925 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:38.971925 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:38.971925 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:38.971925 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:38.971925 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:38.971925 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:38.971925 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:38.971925 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:38.971925 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:38.971925 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:38.975186 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 342/664] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:38.976209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c81ba2-e8ab-45c0-80f9-dd2048bd3bdf None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:39.002439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5c69e-76de-4577-9eed-3ec7f694bea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:39.003031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5c69e-76de-4577-9eed-3ec7f694bea9 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:39.003341 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5c69e-76de-4577-9eed-3ec7f694bea9 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:39.003612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5c69e-76de-4577-9eed-3ec7f694bea9 None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:39.004398 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5c69e-76de-4577-9eed-3ec7f694bea9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:39.004704 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5c69e-76de-4577-9eed-3ec7f694bea9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:39.006119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5c69e-76de-4577-9eed-3ec7f694bea9 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:39.017904 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 323/665] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:39.019131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5c69e-76de-4577-9eed-3ec7f694bea9 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:39.078358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c81ba2-e8ab-45c0-80f9-dd2048bd3bdf None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:39.111177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c27f2b-f34f-4752-a64d-0a5ed4f3ceeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:39.111841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c27f2b-f34f-4752-a64d-0a5ed4f3ceeb None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:39.112124 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c27f2b-f34f-4752-a64d-0a5ed4f3ceeb None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:39.112400 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c27f2b-f34f-4752-a64d-0a5ed4f3ceeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:39.117496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5c69e-76de-4577-9eed-3ec7f694bea9 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:39.149300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed955d-3edb-4fc2-98fd-9898b03e4c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:39.149997 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed955d-3edb-4fc2-98fd-9898b03e4c98 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:39.150354 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed955d-3edb-4fc2-98fd-9898b03e4c98 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:39.150632 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed955d-3edb-4fc2-98fd-9898b03e4c98 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:39.151504 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed955d-3edb-4fc2-98fd-9898b03e4c98 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:39.151814 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed955d-3edb-4fc2-98fd-9898b03e4c98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:39.153335 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed955d-3edb-4fc2-98fd-9898b03e4c98 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:39.174285 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 324/666] 10.222.0.11 () {56 vars in 1139 bytes} [Wed May 4 21:33:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:39.174285 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed955d-3edb-4fc2-98fd-9898b03e4c98 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:39.177088 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c27f2b-f34f-4752-a64d-0a5ed4f3ceeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:39.178534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c27f2b-f34f-4752-a64d-0a5ed4f3ceeb None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:39.266020 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed955d-3edb-4fc2-98fd-9898b03e4c98 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:39.276309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 343/667] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:39.276309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c27f2b-f34f-4752-a64d-0a5ed4f3ceeb None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:39.301883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a4f9f-a100-45d8-b2fe-5f99b98b40a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:39.302551 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a4f9f-a100-45d8-b2fe-5f99b98b40a2 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:39.302832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a4f9f-a100-45d8-b2fe-5f99b98b40a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:39.303130 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a4f9f-a100-45d8-b2fe-5f99b98b40a2 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:39.303874 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a4f9f-a100-45d8-b2fe-5f99b98b40a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:39.304180 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a4f9f-a100-45d8-b2fe-5f99b98b40a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:39.305552 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a4f9f-a100-45d8-b2fe-5f99b98b40a2 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:39.317810 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 325/668] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:33:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:39.317810 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a4f9f-a100-45d8-b2fe-5f99b98b40a2 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:39.365669 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c27f2b-f34f-4752-a64d-0a5ed4f3ceeb None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:39.398789 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26acc8-e07d-42b2-a56b-192a2e9e69d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:39.399473 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26acc8-e07d-42b2-a56b-192a2e9e69d0 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:39.399754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26acc8-e07d-42b2-a56b-192a2e9e69d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:39.400049 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26acc8-e07d-42b2-a56b-192a2e9e69d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:39.400938 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26acc8-e07d-42b2-a56b-192a2e9e69d0 None admin] RBAC: Adding query filter params (role.id=c1ee07ef1a1f4986afc3af5a357e2c4c, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=b9a86016cde040e7b8a9eeaf34cf0715) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:39.401259 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26acc8-e07d-42b2-a56b-192a2e9e69d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:39.402688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26acc8-e07d-42b2-a56b-192a2e9e69d0 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:39.408466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 344/669] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:33:39 2022] GET /identity/v3/role_assignments?user.id=b9a86016cde040e7b8a9eeaf34cf0715&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=c1ee07ef1a1f4986afc3af5a357e2c4c => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:39.409228 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26acc8-e07d-42b2-a56b-192a2e9e69d0 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:39.423743 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a4f9f-a100-45d8-b2fe-5f99b98b40a2 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:39.458731 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92769b28-e509-4e02-87fa-ee9fc6357ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:39.459836 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92769b28-e509-4e02-87fa-ee9fc6357ed6 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:39.460318 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92769b28-e509-4e02-87fa-ee9fc6357ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:39.460803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92769b28-e509-4e02-87fa-ee9fc6357ed6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:39.511422 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26acc8-e07d-42b2-a56b-192a2e9e69d0 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:39.535579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92769b28-e509-4e02-87fa-ee9fc6357ed6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:39.536969 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92769b28-e509-4e02-87fa-ee9fc6357ed6 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:39.547892 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc768c0-a5c6-4714-abe4-ff4433a00ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:39.548701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc768c0-a5c6-4714-abe4-ff4433a00ed7 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:39.548978 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc768c0-a5c6-4714-abe4-ff4433a00ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:39.549248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc768c0-a5c6-4714-abe4-ff4433a00ed7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:39.560307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc768c0-a5c6-4714-abe4-ff4433a00ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:39.561791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc768c0-a5c6-4714-abe4-ff4433a00ed7 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:39.582369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-dcc768c0-a5c6-4714-abe4-ff4433a00ed7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:39.582369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:39.582369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:39.582369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:39.582369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:39.582369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:39.582369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:39.582369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:39.582369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:39.582369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:39.582369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:39.582369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:39.582369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:39.582369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:39.582369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:39.583344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:39.583344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:39.583344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:39.583344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:39.583344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:39.583344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:39.583344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:39.583344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:39.583344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:39.583344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:39.583344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:39.583344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:39.583344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:39.583344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:39.583344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:39.583344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:39.583344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:39.584418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:39.584418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:39.584418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:39.584418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:39.584418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 345/670] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:39.584418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc768c0-a5c6-4714-abe4-ff4433a00ed7 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:39.650679 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 326/671] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:39.651511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92769b28-e509-4e02-87fa-ee9fc6357ed6 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:39.699593 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc768c0-a5c6-4714-abe4-ff4433a00ed7 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:39.738868 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075cedd-aa1e-40ba-ab66-7e1380297c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:39.739700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075cedd-aa1e-40ba-ab66-7e1380297c05 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:39.739984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075cedd-aa1e-40ba-ab66-7e1380297c05 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:39.740259 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075cedd-aa1e-40ba-ab66-7e1380297c05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:39.750464 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075cedd-aa1e-40ba-ab66-7e1380297c05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:39.751973 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075cedd-aa1e-40ba-ab66-7e1380297c05 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:39.769224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-3075cedd-aa1e-40ba-ab66-7e1380297c05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:39.769224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:39.769224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:39.769224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:39.769224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:39.769224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:39.769224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:39.769224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:39.769224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:39.769224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:39.769224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:39.769224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:39.769224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:39.769224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:39.769224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:39.770125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:39.770125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:39.770125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:39.770125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:39.770125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:39.770125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:39.770125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:39.770125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:39.770125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:39.770125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:39.770125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:39.770125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:39.770125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:39.770125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:39.770125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:39.770125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:39.770125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:39.771465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:39.771465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:39.771465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:39.771465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:39.771465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 346/672] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:39.771754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075cedd-aa1e-40ba-ab66-7e1380297c05 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:39.783275 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92769b28-e509-4e02-87fa-ee9fc6357ed6 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:39.826956 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f1502-98a9-4911-8af4-0a5320c15cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:39.827602 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f1502-98a9-4911-8af4-0a5320c15cc4 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:39.827856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f1502-98a9-4911-8af4-0a5320c15cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:39.828287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f1502-98a9-4911-8af4-0a5320c15cc4 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:39.829401 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f1502-98a9-4911-8af4-0a5320c15cc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:39.829985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f1502-98a9-4911-8af4-0a5320c15cc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:39.831860 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f1502-98a9-4911-8af4-0a5320c15cc4 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:39.851135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 327/673] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:39.852024 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f1502-98a9-4911-8af4-0a5320c15cc4 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:39.879604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075cedd-aa1e-40ba-ab66-7e1380297c05 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:39.914024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c4182-9285-4134-a5bc-4300ff742499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:39.914829 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c4182-9285-4134-a5bc-4300ff742499 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:39.915135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c4182-9285-4134-a5bc-4300ff742499 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:39.915414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c4182-9285-4134-a5bc-4300ff742499 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:39.925843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c4182-9285-4134-a5bc-4300ff742499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:39.927634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c4182-9285-4134-a5bc-4300ff742499 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:39.945699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-6b7c4182-9285-4134-a5bc-4300ff742499 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:39.945699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:39.945699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:39.945699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:39.945699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:39.945699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:39.945699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:39.945699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:39.945699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:39.945699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:39.945699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:39.945699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:39.945699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:39.945699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:39.945699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:39.947707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:39.947707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:39.947707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:39.947707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:39.947707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:39.947707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:39.947707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:39.947707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:39.947707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:39.947707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:39.947707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:39.947707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:39.947707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:39.947707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:39.947707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:39.947707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:39.947707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:39.949800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:39.949800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:39.949800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:39.949800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:39.952661 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 347/674] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:39.952661 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c4182-9285-4134-a5bc-4300ff742499 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:39.959068 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f1502-98a9-4911-8af4-0a5320c15cc4 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:39.988691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db77357-d720-455a-ae26-a5b865f266ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:39.989359 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db77357-d720-455a-ae26-a5b865f266ea None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:39.989637 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db77357-d720-455a-ae26-a5b865f266ea None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:39.989907 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db77357-d720-455a-ae26-a5b865f266ea None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:39.990622 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db77357-d720-455a-ae26-a5b865f266ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:39.990927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db77357-d720-455a-ae26-a5b865f266ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:39.992751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db77357-d720-455a-ae26-a5b865f266ea None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:40.011154 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 328/675] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:40.012031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db77357-d720-455a-ae26-a5b865f266ea None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:40.053667 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c4182-9285-4134-a5bc-4300ff742499 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:40.087524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1862236-d400-437b-a763-ef9ea78aebd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:40.088291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1862236-d400-437b-a763-ef9ea78aebd0 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:40.088577 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1862236-d400-437b-a763-ef9ea78aebd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:40.088851 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1862236-d400-437b-a763-ef9ea78aebd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:40.100014 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1862236-d400-437b-a763-ef9ea78aebd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:40.101475 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1862236-d400-437b-a763-ef9ea78aebd0 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:40.115297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-e1862236-d400-437b-a763-ef9ea78aebd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:40.115297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:40.115297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:40.115297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:40.115297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:40.115297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:40.115297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:40.115297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:40.115297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:40.115297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:40.115297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:40.115297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:40.115297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:40.115297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:40.115297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:40.117229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:40.117229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:40.117229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:40.117229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:40.117229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:40.117229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:40.117229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:40.117229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:40.117229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:40.117229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:40.117229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:40.117229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:40.117229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:40.117229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:40.117229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:40.117229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:40.117229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:40.119372 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:40.119372 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:40.119372 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:40.119372 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:40.119372 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:40.119372 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:40.119372 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:40.119372 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:40.122560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 348/676] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:40.122560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1862236-d400-437b-a763-ef9ea78aebd0 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:40.123656 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db77357-d720-455a-ae26-a5b865f266ea None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:40.158958 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c220832-6934-41e6-8672-6277c7b8ab35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:40.159691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c220832-6934-41e6-8672-6277c7b8ab35 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:40.159985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c220832-6934-41e6-8672-6277c7b8ab35 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:40.160255 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c220832-6934-41e6-8672-6277c7b8ab35 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:40.161033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c220832-6934-41e6-8672-6277c7b8ab35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:40.161346 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c220832-6934-41e6-8672-6277c7b8ab35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:40.162716 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c220832-6934-41e6-8672-6277c7b8ab35 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:40.178741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 329/677] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:40.179661 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c220832-6934-41e6-8672-6277c7b8ab35 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:40.222818 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1862236-d400-437b-a763-ef9ea78aebd0 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:40.256771 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b4878-2eb6-479c-a14c-d2c7cc966196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:40.257828 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b4878-2eb6-479c-a14c-d2c7cc966196 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:40.258251 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b4878-2eb6-479c-a14c-d2c7cc966196 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:40.258664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b4878-2eb6-479c-a14c-d2c7cc966196 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:40.266648 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b4878-2eb6-479c-a14c-d2c7cc966196 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:40.268357 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b4878-2eb6-479c-a14c-d2c7cc966196 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:40.279009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c220832-6934-41e6-8672-6277c7b8ab35 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:40.282972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-355b4878-2eb6-479c-a14c-d2c7cc966196 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 21:33:40.282972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:40.282972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:40.282972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:40.282972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:40.282972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:40.282972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:40.282972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:40.282972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:40.282972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:40.282972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:40.282972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:40.282972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:40.282972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:40.282972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:40.282972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:40.284108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:40.284108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:40.284108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:40.284108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:40.284108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:40.284108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:40.284108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:40.284108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:40.284108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:40.284108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:40.284108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:40.284108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:40.284108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:40.284108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:40.284108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:40.284108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:40.284108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:40.284108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:40.285169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:40.285169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:40.285169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:40.285169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:40.285169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:40.285169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:40.285169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:40.285169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:40.285169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 21:33:40.285169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:40.291880 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 349/678] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:33:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:40.293150 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b4878-2eb6-479c-a14c-d2c7cc966196 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:40.314276 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08347c1b-f24e-48ad-af3a-4008f43605b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:40.314947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08347c1b-f24e-48ad-af3a-4008f43605b4 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:40.315283 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08347c1b-f24e-48ad-af3a-4008f43605b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:40.315563 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08347c1b-f24e-48ad-af3a-4008f43605b4 None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:40.316352 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08347c1b-f24e-48ad-af3a-4008f43605b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:40.316672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08347c1b-f24e-48ad-af3a-4008f43605b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:40.318091 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08347c1b-f24e-48ad-af3a-4008f43605b4 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:40.335284 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 330/679] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:40.335284 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08347c1b-f24e-48ad-af3a-4008f43605b4 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:40.398756 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b4878-2eb6-479c-a14c-d2c7cc966196 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:40.432955 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9ba51-1f45-49af-b558-30a7f937249c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:40.433764 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9ba51-1f45-49af-b558-30a7f937249c None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:40.434043 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9ba51-1f45-49af-b558-30a7f937249c None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:40.434317 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9ba51-1f45-49af-b558-30a7f937249c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:40.441232 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9ba51-1f45-49af-b558-30a7f937249c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:40.442671 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9ba51-1f45-49af-b558-30a7f937249c None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:40.456998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-41c9ba51-1f45-49af-b558-30a7f937249c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:40.456998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:40.456998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:40.456998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:40.456998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:40.456998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:40.456998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:40.456998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:40.456998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:40.456998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:40.456998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:40.456998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:40.456998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:40.456998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:40.456998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:40.457948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:40.457948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:40.457948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:40.457948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:40.457948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:40.457948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:40.457948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:40.457948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:40.457948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:40.457948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:40.457948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:40.457948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:40.457948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:40.457948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:40.457948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:40.457948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:40.457948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:40.458820 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:40.458820 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:40.458820 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:40.458820 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:40.458820 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:40.458820 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:40.458820 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:40.458820 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:40.461014 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08347c1b-f24e-48ad-af3a-4008f43605b4 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:40.463347 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 350/680] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:40.464553 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9ba51-1f45-49af-b558-30a7f937249c None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:40.496261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f22dc-61af-4885-9700-a93f10ee99e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:40.497291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f22dc-61af-4885-9700-a93f10ee99e9 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:40.497794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f22dc-61af-4885-9700-a93f10ee99e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:40.498263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f22dc-61af-4885-9700-a93f10ee99e9 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:40.499324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f22dc-61af-4885-9700-a93f10ee99e9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:40.499831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f22dc-61af-4885-9700-a93f10ee99e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:40.501450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f22dc-61af-4885-9700-a93f10ee99e9 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:40.519483 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 331/681] 10.222.0.11 () {56 vars in 1135 bytes} [Wed May 4 21:33:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:40.520626 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f22dc-61af-4885-9700-a93f10ee99e9 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:40.568543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9ba51-1f45-49af-b558-30a7f937249c None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:40.602586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f7afe-8a3c-4208-adac-499ec6c4195b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:40.603753 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f7afe-8a3c-4208-adac-499ec6c4195b None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:40.603868 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f7afe-8a3c-4208-adac-499ec6c4195b None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:40.604107 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f7afe-8a3c-4208-adac-499ec6c4195b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:40.604910 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f7afe-8a3c-4208-adac-499ec6c4195b None admin] RBAC: Adding query filter params (role.id=c1ee07ef1a1f4986afc3af5a357e2c4c, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=c61205d7e96f496ab9f8ca84ab9408b4) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:40.605220 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f7afe-8a3c-4208-adac-499ec6c4195b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:40.606679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f7afe-8a3c-4208-adac-499ec6c4195b None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:40.619450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 351/682] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:33:40 2022] GET /identity/v3/role_assignments?user.id=c61205d7e96f496ab9f8ca84ab9408b4&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=c1ee07ef1a1f4986afc3af5a357e2c4c => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:40.620438 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f7afe-8a3c-4208-adac-499ec6c4195b None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:40.630911 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f22dc-61af-4885-9700-a93f10ee99e9 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:40.689608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5482e6d-bc3c-4f75-b560-85fb6cdbc865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:40.690294 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5482e6d-bc3c-4f75-b560-85fb6cdbc865 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:40.690578 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5482e6d-bc3c-4f75-b560-85fb6cdbc865 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:40.690857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5482e6d-bc3c-4f75-b560-85fb6cdbc865 None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:40.691701 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5482e6d-bc3c-4f75-b560-85fb6cdbc865 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:40.692014 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5482e6d-bc3c-4f75-b560-85fb6cdbc865 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:40.693447 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5482e6d-bc3c-4f75-b560-85fb6cdbc865 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:40.718288 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 332/683] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:40.737499 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5482e6d-bc3c-4f75-b560-85fb6cdbc865 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:40.811757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f7afe-8a3c-4208-adac-499ec6c4195b None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:40.856839 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68903d6-db00-4d7c-aff3-be944135375f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:40.857521 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68903d6-db00-4d7c-aff3-be944135375f None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:40.857802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68903d6-db00-4d7c-aff3-be944135375f None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:40.858072 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68903d6-db00-4d7c-aff3-be944135375f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:40.898829 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5482e6d-bc3c-4f75-b560-85fb6cdbc865 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:40.928094 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68903d6-db00-4d7c-aff3-be944135375f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:40.929558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68903d6-db00-4d7c-aff3-be944135375f None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:40.933864 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f083d90-94a1-4d79-8b2b-7921dba0f58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:40.934794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f083d90-94a1-4d79-8b2b-7921dba0f58c None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:40.935372 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f083d90-94a1-4d79-8b2b-7921dba0f58c None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:40.936029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f083d90-94a1-4d79-8b2b-7921dba0f58c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:40.937229 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f083d90-94a1-4d79-8b2b-7921dba0f58c None admin] RBAC: Adding query filter params (role.id=c1ee07ef1a1f4986afc3af5a357e2c4c, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=e4e5d4fe283447c59672398a26dea225) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:40.937754 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f083d90-94a1-4d79-8b2b-7921dba0f58c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:40.939414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f083d90-94a1-4d79-8b2b-7921dba0f58c None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:40.946160 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 333/684] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:33:40 2022] GET /identity/v3/role_assignments?user.id=e4e5d4fe283447c59672398a26dea225&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=c1ee07ef1a1f4986afc3af5a357e2c4c => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:41.038393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 352/685] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:41.043961 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f083d90-94a1-4d79-8b2b-7921dba0f58c None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:41.063445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a814303-ca0c-4384-b735-12c68c0791e9 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:41.063773 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a814303-ca0c-4384-b735-12c68c0791e9 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:41.063996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a814303-ca0c-4384-b735-12c68c0791e9 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:41.065512 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 353/686] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:33:41.071073 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fba74-192c-4a3e-828e-6eb6b0871197 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:41.071387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fba74-192c-4a3e-828e-6eb6b0871197 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:41.071642 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fba74-192c-4a3e-828e-6eb6b0871197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:41.090064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-150fba74-192c-4a3e-828e-6eb6b0871197 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:41.090526 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-150fba74-192c-4a3e-828e-6eb6b0871197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:41.159829 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 354/687] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:33:41.172112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f083d90-94a1-4d79-8b2b-7921dba0f58c None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:41.185112 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fba74-192c-4a3e-828e-6eb6b0871197 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:41.210266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e55ba-d20a-4f2e-bc60-098af5bb50c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:41.211439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e55ba-d20a-4f2e-bc60-098af5bb50c9 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:41.211721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e55ba-d20a-4f2e-bc60-098af5bb50c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:41.211998 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e55ba-d20a-4f2e-bc60-098af5bb50c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:41.225919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e55ba-d20a-4f2e-bc60-098af5bb50c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:41.227851 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e55ba-d20a-4f2e-bc60-098af5bb50c9 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:41.245753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-768e55ba-d20a-4f2e-bc60-098af5bb50c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:41.245753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:41.245753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:41.245753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:41.245753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:41.245753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:41.245753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:41.245753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:41.245753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:41.245753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:41.245753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:41.245753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:41.245753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:41.245753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:41.245753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:41.246717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:41.246717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:41.246717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:41.246717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:41.246717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:41.246717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:41.246717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:41.246717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:41.246717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:41.246717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:41.246717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:41.246717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:41.246717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:41.246717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:41.246717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:41.246717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:41.246717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:41.247657 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:41.247657 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:41.247657 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:41.247657 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:41.249967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 334/688] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:41.254897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e55ba-d20a-4f2e-bc60-098af5bb50c9 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:41.299963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fba74-192c-4a3e-828e-6eb6b0871197 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:41.335642 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babf162-005e-4d96-91eb-ae3dce7aadfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:41.336455 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babf162-005e-4d96-91eb-ae3dce7aadfc None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:41.336739 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babf162-005e-4d96-91eb-ae3dce7aadfc None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:41.337018 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babf162-005e-4d96-91eb-ae3dce7aadfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:41.349598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5babf162-005e-4d96-91eb-ae3dce7aadfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:41.357253 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e55ba-d20a-4f2e-bc60-098af5bb50c9 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:41.357486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-5babf162-005e-4d96-91eb-ae3dce7aadfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:33:41.357486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:41.357486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:41.357486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:41.357486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:41.357486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:41.357486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:41.357486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:41.357486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:41.357486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:41.357486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:41.357486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:41.357486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:41.357486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:41.357486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:41.357486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:41.358377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:41.358377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:41.358377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:41.358377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:41.358377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:41.358377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:41.358377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:41.358377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:41.358377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:41.358377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:41.358377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:41.358377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:41.358377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:41.358377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:41.358377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:41.358377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:41.359391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:41.359391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:41.359391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:41.359391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:41.359391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:41.359391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:41.359391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:41.359391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:41.359391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:41.359391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:41.359391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:33:41.359391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:41.359391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 355/689] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:33:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:41.371064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babf162-005e-4d96-91eb-ae3dce7aadfc None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:41.455753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943eeece-8c51-4b6b-b0b3-b79cd742a1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:41.456694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943eeece-8c51-4b6b-b0b3-b79cd742a1f7 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:41.457115 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943eeece-8c51-4b6b-b0b3-b79cd742a1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:41.457525 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943eeece-8c51-4b6b-b0b3-b79cd742a1f7 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:41.458404 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943eeece-8c51-4b6b-b0b3-b79cd742a1f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:41.458848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943eeece-8c51-4b6b-b0b3-b79cd742a1f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:41.460439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943eeece-8c51-4b6b-b0b3-b79cd742a1f7 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:41.485368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 335/690] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:41.495068 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943eeece-8c51-4b6b-b0b3-b79cd742a1f7 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:41.495262 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babf162-005e-4d96-91eb-ae3dce7aadfc None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:41.549675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77599f02-c854-4f1d-828e-0e2293a8613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:41.550395 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77599f02-c854-4f1d-828e-0e2293a8613d None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:41.550677 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77599f02-c854-4f1d-828e-0e2293a8613d None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:41.550949 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77599f02-c854-4f1d-828e-0e2293a8613d None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:41.551861 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77599f02-c854-4f1d-828e-0e2293a8613d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:41.552165 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77599f02-c854-4f1d-828e-0e2293a8613d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:41.553547 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77599f02-c854-4f1d-828e-0e2293a8613d None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:41.569675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 356/691] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:41.575622 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77599f02-c854-4f1d-828e-0e2293a8613d None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:41.666655 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943eeece-8c51-4b6b-b0b3-b79cd742a1f7 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:41.726549 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5ddb8-c3fd-46e3-8455-e616fdd57965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:41.727300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5ddb8-c3fd-46e3-8455-e616fdd57965 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:41.727578 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5ddb8-c3fd-46e3-8455-e616fdd57965 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:41.727845 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5ddb8-c3fd-46e3-8455-e616fdd57965 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:41.736611 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5ddb8-c3fd-46e3-8455-e616fdd57965 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:41.738069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5ddb8-c3fd-46e3-8455-e616fdd57965 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:41.747313 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77599f02-c854-4f1d-828e-0e2293a8613d None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:41.753266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-98d5ddb8-c3fd-46e3-8455-e616fdd57965 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:41.753266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:41.753266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:41.753266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:41.753266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:41.753266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:41.753266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:41.753266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:41.753266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:41.753266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:41.753266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:41.753266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:41.753266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:41.753266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:41.753266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:41.754149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:41.754149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:41.754149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:41.754149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:41.754149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:41.754149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:41.754149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:41.754149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:41.754149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:41.754149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:41.754149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:41.754149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:41.754149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:41.754149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:41.754149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:41.754149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:41.754149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:41.755451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:41.755451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:41.755451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:41.755451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:41.755451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:41.755451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:41.755451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:41.755451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:41.755451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 336/692] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:41.760383 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5ddb8-c3fd-46e3-8455-e616fdd57965 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:41.812558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69ad34-4e01-444d-b2a6-3c651792ad62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:41.813359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69ad34-4e01-444d-b2a6-3c651792ad62 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:41.813636 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69ad34-4e01-444d-b2a6-3c651792ad62 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:41.813906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69ad34-4e01-444d-b2a6-3c651792ad62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:41.833148 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69ad34-4e01-444d-b2a6-3c651792ad62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:41.834603 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69ad34-4e01-444d-b2a6-3c651792ad62 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:41.870944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-ed69ad34-4e01-444d-b2a6-3c651792ad62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:41.870944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:41.870944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:41.870944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:41.870944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:41.870944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:41.870944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:41.870944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:41.870944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:41.870944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:41.870944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:41.870944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:41.870944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:41.870944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:41.870944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:41.871915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:41.871915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:41.871915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:41.871915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:41.871915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:41.871915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:41.871915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:41.871915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:41.871915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:41.871915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:41.871915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:41.871915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:41.871915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:41.871915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:41.871915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:41.871915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:41.871915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:41.873153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:41.873153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:41.873153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:41.873153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:41.873910 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 357/693] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:41.879351 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69ad34-4e01-444d-b2a6-3c651792ad62 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:41.949396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5ddb8-c3fd-46e3-8455-e616fdd57965 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:41.990953 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809159dc-c9f8-4c5e-be8b-70f4f5ee9b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:41.991606 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809159dc-c9f8-4c5e-be8b-70f4f5ee9b80 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:41.991890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809159dc-c9f8-4c5e-be8b-70f4f5ee9b80 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:41.992167 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809159dc-c9f8-4c5e-be8b-70f4f5ee9b80 None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:41.992959 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809159dc-c9f8-4c5e-be8b-70f4f5ee9b80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:41.993272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809159dc-c9f8-4c5e-be8b-70f4f5ee9b80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:41.995482 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809159dc-c9f8-4c5e-be8b-70f4f5ee9b80 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:42.010785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 337/694] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:42.012216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefaac8-371a-4a98-9987-6b308883832b None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:42.012508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefaac8-371a-4a98-9987-6b308883832b None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:42.012783 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefaac8-371a-4a98-9987-6b308883832b None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:42.014251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 338/695] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:42.019868 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefaac8-371a-4a98-9987-6b308883832b None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:42.031319 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69ad34-4e01-444d-b2a6-3c651792ad62 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:42.065119 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd0e2c-7ff4-42a4-9c68-ab8555bae6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:42.066194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd0e2c-7ff4-42a4-9c68-ab8555bae6d7 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:42.066669 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd0e2c-7ff4-42a4-9c68-ab8555bae6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:42.067195 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd0e2c-7ff4-42a4-9c68-ab8555bae6d7 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:42.068214 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd0e2c-7ff4-42a4-9c68-ab8555bae6d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:42.068772 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd0e2c-7ff4-42a4-9c68-ab8555bae6d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:42.070330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd0e2c-7ff4-42a4-9c68-ab8555bae6d7 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:42.083535 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 358/696] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:42.085220 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf995902-10f1-4531-9fa5-e78d86d5e798 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:42.085703 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf995902-10f1-4531-9fa5-e78d86d5e798 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:42.086167 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf995902-10f1-4531-9fa5-e78d86d5e798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:42.102943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-bf995902-10f1-4531-9fa5-e78d86d5e798 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:42.104671 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-bf995902-10f1-4531-9fa5-e78d86d5e798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:42.121665 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefaac8-371a-4a98-9987-6b308883832b None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:42.155786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d98709-5598-4382-a37e-7e511586040e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:42.156498 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d98709-5598-4382-a37e-7e511586040e None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:42.156777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d98709-5598-4382-a37e-7e511586040e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:42.157104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d98709-5598-4382-a37e-7e511586040e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:42.157936 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d98709-5598-4382-a37e-7e511586040e None admin] RBAC: Adding query filter params (role.id=c1ee07ef1a1f4986afc3af5a357e2c4c, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=8358da535a104873ad9f5676989a9e21) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:42.158301 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d98709-5598-4382-a37e-7e511586040e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:42.159759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d98709-5598-4382-a37e-7e511586040e None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:42.171425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 339/697] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:33:42 2022] GET /identity/v3/role_assignments?user.id=8358da535a104873ad9f5676989a9e21&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=c1ee07ef1a1f4986afc3af5a357e2c4c => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:42.172419 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d98709-5598-4382-a37e-7e511586040e None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:42.179142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 359/698] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:42.195921 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf995902-10f1-4531-9fa5-e78d86d5e798 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:42.300252 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf995902-10f1-4531-9fa5-e78d86d5e798 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:42.336587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b82a3b-60ad-49f7-93d4-4dfd5f89b7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:42.337880 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b82a3b-60ad-49f7-93d4-4dfd5f89b7c5 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:42.338478 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b82a3b-60ad-49f7-93d4-4dfd5f89b7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:42.338958 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b82a3b-60ad-49f7-93d4-4dfd5f89b7c5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:42.339956 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b82a3b-60ad-49f7-93d4-4dfd5f89b7c5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:42.341565 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b82a3b-60ad-49f7-93d4-4dfd5f89b7c5 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:42.356877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-02b82a3b-60ad-49f7-93d4-4dfd5f89b7c5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 21:33:42.356877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:42.356877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:33:42.356877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:33:42.356877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:33:42.356877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:33:42.356877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:33:42.356877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:33:42.356877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 21:33:42.356877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:42.356877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:33:42.356877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:42.356877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:42.356877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:42.356877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:42.356877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:42.357998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:42.357998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:42.357998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:42.357998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:42.357998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:42.357998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:42.357998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:42.357998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:33:42.357998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:33:42.357998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:33:42.357998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:33:42.357998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:42.357998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:42.357998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:42.357998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:42.357998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:42.358822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:42.358822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:42.358822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:42.358822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:42.358822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:42.358822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:42.358822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:42.358822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:42.358822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:42.358822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:42.358822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:42.358822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:33:42.358822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:33:42.358822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 21:33:42.358822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:42.366569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 360/699] 10.222.0.11 () {56 vars in 1129 bytes} [Wed May 4 21:33:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:33:42.368255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b82a3b-60ad-49f7-93d4-4dfd5f89b7c5 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:42.389517 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d98709-5598-4382-a37e-7e511586040e None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:42.471308 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b82a3b-60ad-49f7-93d4-4dfd5f89b7c5 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:42.479795 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dad4bb-b41c-4803-b000-53183cbd6723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:42.480614 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dad4bb-b41c-4803-b000-53183cbd6723 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:42.480893 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dad4bb-b41c-4803-b000-53183cbd6723 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:42.481166 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dad4bb-b41c-4803-b000-53183cbd6723 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:42.493501 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dad4bb-b41c-4803-b000-53183cbd6723 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:42.495057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dad4bb-b41c-4803-b000-53183cbd6723 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:42.507420 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160920c-293f-4ef2-80c8-d4ddde742143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:42.508455 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160920c-293f-4ef2-80c8-d4ddde742143 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:42.508928 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160920c-293f-4ef2-80c8-d4ddde742143 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:42.509425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160920c-293f-4ef2-80c8-d4ddde742143 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:42.510342 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160920c-293f-4ef2-80c8-d4ddde742143 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:42.510837 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160920c-293f-4ef2-80c8-d4ddde742143 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:42.512426 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160920c-293f-4ef2-80c8-d4ddde742143 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:42.521143 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 361/700] 10.222.0.11 () {56 vars in 1124 bytes} [Wed May 4 21:33:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:42.521971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-79dad4bb-b41c-4803-b000-53183cbd6723 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 21:33:42.521971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:42.521971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:42.521971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:42.521971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:42.521971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:42.521971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:42.521971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:42.521971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:42.521971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:42.521971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:42.521971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:42.521971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:42.521971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:42.521971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:42.521971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:42.522865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:42.522865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:42.522865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:42.522865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:42.522865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:42.522865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:42.522865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:42.522865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:42.522865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:42.522865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:42.522865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:42.522865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:42.522865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:42.522865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:42.522865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:42.522865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:42.522865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:42.522865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:42.524096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:42.524096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:42.524096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:42.524096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:42.524096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:42.524096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:42.524096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:42.524096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:42.524096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 21:33:42.524096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:42.524096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 340/701] 10.222.0.11 () {56 vars in 1093 bytes} [Wed May 4 21:33:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:42.528261 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160920c-293f-4ef2-80c8-d4ddde742143 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:42.529478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dad4bb-b41c-4803-b000-53183cbd6723 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:42.647451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160920c-293f-4ef2-80c8-d4ddde742143 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:42.662547 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dad4bb-b41c-4803-b000-53183cbd6723 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:42.683385 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e392d-6f90-4289-8fef-1abe9378d8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:42.684465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e392d-6f90-4289-8fef-1abe9378d8ba None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:42.684937 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e392d-6f90-4289-8fef-1abe9378d8ba None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:42.685429 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e392d-6f90-4289-8fef-1abe9378d8ba None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:42.686318 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e392d-6f90-4289-8fef-1abe9378d8ba None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:42.686803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e392d-6f90-4289-8fef-1abe9378d8ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:42.688345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e392d-6f90-4289-8fef-1abe9378d8ba None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:42.695689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 362/702] 10.222.0.11 () {56 vars in 1124 bytes} [Wed May 4 21:33:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:42.709002 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98d644-05b0-48cb-9eae-eb53d14a7e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:42.709698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98d644-05b0-48cb-9eae-eb53d14a7e24 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:42.709979 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98d644-05b0-48cb-9eae-eb53d14a7e24 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:42.710252 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98d644-05b0-48cb-9eae-eb53d14a7e24 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:42.711152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98d644-05b0-48cb-9eae-eb53d14a7e24 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:42.711465 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98d644-05b0-48cb-9eae-eb53d14a7e24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:42.713073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98d644-05b0-48cb-9eae-eb53d14a7e24 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:42.736133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 341/703] 10.222.0.11 () {56 vars in 1133 bytes} [Wed May 4 21:33:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:42.742138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e392d-6f90-4289-8fef-1abe9378d8ba None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:42.855569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e392d-6f90-4289-8fef-1abe9378d8ba None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:42.893624 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67584d-ddcf-4bce-9959-6ff3deef2e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:42.894340 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67584d-ddcf-4bce-9959-6ff3deef2e89 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:42.894627 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67584d-ddcf-4bce-9959-6ff3deef2e89 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:42.894899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67584d-ddcf-4bce-9959-6ff3deef2e89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:42.967491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67584d-ddcf-4bce-9959-6ff3deef2e89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:42.969038 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67584d-ddcf-4bce-9959-6ff3deef2e89 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:43.075117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 363/704] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:43.080376 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98d644-05b0-48cb-9eae-eb53d14a7e24 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:43.187007 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98d644-05b0-48cb-9eae-eb53d14a7e24 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:43.220072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6ba00-e301-42e2-b562-a0103ad3f311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:43.220872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6ba00-e301-42e2-b562-a0103ad3f311 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:43.221150 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6ba00-e301-42e2-b562-a0103ad3f311 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:43.221421 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6ba00-e301-42e2-b562-a0103ad3f311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:43.231749 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6ba00-e301-42e2-b562-a0103ad3f311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:43.233196 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6ba00-e301-42e2-b562-a0103ad3f311 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:43.250317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-28e6ba00-e301-42e2-b562-a0103ad3f311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:43.250317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:43.250317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:43.250317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:43.250317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:43.250317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:43.250317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:43.250317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:43.250317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:43.250317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:43.250317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:43.250317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:43.250317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:43.250317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:43.250317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:43.251287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:43.251287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:43.251287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:43.251287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:43.251287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:43.251287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:43.251287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:43.251287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:43.251287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:43.251287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:43.251287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:43.251287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:43.251287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:43.251287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:43.251287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:43.251287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:43.251287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:43.252384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:43.252384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:43.252384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:43.252384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:43.252384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 342/705] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:43.260479 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67584d-ddcf-4bce-9959-6ff3deef2e89 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:43.374730 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67584d-ddcf-4bce-9959-6ff3deef2e89 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:43.419758 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2df1d-6349-495e-8b58-59a9ba309763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:43.420438 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2df1d-6349-495e-8b58-59a9ba309763 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:43.420722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2df1d-6349-495e-8b58-59a9ba309763 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:43.420999 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2df1d-6349-495e-8b58-59a9ba309763 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:43.421728 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2df1d-6349-495e-8b58-59a9ba309763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:43.422035 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2df1d-6349-495e-8b58-59a9ba309763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:43.423633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2df1d-6349-495e-8b58-59a9ba309763 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:43.435269 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 364/706] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:43.440387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6ba00-e301-42e2-b562-a0103ad3f311 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:43.472603 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3c9c4-1bf7-4057-9c2c-23407cb83341 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:43.472905 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3c9c4-1bf7-4057-9c2c-23407cb83341 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:43.473156 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3c9c4-1bf7-4057-9c2c-23407cb83341 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:43.474952 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 365/707] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:33:43.480117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c379c-c65e-4613-be2e-62cb972b2fda None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:43.480662 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c379c-c65e-4613-be2e-62cb972b2fda None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:43.481137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c379c-c65e-4613-be2e-62cb972b2fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:43.499759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-847c379c-c65e-4613-be2e-62cb972b2fda None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:43.501671 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-847c379c-c65e-4613-be2e-62cb972b2fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:43.591517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 366/708] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:33:43.619170 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c379c-c65e-4613-be2e-62cb972b2fda None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:43.634006 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6ba00-e301-42e2-b562-a0103ad3f311 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:43.707838 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319df5eb-c0ef-4c4e-9edf-4c389793ad34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:43.708573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319df5eb-c0ef-4c4e-9edf-4c389793ad34 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:43.708855 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319df5eb-c0ef-4c4e-9edf-4c389793ad34 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:43.709166 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319df5eb-c0ef-4c4e-9edf-4c389793ad34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:43.719360 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319df5eb-c0ef-4c4e-9edf-4c389793ad34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:43.720811 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319df5eb-c0ef-4c4e-9edf-4c389793ad34 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:43.759065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-319df5eb-c0ef-4c4e-9edf-4c389793ad34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:43.759065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:43.759065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:43.759065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:43.759065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:43.759065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:43.759065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:43.759065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:43.759065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:43.759065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:43.759065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:43.759065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:43.759065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:43.759065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:43.759065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:43.760247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:43.760247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:43.760247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:43.760247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:43.760247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:43.760247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:43.760247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:43.760247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:43.760247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:43.760247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:43.760247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:43.760247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:43.760247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:43.760247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:43.760247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:43.760247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:43.760247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:43.761230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:43.761230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:43.761230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:43.761230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:43.761230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:43.761230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:43.761230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:43.761230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:43.761230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 343/709] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:43.761230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319df5eb-c0ef-4c4e-9edf-4c389793ad34 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:43.772865 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c379c-c65e-4613-be2e-62cb972b2fda None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:43.808961 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f295bd-b8e8-46ca-90d5-2c7c5da053c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:43.809784 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f295bd-b8e8-46ca-90d5-2c7c5da053c1 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:43.810059 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f295bd-b8e8-46ca-90d5-2c7c5da053c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:43.810328 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f295bd-b8e8-46ca-90d5-2c7c5da053c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:43.820331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f295bd-b8e8-46ca-90d5-2c7c5da053c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:43.822018 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f295bd-b8e8-46ca-90d5-2c7c5da053c1 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:43.839974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-07f295bd-b8e8-46ca-90d5-2c7c5da053c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:43.839974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:43.839974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:43.839974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:43.839974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:43.839974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:43.839974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:43.839974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:43.839974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:43.839974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:43.839974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:43.839974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:43.839974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:43.839974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:43.839974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:43.840941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:43.840941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:43.840941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:43.840941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:43.840941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:43.840941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:43.840941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:43.840941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:43.840941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:43.840941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:43.840941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:43.840941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:43.840941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:43.840941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:43.840941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:43.840941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:43.840941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:43.841839 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:43.841839 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:43.841839 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:43.841839 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:43.841839 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 367/710] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:43.847064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f329c-a61c-4387-932d-32ebf9224582 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:43.847064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f329c-a61c-4387-932d-32ebf9224582 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:43.847064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f329c-a61c-4387-932d-32ebf9224582 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:43.848969 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 368/711] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:43.849722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f329c-a61c-4387-932d-32ebf9224582 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:43.878501 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319df5eb-c0ef-4c4e-9edf-4c389793ad34 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:43.912416 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d872a2d-c78e-478f-9266-4d89d44d6f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:43.913075 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d872a2d-c78e-478f-9266-4d89d44d6f87 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:43.913353 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d872a2d-c78e-478f-9266-4d89d44d6f87 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:43.913624 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d872a2d-c78e-478f-9266-4d89d44d6f87 None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:43.914462 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d872a2d-c78e-478f-9266-4d89d44d6f87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:43.914772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d872a2d-c78e-478f-9266-4d89d44d6f87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:43.916407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d872a2d-c78e-478f-9266-4d89d44d6f87 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:43.928652 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 344/712] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:43.930021 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f43d1-1d06-40b6-9b72-c4f89dc2c841 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:43.930308 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f43d1-1d06-40b6-9b72-c4f89dc2c841 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:43.930582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f43d1-1d06-40b6-9b72-c4f89dc2c841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:43.947716 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-6c8f43d1-1d06-40b6-9b72-c4f89dc2c841 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:43.948936 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-6c8f43d1-1d06-40b6-9b72-c4f89dc2c841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:43.969796 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f329c-a61c-4387-932d-32ebf9224582 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:44.003816 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69001b-c2a6-47d5-93aa-d97cffbaca94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:44.004493 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69001b-c2a6-47d5-93aa-d97cffbaca94 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:44.004781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69001b-c2a6-47d5-93aa-d97cffbaca94 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:44.005059 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69001b-c2a6-47d5-93aa-d97cffbaca94 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:44.005790 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69001b-c2a6-47d5-93aa-d97cffbaca94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:44.006100 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69001b-c2a6-47d5-93aa-d97cffbaca94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:44.007527 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69001b-c2a6-47d5-93aa-d97cffbaca94 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:44.019442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 369/714] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:44.020299 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69001b-c2a6-47d5-93aa-d97cffbaca94 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:44.023148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 345/714] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:44.025720 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f43d1-1d06-40b6-9b72-c4f89dc2c841 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:44.122852 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69001b-c2a6-47d5-93aa-d97cffbaca94 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:44.142767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f43d1-1d06-40b6-9b72-c4f89dc2c841 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:44.157441 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9913898-3a60-485d-a2e0-4dcf5a20c61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:44.158117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9913898-3a60-485d-a2e0-4dcf5a20c61f None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:44.158409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9913898-3a60-485d-a2e0-4dcf5a20c61f None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:44.158689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9913898-3a60-485d-a2e0-4dcf5a20c61f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:44.159559 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9913898-3a60-485d-a2e0-4dcf5a20c61f None admin] RBAC: Adding query filter params (role.id=59778f07f0504e90a60212f460e8c774, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=f4f207481ccb4cfcbbcffd9df73d2985) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:44.159877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9913898-3a60-485d-a2e0-4dcf5a20c61f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:44.161317 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9913898-3a60-485d-a2e0-4dcf5a20c61f None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:44.167600 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 370/715] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:33:44 2022] GET /identity/v3/role_assignments?user.id=f4f207481ccb4cfcbbcffd9df73d2985&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=59778f07f0504e90a60212f460e8c774 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:44.168403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9913898-3a60-485d-a2e0-4dcf5a20c61f None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:44.176567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668585f-8a82-4e14-8eed-c3ff16f45493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:44.177246 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668585f-8a82-4e14-8eed-c3ff16f45493 None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:44.177528 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668585f-8a82-4e14-8eed-c3ff16f45493 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:44.177801 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668585f-8a82-4e14-8eed-c3ff16f45493 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:44.178511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668585f-8a82-4e14-8eed-c3ff16f45493 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:44.180190 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668585f-8a82-4e14-8eed-c3ff16f45493 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:44.208036 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 346/716] 10.222.0.11 () {60 vars in 1132 bytes} [Wed May 4 21:33:44 2022] POST /identity/v3/users => generated 254 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:33:44.322384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9913898-3a60-485d-a2e0-4dcf5a20c61f None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:44.373297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4389630-b28d-4ed0-9d56-1174047570f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:44.374110 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4389630-b28d-4ed0-9d56-1174047570f4 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:44.374387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4389630-b28d-4ed0-9d56-1174047570f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:44.374663 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4389630-b28d-4ed0-9d56-1174047570f4 None admin] PATH_INFO: `/v3/services/network` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:44.375646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4389630-b28d-4ed0-9d56-1174047570f4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:44.377054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4389630-b28d-4ed0-9d56-1174047570f4 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:44.393303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-d4389630-b28d-4ed0-9d56-1174047570f4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 21:33:44.393303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:44.393303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:33:44.393303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:33:44.393303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:33:44.393303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:33:44.393303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:33:44.393303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:33:44.393303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 21:33:44.393303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:44.393303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:33:44.393303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:44.393303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:44.393303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:44.393303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:44.393303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:44.393303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:44.395656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:44.395656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:44.395656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:44.395656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:44.395656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:44.395656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:44.395656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:33:44.395656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:33:44.395656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:33:44.395656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:33:44.395656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:44.395656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:44.395656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:44.395656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:44.395656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:44.395656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:44.397651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:44.397651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:44.397651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:44.397651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:44.397651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:44.397651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:44.397651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:44.397651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:44.397651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:44.397651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:44.397651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:33:44.397651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:33:44.397651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 21:33:44.397651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:44.397651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 371/717] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:44 2022] GET /identity/v3/services/network => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:44.405616 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668585f-8a82-4e14-8eed-c3ff16f45493 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:44.501448 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668585f-8a82-4e14-8eed-c3ff16f45493 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:44.534877 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc709d-ab35-4e78-80b8-935ffac20561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:44.535582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc709d-ab35-4e78-80b8-935ffac20561 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:44.535861 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc709d-ab35-4e78-80b8-935ffac20561 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:44.536135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc709d-ab35-4e78-80b8-935ffac20561 None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:44.536850 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc709d-ab35-4e78-80b8-935ffac20561 None admin] RBAC: Adding query filter params (name=network) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:44.537154 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc709d-ab35-4e78-80b8-935ffac20561 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:44.538519 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc709d-ab35-4e78-80b8-935ffac20561 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:44.543523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 347/718] 10.222.0.11 () {56 vars in 1112 bytes} [Wed May 4 21:33:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:44.549180 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4389630-b28d-4ed0-9d56-1174047570f4 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:44.665066 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4389630-b28d-4ed0-9d56-1174047570f4 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:44.702073 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43ed51-1453-4252-b2bf-58f4654aa4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:44.703209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43ed51-1453-4252-b2bf-58f4654aa4f0 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:44.703710 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43ed51-1453-4252-b2bf-58f4654aa4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:44.704241 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43ed51-1453-4252-b2bf-58f4654aa4f0 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:44.705147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43ed51-1453-4252-b2bf-58f4654aa4f0 None admin] RBAC: Adding query filter params (type=network) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:44.705654 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43ed51-1453-4252-b2bf-58f4654aa4f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:44.707263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43ed51-1453-4252-b2bf-58f4654aa4f0 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:44.712997 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 372/719] 10.222.0.11 () {56 vars in 1112 bytes} [Wed May 4 21:33:44 2022] GET /identity/v3/services?type=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:45.382402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f1c05-e7f6-4f59-872f-3ff4634d611f None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:45.382927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f1c05-e7f6-4f59-872f-3ff4634d611f None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:45.382927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f1c05-e7f6-4f59-872f-3ff4634d611f None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:45.384671 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 348/720] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:45.389897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b88e0-1ff3-4a1a-ab36-6fe00279f9cd None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:45.390329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b88e0-1ff3-4a1a-ab36-6fe00279f9cd None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:45.390520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b88e0-1ff3-4a1a-ab36-6fe00279f9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:45.412695 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-a21b88e0-1ff3-4a1a-ab36-6fe00279f9cd None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:45.413885 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a21b88e0-1ff3-4a1a-ab36-6fe00279f9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:45.497241 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 373/721] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:45.539629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c4870-b04e-42c6-8ed9-44632e39f65e None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:45.539963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c4870-b04e-42c6-8ed9-44632e39f65e None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:45.540187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c4870-b04e-42c6-8ed9-44632e39f65e None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:45.541896 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 349/722] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:45.542897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b88e0-1ff3-4a1a-ab36-6fe00279f9cd None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:45.561865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9bef7-ad00-4267-9eb9-47692f8ba42c None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:45.562148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9bef7-ad00-4267-9eb9-47692f8ba42c None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:45.562407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9bef7-ad00-4267-9eb9-47692f8ba42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:45.595066 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-32a9bef7-ad00-4267-9eb9-47692f8ba42c None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:45.595066 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-32a9bef7-ad00-4267-9eb9-47692f8ba42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:45.672048 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b88e0-1ff3-4a1a-ab36-6fe00279f9cd None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:45.709900 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 350/723] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:33:45.711850 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5ecac-40fd-4d7d-aab4-d235d2ae91b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:45.712594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5ecac-40fd-4d7d-aab4-d235d2ae91b2 None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:45.712594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5ecac-40fd-4d7d-aab4-d235d2ae91b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:45.712594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5ecac-40fd-4d7d-aab4-d235d2ae91b2 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:45.713846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5ecac-40fd-4d7d-aab4-d235d2ae91b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:45.715270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5ecac-40fd-4d7d-aab4-d235d2ae91b2 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:45.734185 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 374/724] 10.222.0.11 () {60 vars in 1141 bytes} [Wed May 4 21:33:45 2022] POST /identity/v3/services => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:33:45.749137 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9bef7-ad00-4267-9eb9-47692f8ba42c None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:45.874088 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9bef7-ad00-4267-9eb9-47692f8ba42c None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:45.916088 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc85191-82c0-40e8-a0d0-8ab519f1472e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:45.917007 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc85191-82c0-40e8-a0d0-8ab519f1472e None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:45.917294 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc85191-82c0-40e8-a0d0-8ab519f1472e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:45.917571 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc85191-82c0-40e8-a0d0-8ab519f1472e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:45.928571 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc85191-82c0-40e8-a0d0-8ab519f1472e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:45.936919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-cdc85191-82c0-40e8-a0d0-8ab519f1472e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:33:45.936919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:45.936919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:45.936919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:45.936919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:45.936919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:45.936919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:45.936919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:45.936919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:45.936919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:45.936919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:45.936919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:45.936919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:45.936919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:45.936919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:45.936919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:45.938992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:45.938992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:45.938992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:45.938992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:45.938992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:45.938992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:45.938992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:45.938992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:45.938992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:45.938992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:45.938992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:45.938992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:45.938992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:45.938992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:45.938992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:45.938992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:45.940910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:45.940910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:45.940910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:45.940910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:45.940910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:45.940910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:45.940910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:45.940910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:45.940910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:45.940910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:45.940910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:33:45.940910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:45.940910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 351/725] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:33:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:45.946224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5ecac-40fd-4d7d-aab4-d235d2ae91b2 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:46.052889 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5ecac-40fd-4d7d-aab4-d235d2ae91b2 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:46.092135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d74a9-c1e0-477d-b26d-758350cb5470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:46.093203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d74a9-c1e0-477d-b26d-758350cb5470 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:46.093705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d74a9-c1e0-477d-b26d-758350cb5470 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:46.094188 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d74a9-c1e0-477d-b26d-758350cb5470 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:46.095170 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d74a9-c1e0-477d-b26d-758350cb5470 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:46.095676 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d74a9-c1e0-477d-b26d-758350cb5470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:46.097309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d74a9-c1e0-477d-b26d-758350cb5470 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:46.107108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 375/726] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:46.112287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc85191-82c0-40e8-a0d0-8ab519f1472e None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:46.225563 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc85191-82c0-40e8-a0d0-8ab519f1472e None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:46.265654 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9012bc7-ec7f-4f6d-bc65-a6b2b4585823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:46.266828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9012bc7-ec7f-4f6d-bc65-a6b2b4585823 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:46.267340 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9012bc7-ec7f-4f6d-bc65-a6b2b4585823 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:46.267824 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9012bc7-ec7f-4f6d-bc65-a6b2b4585823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:46.279308 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9012bc7-ec7f-4f6d-bc65-a6b2b4585823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:46.281078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9012bc7-ec7f-4f6d-bc65-a6b2b4585823 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:46.308057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-b9012bc7-ec7f-4f6d-bc65-a6b2b4585823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:46.308057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:46.308057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:46.308057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:46.308057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:46.308057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:46.308057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:46.308057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:46.308057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:46.308057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:46.308057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:46.308057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:46.308057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:46.308057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:46.308057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:46.309001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:46.309001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:46.309001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:46.309001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:46.309001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:46.309001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:46.309001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:46.309001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:46.309001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:46.309001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:46.309001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:46.309001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:46.309001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:46.309001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:46.309001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:46.309001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:46.309001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:46.309869 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:46.309869 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:46.309869 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:46.309869 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:46.311903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 352/727] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:46.317490 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d74a9-c1e0-477d-b26d-758350cb5470 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:46.434240 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d74a9-c1e0-477d-b26d-758350cb5470 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:46.474429 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f9070-f020-4d49-a766-65ccebc8cb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:46.475133 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f9070-f020-4d49-a766-65ccebc8cb08 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:46.475416 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f9070-f020-4d49-a766-65ccebc8cb08 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:46.475741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f9070-f020-4d49-a766-65ccebc8cb08 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:46.476417 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f9070-f020-4d49-a766-65ccebc8cb08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:46.476725 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f9070-f020-4d49-a766-65ccebc8cb08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:46.478417 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f9070-f020-4d49-a766-65ccebc8cb08 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:46.490780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 376/728] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:46.496519 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9012bc7-ec7f-4f6d-bc65-a6b2b4585823 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:46.599985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9012bc7-ec7f-4f6d-bc65-a6b2b4585823 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:46.638073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2669d-6117-41b5-9c87-87d99a32a886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:46.638880 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2669d-6117-41b5-9c87-87d99a32a886 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:46.639184 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2669d-6117-41b5-9c87-87d99a32a886 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:46.639457 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2669d-6117-41b5-9c87-87d99a32a886 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:46.650846 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2669d-6117-41b5-9c87-87d99a32a886 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:46.652326 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2669d-6117-41b5-9c87-87d99a32a886 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:46.669083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-b9e2669d-6117-41b5-9c87-87d99a32a886 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 21:33:46.669083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:46.669083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:46.669083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:46.669083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:46.669083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:46.669083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:46.669083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:46.669083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:46.669083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:46.669083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:46.669083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:46.669083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:46.669083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:46.669083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:46.669083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:46.670070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:46.670070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:46.670070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:46.670070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:46.670070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:46.670070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:46.670070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:46.670070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:46.670070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:46.670070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:46.670070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:46.670070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:46.670070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:46.670070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:46.670070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:46.670070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:46.670070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:46.670070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:46.671027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:46.671027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:46.671027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:46.671027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:46.671027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:46.671027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:46.671027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:46.671027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:46.671027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 21:33:46.671027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:46.675552 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 353/729] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:33:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:46.684178 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f9070-f020-4d49-a766-65ccebc8cb08 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:46.809912 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f9070-f020-4d49-a766-65ccebc8cb08 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:46.852363 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2f6bc-9690-4d64-96d4-b36f5c8784f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:46.853236 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2f6bc-9690-4d64-96d4-b36f5c8784f7 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:46.853573 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2f6bc-9690-4d64-96d4-b36f5c8784f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:46.853849 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2f6bc-9690-4d64-96d4-b36f5c8784f7 None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:46.854706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2f6bc-9690-4d64-96d4-b36f5c8784f7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:46.855014 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2f6bc-9690-4d64-96d4-b36f5c8784f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:46.856469 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2f6bc-9690-4d64-96d4-b36f5c8784f7 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:46.878577 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 377/730] 10.222.0.11 () {56 vars in 1135 bytes} [Wed May 4 21:33:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:46.884514 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2669d-6117-41b5-9c87-87d99a32a886 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:47.053428 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2669d-6117-41b5-9c87-87d99a32a886 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:47.104881 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4114d-4af1-4442-91ef-9b0fcdcd9b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:47.105463 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4114d-4af1-4442-91ef-9b0fcdcd9b04 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:47.105751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4114d-4af1-4442-91ef-9b0fcdcd9b04 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:47.106029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4114d-4af1-4442-91ef-9b0fcdcd9b04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:47.169377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e2ec5-fe88-4052-a3b9-591b9ec5ca09 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:47.169701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e2ec5-fe88-4052-a3b9-591b9ec5ca09 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:47.169936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e2ec5-fe88-4052-a3b9-591b9ec5ca09 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:47.171580 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 378/731] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:47.179617 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3349c-40c1-4a86-86c7-b6b93d496b05 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:47.179903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3349c-40c1-4a86-86c7-b6b93d496b05 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:47.180176 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3349c-40c1-4a86-86c7-b6b93d496b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:47.192087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4114d-4af1-4442-91ef-9b0fcdcd9b04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:47.193545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4114d-4af1-4442-91ef-9b0fcdcd9b04 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:47.196807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-9ad3349c-40c1-4a86-86c7-b6b93d496b05 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:47.197990 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-9ad3349c-40c1-4a86-86c7-b6b93d496b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:47.269847 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 379/732] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:47 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:33:47.271692 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d537673-5072-4bcb-9e81-b918324831e5 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:47.272197 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d537673-5072-4bcb-9e81-b918324831e5 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:47.272666 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d537673-5072-4bcb-9e81-b918324831e5 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:47.274465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 380/733] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:47.286310 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cef48-f932-4c9e-b8d3-cc325e35074c None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:47.286893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cef48-f932-4c9e-b8d3-cc325e35074c None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:47.287381 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cef48-f932-4c9e-b8d3-cc325e35074c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:47.309205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-9c9cef48-f932-4c9e-b8d3-cc325e35074c None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:47.311160 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-9c9cef48-f932-4c9e-b8d3-cc325e35074c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:47.328785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 354/734] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:46 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:33:47.328785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4114d-4af1-4442-91ef-9b0fcdcd9b04 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:47.407389 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 381/735] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:47 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:33:47.408485 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cef48-f932-4c9e-b8d3-cc325e35074c None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:47.433607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4114d-4af1-4442-91ef-9b0fcdcd9b04 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:47.471693 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd1f2c-c309-4457-a14e-83d3f165656d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:47.472511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd1f2c-c309-4457-a14e-83d3f165656d None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:47.472794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd1f2c-c309-4457-a14e-83d3f165656d None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:47.473067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd1f2c-c309-4457-a14e-83d3f165656d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:47.486941 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd1f2c-c309-4457-a14e-83d3f165656d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:47.497286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-b2bd1f2c-c309-4457-a14e-83d3f165656d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:33:47.497286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:47.497286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:47.497286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:47.497286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:47.497286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:47.497286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:47.497286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:47.497286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:47.497286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:47.497286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:47.497286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:47.497286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:47.497286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:47.497286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:47.497286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:47.498653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:47.498653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:47.498653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:47.498653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:47.498653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:47.498653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:47.498653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:47.498653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:47.498653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:47.498653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:47.498653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:47.498653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:47.498653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:47.498653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:47.498653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:47.498653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:47.504094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:47.504094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:47.504094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:47.504094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:47.504094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:47.504094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:47.504094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:47.504094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:47.504094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:47.504094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:47.504094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:33:47.504094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:47.504094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 355/736] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:33:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:47.504094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c75aa4-d5e1-4bad-adf3-61785b523a92 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:47.504834 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c75aa4-d5e1-4bad-adf3-61785b523a92 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:47.504834 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c75aa4-d5e1-4bad-adf3-61785b523a92 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:47.505979 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 356/737] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:47.506774 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c75aa4-d5e1-4bad-adf3-61785b523a92 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:47.524688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cef48-f932-4c9e-b8d3-cc325e35074c None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:47.562515 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7cde5-1c04-4b32-a5cd-0c87692f9128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:47.564094 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7cde5-1c04-4b32-a5cd-0c87692f9128 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:47.564824 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7cde5-1c04-4b32-a5cd-0c87692f9128 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:47.565304 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7cde5-1c04-4b32-a5cd-0c87692f9128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:47.578393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7cde5-1c04-4b32-a5cd-0c87692f9128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:47.579903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7cde5-1c04-4b32-a5cd-0c87692f9128 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:47.598951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-bde7cde5-1c04-4b32-a5cd-0c87692f9128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:47.598951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:47.598951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:47.598951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:47.598951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:47.598951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:47.598951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:47.598951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:47.598951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:47.598951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:47.598951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:47.598951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:47.598951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:47.598951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:47.598951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:47.600106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:47.600106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:47.600106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:47.600106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:47.600106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:47.600106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:47.600106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:47.600106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:47.600106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:47.600106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:47.600106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:47.600106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:47.600106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:47.600106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:47.600106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:47.600106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:47.600106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:47.601045 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:47.601045 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:47.601045 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:47.601045 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:47.601045 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 382/738] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:47.601045 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7cde5-1c04-4b32-a5cd-0c87692f9128 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:47.610683 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c75aa4-d5e1-4bad-adf3-61785b523a92 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:47.645784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443a2a7-375e-452e-87fd-79b4a3092697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:47.646588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443a2a7-375e-452e-87fd-79b4a3092697 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:47.646870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443a2a7-375e-452e-87fd-79b4a3092697 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:47.651079 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443a2a7-375e-452e-87fd-79b4a3092697 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:47.657245 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443a2a7-375e-452e-87fd-79b4a3092697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:47.664837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-3443a2a7-375e-452e-87fd-79b4a3092697 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:47.664837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:47.664837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:47.664837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:47.664837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:47.664837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:47.664837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:47.664837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:47.664837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:47.664837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:47.664837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:47.664837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:47.664837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:47.664837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:47.664837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:47.664837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:47.665897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:47.665897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:47.665897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:47.665897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:47.665897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:47.665897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:47.665897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:47.665897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:47.665897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:47.665897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:47.665897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:47.665897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:47.665897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:47.665897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:47.665897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:47.665897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:47.666762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:47.666762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:47.666762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:47.666762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:47.666762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:47.666762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:47.666762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:47.666762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:47.666762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:47.666762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:47.666762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:47.666762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:47.666762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 357/739] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:47.667531 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f186652-796b-44e5-ab9a-5c90083a4904 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:47.667531 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f186652-796b-44e5-ab9a-5c90083a4904 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:47.668198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f186652-796b-44e5-ab9a-5c90083a4904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:47.683576 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-4f186652-796b-44e5-ab9a-5c90083a4904 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:47.684768 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-4f186652-796b-44e5-ab9a-5c90083a4904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:47.711984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7cde5-1c04-4b32-a5cd-0c87692f9128 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:47.748162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22733b82-9800-4032-9877-4fb19f0adb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:47.748839 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22733b82-9800-4032-9877-4fb19f0adb42 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:47.749125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22733b82-9800-4032-9877-4fb19f0adb42 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:47.749403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22733b82-9800-4032-9877-4fb19f0adb42 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:47.750249 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 358/740] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:47 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:33:47.751138 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f186652-796b-44e5-ab9a-5c90083a4904 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:47.759360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22733b82-9800-4032-9877-4fb19f0adb42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:47.759951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22733b82-9800-4032-9877-4fb19f0adb42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:47.762231 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22733b82-9800-4032-9877-4fb19f0adb42 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:47.774250 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 383/741] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:47.774250 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22733b82-9800-4032-9877-4fb19f0adb42 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:47.847824 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f186652-796b-44e5-ab9a-5c90083a4904 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:47.872368 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22733b82-9800-4032-9877-4fb19f0adb42 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:47.888379 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f5a93-23f5-4182-8880-93dfc8b64897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:47.889049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f5a93-23f5-4182-8880-93dfc8b64897 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:47.889331 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f5a93-23f5-4182-8880-93dfc8b64897 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:47.889605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f5a93-23f5-4182-8880-93dfc8b64897 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:47.890326 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f5a93-23f5-4182-8880-93dfc8b64897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:47.890633 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f5a93-23f5-4182-8880-93dfc8b64897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:47.892031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f5a93-23f5-4182-8880-93dfc8b64897 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:47.903451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 359/742] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:47.905939 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ef105-7c12-4dd8-af30-7c81be52a631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:47.906620 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ef105-7c12-4dd8-af30-7c81be52a631 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:47.906906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ef105-7c12-4dd8-af30-7c81be52a631 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:47.907221 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ef105-7c12-4dd8-af30-7c81be52a631 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:47.908070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ef105-7c12-4dd8-af30-7c81be52a631 None admin] RBAC: Adding query filter params (name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:47.908368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f5a93-23f5-4182-8880-93dfc8b64897 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:47.908476 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ef105-7c12-4dd8-af30-7c81be52a631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:47.909760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ef105-7c12-4dd8-af30-7c81be52a631 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:47.918399 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 384/743] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:33:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:47.919111 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ef105-7c12-4dd8-af30-7c81be52a631 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:48.009749 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f5a93-23f5-4182-8880-93dfc8b64897 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:48.020142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ef105-7c12-4dd8-af30-7c81be52a631 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:48.043161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12eded-4490-43ee-af17-4e6b4b258adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:48.043827 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12eded-4490-43ee-af17-4e6b4b258adc None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:48.044123 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12eded-4490-43ee-af17-4e6b4b258adc None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:48.044401 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12eded-4490-43ee-af17-4e6b4b258adc None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:48.045122 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12eded-4490-43ee-af17-4e6b4b258adc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:48.046492 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12eded-4490-43ee-af17-4e6b4b258adc None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:48.053336 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3ddbc-d24b-49da-aca5-aaf19fcac580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:48.054395 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3ddbc-d24b-49da-aca5-aaf19fcac580 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:48.054681 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3ddbc-d24b-49da-aca5-aaf19fcac580 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:48.054961 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3ddbc-d24b-49da-aca5-aaf19fcac580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:48.071433 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 360/744] 10.222.0.11 () {60 vars in 1141 bytes} [Wed May 4 21:33:47 2022] POST /identity/v3/services => generated 240 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:33:48.071433 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12eded-4490-43ee-af17-4e6b4b258adc None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:48.071780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3ddbc-d24b-49da-aca5-aaf19fcac580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:48.071780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3ddbc-d24b-49da-aca5-aaf19fcac580 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:48.090574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-83e3ddbc-d24b-49da-aca5-aaf19fcac580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:48.090574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:48.090574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:48.090574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:48.090574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:48.090574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:48.090574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:48.090574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:48.090574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:48.090574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:48.090574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:48.090574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:48.090574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:48.090574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:48.090574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:48.091581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:48.091581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:48.091581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:48.091581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:48.091581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:48.091581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:48.091581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:48.091581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:48.091581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:48.091581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:48.091581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:48.091581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:48.091581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:48.091581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:48.091581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:48.091581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:48.091581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:48.092530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:48.092530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:48.092530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:48.092530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:48.092530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 385/745] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:48.092819 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3ddbc-d24b-49da-aca5-aaf19fcac580 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:48.191791 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12eded-4490-43ee-af17-4e6b4b258adc None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:48.233659 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d22df2-72d1-4e2e-8ef2-9a73017278a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:48.234496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d22df2-72d1-4e2e-8ef2-9a73017278a0 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:48.234780 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d22df2-72d1-4e2e-8ef2-9a73017278a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:48.235081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d22df2-72d1-4e2e-8ef2-9a73017278a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:48.243236 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d22df2-72d1-4e2e-8ef2-9a73017278a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:48.245060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d22df2-72d1-4e2e-8ef2-9a73017278a0 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:48.261916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-a8d22df2-72d1-4e2e-8ef2-9a73017278a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:48.261916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:48.261916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:48.261916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:48.261916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:48.261916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:48.261916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:48.261916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:48.261916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:48.261916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:48.261916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:48.261916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:48.261916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:48.261916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:48.261916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:48.263071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:48.263071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:48.263071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:48.263071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:48.263071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:48.263071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:48.263071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:48.263071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:48.263071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:48.263071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:48.263071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:48.263071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:48.263071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:48.263071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:48.263071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:48.263071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:48.263071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:48.264290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:48.264290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:48.264290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:48.264290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:48.264290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:48.264290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:48.264290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:48.264290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:48.264290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 361/746] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:48.264290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d22df2-72d1-4e2e-8ef2-9a73017278a0 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:48.337069 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3ddbc-d24b-49da-aca5-aaf19fcac580 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:48.375137 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d22df2-72d1-4e2e-8ef2-9a73017278a0 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:48.379127 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ff30a-f5aa-4b5b-94eb-6930328345ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:48.380195 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ff30a-f5aa-4b5b-94eb-6930328345ca None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:48.380623 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ff30a-f5aa-4b5b-94eb-6930328345ca None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:48.381085 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ff30a-f5aa-4b5b-94eb-6930328345ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:48.394116 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ff30a-f5aa-4b5b-94eb-6930328345ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:48.396525 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ff30a-f5aa-4b5b-94eb-6930328345ca None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:48.408074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f1a4e-b32a-4313-a9a9-e01b76ac695b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:48.408744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f1a4e-b32a-4313-a9a9-e01b76ac695b None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:48.409023 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f1a4e-b32a-4313-a9a9-e01b76ac695b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:48.409293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f1a4e-b32a-4313-a9a9-e01b76ac695b None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:48.410006 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f1a4e-b32a-4313-a9a9-e01b76ac695b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:48.410310 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f1a4e-b32a-4313-a9a9-e01b76ac695b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:48.411708 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f1a4e-b32a-4313-a9a9-e01b76ac695b None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:48.419192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-199ff30a-f5aa-4b5b-94eb-6930328345ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:48.419192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:48.419192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:48.419192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:48.419192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:48.419192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:48.419192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:48.419192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:48.419192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:48.419192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:48.419192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:48.419192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:48.419192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:48.419192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:48.419192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:48.420263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:48.420263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:48.420263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:48.420263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:48.420263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:48.420263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:48.420263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:48.420263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:48.420263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:48.420263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:48.420263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:48.420263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:48.420263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:48.420263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:48.420263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:48.420263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:48.420263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:48.421362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:48.421362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:48.421362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:48.421362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:48.424181 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 386/747] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:48.428622 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ff30a-f5aa-4b5b-94eb-6930328345ca None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:48.431985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 362/748] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:48.432814 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f1a4e-b32a-4313-a9a9-e01b76ac695b None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:48.536201 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f1a4e-b32a-4313-a9a9-e01b76ac695b None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:48.564258 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ff30a-f5aa-4b5b-94eb-6930328345ca None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:48.575547 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60bd83-b798-47b4-a7ef-bcb7c41d0818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:48.576218 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60bd83-b798-47b4-a7ef-bcb7c41d0818 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:48.576497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60bd83-b798-47b4-a7ef-bcb7c41d0818 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:48.576767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60bd83-b798-47b4-a7ef-bcb7c41d0818 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:48.577840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60bd83-b798-47b4-a7ef-bcb7c41d0818 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:48.577840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60bd83-b798-47b4-a7ef-bcb7c41d0818 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:48.579477 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60bd83-b798-47b4-a7ef-bcb7c41d0818 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:48.596353 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 363/749] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:48.596353 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60bd83-b798-47b4-a7ef-bcb7c41d0818 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:48.614693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4fe07-94fa-48dc-850e-980149d5da0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:48.615439 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4fe07-94fa-48dc-850e-980149d5da0d None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:48.615721 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4fe07-94fa-48dc-850e-980149d5da0d None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:48.615993 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4fe07-94fa-48dc-850e-980149d5da0d None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:48.616816 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4fe07-94fa-48dc-850e-980149d5da0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:48.617563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4fe07-94fa-48dc-850e-980149d5da0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:48.619111 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4fe07-94fa-48dc-850e-980149d5da0d None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:48.635181 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 387/750] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:48.636074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4fe07-94fa-48dc-850e-980149d5da0d None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:48.695230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60bd83-b798-47b4-a7ef-bcb7c41d0818 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:48.728037 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254b566-5681-4f92-92bb-b4a3290911d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:48.728923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254b566-5681-4f92-92bb-b4a3290911d6 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:48.729208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254b566-5681-4f92-92bb-b4a3290911d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:48.729481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254b566-5681-4f92-92bb-b4a3290911d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:48.730710 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4fe07-94fa-48dc-850e-980149d5da0d None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:48.736480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254b566-5681-4f92-92bb-b4a3290911d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:48.737915 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254b566-5681-4f92-92bb-b4a3290911d6 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:48.752152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-9254b566-5681-4f92-92bb-b4a3290911d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 21:33:48.752152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:48.752152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:48.752152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:48.752152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:48.752152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:48.752152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:48.752152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:48.752152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:48.752152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:48.752152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:48.752152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:48.752152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:48.752152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:48.752152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:48.752152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:48.753095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:48.753095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:48.753095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:48.753095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:48.753095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:48.753095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:48.753095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:48.753095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:48.753095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:48.753095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:48.753095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:48.753095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:48.753095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:48.753095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:48.753095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:48.753095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:48.753095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:48.753095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:48.754030 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:48.754030 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:48.754030 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:48.754030 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:48.754030 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:48.754030 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:48.754030 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:48.754030 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:48.754030 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 21:33:48.754030 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:48.754030 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 364/751] 10.222.0.11 () {56 vars in 1093 bytes} [Wed May 4 21:33:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:48.755162 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cf13a-7cbb-4658-92e5-12f40ce6cc0e None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:48.755162 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cf13a-7cbb-4658-92e5-12f40ce6cc0e None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:48.755162 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cf13a-7cbb-4658-92e5-12f40ce6cc0e None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:48.759227 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 365/752] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:48.759227 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cf13a-7cbb-4658-92e5-12f40ce6cc0e None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:48.772978 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab57bf8-34c3-4653-8a1c-b648fda56cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:48.773996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab57bf8-34c3-4653-8a1c-b648fda56cd9 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:48.774440 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab57bf8-34c3-4653-8a1c-b648fda56cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:48.775201 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab57bf8-34c3-4653-8a1c-b648fda56cd9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:48.782710 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab57bf8-34c3-4653-8a1c-b648fda56cd9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:48.784174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab57bf8-34c3-4653-8a1c-b648fda56cd9 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:48.798423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-5ab57bf8-34c3-4653-8a1c-b648fda56cd9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:33:48.798423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:48.798423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:48.798423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:48.798423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:48.798423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:48.798423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:48.798423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:48.798423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:48.798423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:48.798423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:48.798423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:48.798423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:48.798423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:48.798423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:48.798423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:48.799390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:48.799390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:48.799390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:48.799390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:48.799390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:48.799390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:48.799390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:48.799390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:48.799390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:48.799390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:48.799390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:48.799390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:48.799390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:48.799390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:48.799390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:48.799390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:48.799390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:48.799390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:48.800300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:48.800300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:48.800300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:48.800300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:48.800300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:48.800300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:48.800300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:48.800300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:48.800300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:33:48.800300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:48.800300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 388/753] 10.222.0.11 () {56 vars in 1117 bytes} [Wed May 4 21:33:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:48.800966 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab57bf8-34c3-4653-8a1c-b648fda56cd9 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:48.861738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cf13a-7cbb-4658-92e5-12f40ce6cc0e None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:48.893904 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbff56d-f692-426c-8490-f5a7c17c33a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:48.894559 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbff56d-f692-426c-8490-f5a7c17c33a5 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:48.894846 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbff56d-f692-426c-8490-f5a7c17c33a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:48.895151 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbff56d-f692-426c-8490-f5a7c17c33a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:48.895993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbff56d-f692-426c-8490-f5a7c17c33a5 None admin] RBAC: Adding query filter params (role.id=59778f07f0504e90a60212f460e8c774, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=8358da535a104873ad9f5676989a9e21) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:48.896302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbff56d-f692-426c-8490-f5a7c17c33a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:48.897733 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbff56d-f692-426c-8490-f5a7c17c33a5 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:48.911071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 366/754] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:33:48 2022] GET /identity/v3/role_assignments?user.id=8358da535a104873ad9f5676989a9e21&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=59778f07f0504e90a60212f460e8c774 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:48.911071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3ff46-61c3-4196-bf80-385d99e892ec None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:48.911071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3ff46-61c3-4196-bf80-385d99e892ec None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:48.911071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3ff46-61c3-4196-bf80-385d99e892ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:48.916772 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab57bf8-34c3-4653-8a1c-b648fda56cd9 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:48.922354 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-cce3ff46-61c3-4196-bf80-385d99e892ec None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:48.923596 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-cce3ff46-61c3-4196-bf80-385d99e892ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:48.966712 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808085d-9385-47d9-9405-80c9ec2a4e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:48.967440 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808085d-9385-47d9-9405-80c9ec2a4e5c None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:48.967724 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808085d-9385-47d9-9405-80c9ec2a4e5c None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:48.968002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808085d-9385-47d9-9405-80c9ec2a4e5c None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:48.969524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808085d-9385-47d9-9405-80c9ec2a4e5c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:48.969839 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808085d-9385-47d9-9405-80c9ec2a4e5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:48.971477 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808085d-9385-47d9-9405-80c9ec2a4e5c None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:48.992325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 389/755] 10.222.0.11 () {56 vars in 1133 bytes} [Wed May 4 21:33:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:48.993270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808085d-9385-47d9-9405-80c9ec2a4e5c None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:49.008674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 367/756] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:33:49.010032 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3ff46-61c3-4196-bf80-385d99e892ec None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:49.121815 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808085d-9385-47d9-9405-80c9ec2a4e5c None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:49.137364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3ff46-61c3-4196-bf80-385d99e892ec None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:49.160113 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182dfae-4cbe-456b-b66e-23e980c5216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:49.161208 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182dfae-4cbe-456b-b66e-23e980c5216e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:49.161687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182dfae-4cbe-456b-b66e-23e980c5216e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:49.162164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182dfae-4cbe-456b-b66e-23e980c5216e None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:49.163272 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182dfae-4cbe-456b-b66e-23e980c5216e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:49.163810 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182dfae-4cbe-456b-b66e-23e980c5216e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:49.165582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182dfae-4cbe-456b-b66e-23e980c5216e None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:49.189757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 390/757] 10.222.0.11 () {56 vars in 1149 bytes} [Wed May 4 21:33:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:49.191172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182dfae-4cbe-456b-b66e-23e980c5216e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:49.299592 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182dfae-4cbe-456b-b66e-23e980c5216e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:49.318541 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90093692-fcbe-42c2-b50c-535017d217cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:49.319756 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90093692-fcbe-42c2-b50c-535017d217cf None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:49.320244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90093692-fcbe-42c2-b50c-535017d217cf None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:49.320713 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90093692-fcbe-42c2-b50c-535017d217cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:49.331531 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90093692-fcbe-42c2-b50c-535017d217cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:49.333741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90093692-fcbe-42c2-b50c-535017d217cf None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:49.334284 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf39264-5eea-4043-a399-4d5b60b9363f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:49.335233 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf39264-5eea-4043-a399-4d5b60b9363f None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:49.335614 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf39264-5eea-4043-a399-4d5b60b9363f None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:49.336002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf39264-5eea-4043-a399-4d5b60b9363f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:49.336731 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf39264-5eea-4043-a399-4d5b60b9363f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:49.338293 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf39264-5eea-4043-a399-4d5b60b9363f None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:49.350936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-7bf39264-5eea-4043-a399-4d5b60b9363f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 21:33:49.350936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:49.350936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:33:49.350936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:33:49.350936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:33:49.350936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:33:49.350936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:33:49.350936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:33:49.350936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 21:33:49.350936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:49.350936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:33:49.350936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:49.350936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:49.350936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:49.350936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:49.350936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:49.351908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:49.351908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:49.351908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:49.351908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:49.351908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:49.351908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:49.351908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:49.351908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:33:49.351908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:33:49.351908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:33:49.351908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:33:49.351908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:49.351908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:49.351908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:49.351908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:49.351908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:49.352718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:49.352718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:49.352718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:49.352718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:49.352718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:49.352718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:49.352718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:49.352718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:49.352718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:49.352718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:49.352718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:49.352718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:33:49.352718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:33:49.352718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 21:33:49.352718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:49.355607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-90093692-fcbe-42c2-b50c-535017d217cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:49.355607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:49.355607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:49.355607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:49.355607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:49.355607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:49.355607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:49.355607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:49.355607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:49.355607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:49.355607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:49.355607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:49.355607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:49.355607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:49.355607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:49.356467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:49.356467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:49.356467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:49.356467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:49.356467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:49.356467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:49.356467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:49.356467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:49.356467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:49.356467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:49.356467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:49.356467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:49.356467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:49.356467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:49.356467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:49.356467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:49.356467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:49.357347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:49.357347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:49.357347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:49.357347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:49.357663 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 391/758] 10.222.0.11 () {56 vars in 1129 bytes} [Wed May 4 21:33:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:49.358924 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf39264-5eea-4043-a399-4d5b60b9363f None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:49.359658 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 368/759] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:49.360588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90093692-fcbe-42c2-b50c-535017d217cf None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:49.458986 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf39264-5eea-4043-a399-4d5b60b9363f None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:49.480456 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90093692-fcbe-42c2-b50c-535017d217cf None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:49.492155 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96646f-b93d-4b46-8398-5328f03b86d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:49.493050 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96646f-b93d-4b46-8398-5328f03b86d3 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:49.493569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96646f-b93d-4b46-8398-5328f03b86d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:49.494019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96646f-b93d-4b46-8398-5328f03b86d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:49.513375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5efa5-11be-4835-826e-d39fe46b7d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:49.514151 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5efa5-11be-4835-826e-d39fe46b7d94 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:49.514502 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5efa5-11be-4835-826e-d39fe46b7d94 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:49.514847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5efa5-11be-4835-826e-d39fe46b7d94 None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:49.515643 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5efa5-11be-4835-826e-d39fe46b7d94 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:49.516018 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5efa5-11be-4835-826e-d39fe46b7d94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:49.517466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5efa5-11be-4835-826e-d39fe46b7d94 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:49.526651 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 369/760] 10.222.0.11 () {56 vars in 1124 bytes} [Wed May 4 21:33:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:49.527641 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5efa5-11be-4835-826e-d39fe46b7d94 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:49.562691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96646f-b93d-4b46-8398-5328f03b86d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:49.564452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96646f-b93d-4b46-8398-5328f03b86d3 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:49.624554 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5efa5-11be-4835-826e-d39fe46b7d94 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:49.658043 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82922579-9aa7-4601-9c50-d8b4adad254b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:49.658834 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82922579-9aa7-4601-9c50-d8b4adad254b None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:49.659256 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82922579-9aa7-4601-9c50-d8b4adad254b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:49.659567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82922579-9aa7-4601-9c50-d8b4adad254b None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:49.660340 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82922579-9aa7-4601-9c50-d8b4adad254b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:49.660713 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82922579-9aa7-4601-9c50-d8b4adad254b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:49.662218 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82922579-9aa7-4601-9c50-d8b4adad254b None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:49.671328 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 392/761] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:33:49.672467 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96646f-b93d-4b46-8398-5328f03b86d3 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:49.674074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 370/762] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:49.677048 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82922579-9aa7-4601-9c50-d8b4adad254b None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:49.784449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82922579-9aa7-4601-9c50-d8b4adad254b None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:49.795605 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96646f-b93d-4b46-8398-5328f03b86d3 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:49.818632 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a720553-af89-4d0b-8a18-408706934ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:49.821410 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a720553-af89-4d0b-8a18-408706934ab0 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:49.821410 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a720553-af89-4d0b-8a18-408706934ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:49.821410 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a720553-af89-4d0b-8a18-408706934ab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:49.833477 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a720553-af89-4d0b-8a18-408706934ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:49.834938 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a720553-af89-4d0b-8a18-408706934ab0 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:49.844919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051da3a1-6c56-472d-a0b3-90eb64400a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:49.845926 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051da3a1-6c56-472d-a0b3-90eb64400a80 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:49.846430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051da3a1-6c56-472d-a0b3-90eb64400a80 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:49.846932 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051da3a1-6c56-472d-a0b3-90eb64400a80 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:49.847888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051da3a1-6c56-472d-a0b3-90eb64400a80 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:49.848392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051da3a1-6c56-472d-a0b3-90eb64400a80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:49.850265 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051da3a1-6c56-472d-a0b3-90eb64400a80 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:49.853866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-5a720553-af89-4d0b-8a18-408706934ab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:49.853866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:49.853866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:49.853866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:49.853866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:49.853866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:49.853866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:49.853866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:49.853866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:49.853866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:49.853866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:49.853866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:49.853866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:49.853866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:49.853866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:49.854750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:49.854750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:49.854750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:49.854750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:49.854750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:49.854750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:49.854750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:49.854750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:49.854750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:49.854750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:49.854750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:49.854750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:49.854750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:49.854750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:49.854750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:49.854750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:49.854750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:49.855664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:49.855664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:49.855664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:49.855664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:49.859638 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 371/763] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:33:49.860612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a720553-af89-4d0b-8a18-408706934ab0 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:49.865987 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 393/764] 10.222.0.11 () {56 vars in 1124 bytes} [Wed May 4 21:33:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:49.867146 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051da3a1-6c56-472d-a0b3-90eb64400a80 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:49.998007 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a720553-af89-4d0b-8a18-408706934ab0 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:50.009689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051da3a1-6c56-472d-a0b3-90eb64400a80 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:50.046776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99449488-4c03-479b-8556-3a6304d0d69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:50.047554 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99449488-4c03-479b-8556-3a6304d0d69a None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:50.047834 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99449488-4c03-479b-8556-3a6304d0d69a None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:50.048109 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99449488-4c03-479b-8556-3a6304d0d69a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:50.051872 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00873c6-2604-45d3-911c-4c94a79c20ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:50.052880 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00873c6-2604-45d3-911c-4c94a79c20ca None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:50.053358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00873c6-2604-45d3-911c-4c94a79c20ca None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:50.053826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00873c6-2604-45d3-911c-4c94a79c20ca None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:50.054798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00873c6-2604-45d3-911c-4c94a79c20ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:50.055342 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00873c6-2604-45d3-911c-4c94a79c20ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:50.057085 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00873c6-2604-45d3-911c-4c94a79c20ca None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:50.065807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99449488-4c03-479b-8556-3a6304d0d69a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:50.067303 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99449488-4c03-479b-8556-3a6304d0d69a None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:50.074956 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 394/765] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:50.076318 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00873c6-2604-45d3-911c-4c94a79c20ca None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:50.099649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-99449488-4c03-479b-8556-3a6304d0d69a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:50.099649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:50.099649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:50.099649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:50.099649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:50.099649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:50.099649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:50.099649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:50.099649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:50.099649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:50.099649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:50.099649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:50.099649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:50.099649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:50.099649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:50.100604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:50.100604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:50.100604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:50.100604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:50.100604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:50.100604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:50.100604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:50.100604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:50.100604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:50.100604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:50.100604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:50.100604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:50.100604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:50.100604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:50.100604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:50.100604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:50.100604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:50.101489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:50.101489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:50.101489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:50.101489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:50.101489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:50.101489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:50.101489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:50.101489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:50.111420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 372/766] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:50.112238 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99449488-4c03-479b-8556-3a6304d0d69a None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:50.179227 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00873c6-2604-45d3-911c-4c94a79c20ca None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:50.212634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78089b-1bb8-4fed-aaf6-de6494a9a41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:50.213649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78089b-1bb8-4fed-aaf6-de6494a9a41c None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:50.214131 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78089b-1bb8-4fed-aaf6-de6494a9a41c None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:50.214603 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78089b-1bb8-4fed-aaf6-de6494a9a41c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:50.215651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78089b-1bb8-4fed-aaf6-de6494a9a41c None admin] RBAC: Adding query filter params (interface=public, service_id=83f5f855948741bbbb33b527afd0bf4c, region_id=RegionOne) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:50.216206 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78089b-1bb8-4fed-aaf6-de6494a9a41c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:50.217766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78089b-1bb8-4fed-aaf6-de6494a9a41c None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:50.231146 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 395/767] 10.222.0.11 () {56 vars in 1251 bytes} [Wed May 4 21:33:50 2022] GET /identity/v3/endpoints?service_id=83f5f855948741bbbb33b527afd0bf4c&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:50.232325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78089b-1bb8-4fed-aaf6-de6494a9a41c None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:50.308935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99449488-4c03-479b-8556-3a6304d0d69a None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:50.336994 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78089b-1bb8-4fed-aaf6-de6494a9a41c None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:50.370799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0f2be-bae9-42ce-b40c-52781de05670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:50.371883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0f2be-bae9-42ce-b40c-52781de05670 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:50.372384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0f2be-bae9-42ce-b40c-52781de05670 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:50.372891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0f2be-bae9-42ce-b40c-52781de05670 None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:50.373934 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0f2be-bae9-42ce-b40c-52781de05670 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:50.374435 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0f2be-bae9-42ce-b40c-52781de05670 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:50.376083 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0f2be-bae9-42ce-b40c-52781de05670 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:50.388967 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 396/768] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:50.390321 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0f2be-bae9-42ce-b40c-52781de05670 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:50.392382 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ceb0e-7e1b-49d4-ad57-adc4abf8eb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:50.393272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ceb0e-7e1b-49d4-ad57-adc4abf8eb8f None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:50.393471 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ceb0e-7e1b-49d4-ad57-adc4abf8eb8f None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:50.393739 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ceb0e-7e1b-49d4-ad57-adc4abf8eb8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:50.423983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ceb0e-7e1b-49d4-ad57-adc4abf8eb8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:50.425515 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ceb0e-7e1b-49d4-ad57-adc4abf8eb8f None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:50.453894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-006ceb0e-7e1b-49d4-ad57-adc4abf8eb8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:50.453894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:50.453894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:50.453894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:50.453894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:50.453894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:50.453894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:50.453894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:50.453894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:50.453894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:50.453894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:50.453894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:50.453894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:50.453894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:50.453894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:50.454840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:50.454840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:50.454840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:50.454840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:50.454840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:50.454840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:50.454840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:50.454840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:50.454840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:50.454840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:50.454840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:50.454840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:50.454840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:50.454840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:50.454840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:50.454840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:50.454840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:50.456186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:50.456186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:50.456186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:50.456186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:50.456186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:50.456186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:50.456186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:50.456186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:50.456186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 373/769] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:50.456186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ceb0e-7e1b-49d4-ad57-adc4abf8eb8f None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:50.501189 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0f2be-bae9-42ce-b40c-52781de05670 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:50.534061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0da5a-53ca-4dcc-bdf1-79b37754bbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:50.535137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0da5a-53ca-4dcc-bdf1-79b37754bbef None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:50.535623 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0da5a-53ca-4dcc-bdf1-79b37754bbef None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:50.536109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0da5a-53ca-4dcc-bdf1-79b37754bbef None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:50.536999 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0da5a-53ca-4dcc-bdf1-79b37754bbef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:50.538532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0da5a-53ca-4dcc-bdf1-79b37754bbef None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:50.543889 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 397/770] 10.222.0.11 () {56 vars in 1087 bytes} [Wed May 4 21:33:50 2022] GET /identity/v3/services => generated 772 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:50.545369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27434e50-9266-4373-a2fb-7db89945f227 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:50.545653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27434e50-9266-4373-a2fb-7db89945f227 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:50.545927 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27434e50-9266-4373-a2fb-7db89945f227 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:50.547358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 398/771] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:50.547952 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27434e50-9266-4373-a2fb-7db89945f227 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:50.599967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ceb0e-7e1b-49d4-ad57-adc4abf8eb8f None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:50.637474 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd98b3-e07d-4a0b-b98f-ede07d0d544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:50.638670 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd98b3-e07d-4a0b-b98f-ede07d0d544a None admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:50.638951 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd98b3-e07d-4a0b-b98f-ede07d0d544a None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:50.639257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd98b3-e07d-4a0b-b98f-ede07d0d544a None admin] PATH_INFO: `/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/f4f207481ccb4cfcbbcffd9df73d2985/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:50.642098 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd98b3-e07d-4a0b-b98f-ede07d0d544a None admin] RBAC: Authorizing `identity:create_grant(project_id=3acb142d1aa34e18a018d3fdee8d7038, user_id=f4f207481ccb4cfcbbcffd9df73d2985, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:50.644368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd98b3-e07d-4a0b-b98f-ede07d0d544a None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:50.663169 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 374/772] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:33:50 2022] PUT /identity/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/f4f207481ccb4cfcbbcffd9df73d2985/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:33:50.665193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733deee-2e44-46dd-a563-fc2361cc6534 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:50.665541 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733deee-2e44-46dd-a563-fc2361cc6534 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:50.665819 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733deee-2e44-46dd-a563-fc2361cc6534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:50.687515 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-0733deee-2e44-46dd-a563-fc2361cc6534 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:50.689071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-0733deee-2e44-46dd-a563-fc2361cc6534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:50.691132 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27434e50-9266-4373-a2fb-7db89945f227 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:50.762457 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a17d7-8db3-4cef-9921-80875c2d3af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:50.763167 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a17d7-8db3-4cef-9921-80875c2d3af5 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:50.763450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a17d7-8db3-4cef-9921-80875c2d3af5 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:50.763724 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a17d7-8db3-4cef-9921-80875c2d3af5 None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:50.764581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a17d7-8db3-4cef-9921-80875c2d3af5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:50.764897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a17d7-8db3-4cef-9921-80875c2d3af5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:50.766408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a17d7-8db3-4cef-9921-80875c2d3af5 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:50.780373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 399/773] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:50.786387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a17d7-8db3-4cef-9921-80875c2d3af5 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:50.814824 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 375/774] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:33:50.840279 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733deee-2e44-46dd-a563-fc2361cc6534 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:50.901105 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a17d7-8db3-4cef-9921-80875c2d3af5 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:50.947058 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da06f32-9c6c-449d-a9a5-8936a33140f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:50.947735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da06f32-9c6c-449d-a9a5-8936a33140f6 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:50.948023 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da06f32-9c6c-449d-a9a5-8936a33140f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:50.948291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da06f32-9c6c-449d-a9a5-8936a33140f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:50.949128 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da06f32-9c6c-449d-a9a5-8936a33140f6 None admin] RBAC: Adding query filter params (role.id=c1ee07ef1a1f4986afc3af5a357e2c4c, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=82b2e79995f94ab880f5d798ddd649b1) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:50.949444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da06f32-9c6c-449d-a9a5-8936a33140f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:50.950886 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da06f32-9c6c-449d-a9a5-8936a33140f6 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:50.957318 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 400/775] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:33:50 2022] GET /identity/v3/role_assignments?user.id=82b2e79995f94ab880f5d798ddd649b1&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=c1ee07ef1a1f4986afc3af5a357e2c4c => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:50.976288 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733deee-2e44-46dd-a563-fc2361cc6534 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:51.014838 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94654c2-1916-4a78-8bcd-8d7516d88e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:51.015693 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94654c2-1916-4a78-8bcd-8d7516d88e22 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:51.016019 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94654c2-1916-4a78-8bcd-8d7516d88e22 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:51.016295 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94654c2-1916-4a78-8bcd-8d7516d88e22 None admin] PATH_INFO: `/v3/services/network` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:51.016956 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94654c2-1916-4a78-8bcd-8d7516d88e22 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:51.018352 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94654c2-1916-4a78-8bcd-8d7516d88e22 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:51.033059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-d94654c2-1916-4a78-8bcd-8d7516d88e22 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 21:33:51.033059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:51.033059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:33:51.033059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:33:51.033059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:33:51.033059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:33:51.033059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:33:51.033059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:33:51.033059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 21:33:51.033059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:51.033059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:33:51.033059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:51.033059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:51.033059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:51.033059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:51.033059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:51.033059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:51.034096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:51.034096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:51.034096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:51.034096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:51.034096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:51.034096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:51.034096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:33:51.034096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:33:51.034096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:33:51.034096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:33:51.034096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:51.034096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:51.034096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:51.034096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:51.034096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:51.034096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:51.034996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:51.034996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:51.034996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:51.034996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:51.034996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:51.034996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:51.034996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:51.034996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:51.034996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:51.034996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:51.034996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:33:51.034996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:33:51.034996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 21:33:51.034996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:51.034996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 376/776] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:50 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:51.044273 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da06f32-9c6c-449d-a9a5-8936a33140f6 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:51.186538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da06f32-9c6c-449d-a9a5-8936a33140f6 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:51.219905 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833eee9b-eb39-4683-91f8-7c8714f5a1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:51.220935 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eee9b-eb39-4683-91f8-7c8714f5a1ff None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:51.221407 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eee9b-eb39-4683-91f8-7c8714f5a1ff None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:51.221864 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eee9b-eb39-4683-91f8-7c8714f5a1ff None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:51.222755 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833eee9b-eb39-4683-91f8-7c8714f5a1ff None admin] RBAC: Adding query filter params (name=network) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:51.223303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833eee9b-eb39-4683-91f8-7c8714f5a1ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:51.225188 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833eee9b-eb39-4683-91f8-7c8714f5a1ff None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:51.235231 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 401/777] 10.222.0.11 () {56 vars in 1112 bytes} [Wed May 4 21:33:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:51.237061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94654c2-1916-4a78-8bcd-8d7516d88e22 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:51.250012 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68e570-3b29-45dd-86e8-2ef6f5c4c75a None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:51.250335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68e570-3b29-45dd-86e8-2ef6f5c4c75a None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:51.250568 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68e570-3b29-45dd-86e8-2ef6f5c4c75a None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:51.252231 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 402/778] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:33:51.258517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e14b87-3d80-44dd-9eae-63030c56519b None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:51.258799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e14b87-3d80-44dd-9eae-63030c56519b None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:51.259172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e14b87-3d80-44dd-9eae-63030c56519b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:51.277494 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-20e14b87-3d80-44dd-9eae-63030c56519b None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:51.278432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-20e14b87-3d80-44dd-9eae-63030c56519b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:51.355382 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94654c2-1916-4a78-8bcd-8d7516d88e22 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:51.390657 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 403/779] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:33:51.399862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994100f-47d4-4e27-ab8f-1e866f795fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:51.400774 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994100f-47d4-4e27-ab8f-1e866f795fc4 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:51.401251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994100f-47d4-4e27-ab8f-1e866f795fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:51.401716 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994100f-47d4-4e27-ab8f-1e866f795fc4 None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:51.402615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994100f-47d4-4e27-ab8f-1e866f795fc4 None admin] RBAC: Adding query filter params (type=network) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:51.403169 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994100f-47d4-4e27-ab8f-1e866f795fc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:51.404753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994100f-47d4-4e27-ab8f-1e866f795fc4 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:51.411396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 377/780] 10.222.0.11 () {56 vars in 1112 bytes} [Wed May 4 21:33:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:51.417014 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e14b87-3d80-44dd-9eae-63030c56519b None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:51.429803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994100f-47d4-4e27-ab8f-1e866f795fc4 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:51.536264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994100f-47d4-4e27-ab8f-1e866f795fc4 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:51.572337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e645159-e85f-4824-848a-c67dd3586e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:51.573486 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e645159-e85f-4824-848a-c67dd3586e62 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:51.574150 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e645159-e85f-4824-848a-c67dd3586e62 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:51.574632 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e645159-e85f-4824-848a-c67dd3586e62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:51.591062 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e645159-e85f-4824-848a-c67dd3586e62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:51.596243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-4e645159-e85f-4824-848a-c67dd3586e62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:33:51.596243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:51.596243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:51.596243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:51.596243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:51.596243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:51.596243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:51.596243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:51.596243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:51.596243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:51.596243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:51.596243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:51.596243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:51.596243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:51.596243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:51.596243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:51.597158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:51.597158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:51.597158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:51.597158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:51.597158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:51.597158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:51.597158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:51.597158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:51.597158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:51.597158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:51.597158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:51.597158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:51.597158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:51.597158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:51.597158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:51.597158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:51.597978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:51.597978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:51.597978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:51.597978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:51.597978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:51.597978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:51.597978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:51.597978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:51.597978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:51.597978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:51.597978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:33:51.597978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:51.597978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 378/781] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:33:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:51.604172 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e645159-e85f-4824-848a-c67dd3586e62 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:51.669171 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e14b87-3d80-44dd-9eae-63030c56519b None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:51.707664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e645159-e85f-4824-848a-c67dd3586e62 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:51.743218 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da594afa-c187-4510-a280-ee5e01cac06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:51.744270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da594afa-c187-4510-a280-ee5e01cac06b None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:51.744552 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da594afa-c187-4510-a280-ee5e01cac06b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:51.744961 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da594afa-c187-4510-a280-ee5e01cac06b None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:51.745729 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da594afa-c187-4510-a280-ee5e01cac06b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:51.746035 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da594afa-c187-4510-a280-ee5e01cac06b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:51.747565 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da594afa-c187-4510-a280-ee5e01cac06b None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:51.756719 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 379/782] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:51.760610 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a44a4-5bc0-4024-84d2-cb6bf6dc5b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:51.761290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a44a4-5bc0-4024-84d2-cb6bf6dc5b53 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:51.761573 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a44a4-5bc0-4024-84d2-cb6bf6dc5b53 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:51.761848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a44a4-5bc0-4024-84d2-cb6bf6dc5b53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:51.762494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da594afa-c187-4510-a280-ee5e01cac06b None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:51.762667 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a44a4-5bc0-4024-84d2-cb6bf6dc5b53 None admin] RBAC: Adding query filter params (interface=public, service_id=2a476d8491a54af7acbbee9c24707e3f, region_id=RegionOne) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:51.763014 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a44a4-5bc0-4024-84d2-cb6bf6dc5b53 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:51.764492 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a44a4-5bc0-4024-84d2-cb6bf6dc5b53 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:51.780346 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 404/783] 10.222.0.11 () {56 vars in 1251 bytes} [Wed May 4 21:33:51 2022] GET /identity/v3/endpoints?service_id=2a476d8491a54af7acbbee9c24707e3f&interface=public®ion_id=RegionOne => generated 194 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:51.785539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a44a4-5bc0-4024-84d2-cb6bf6dc5b53 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:51.868816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da594afa-c187-4510-a280-ee5e01cac06b None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:51.904188 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cab18-4c25-4c77-9806-e5a7424b0f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:51.905135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cab18-4c25-4c77-9806-e5a7424b0f89 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:51.905420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cab18-4c25-4c77-9806-e5a7424b0f89 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:51.905692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cab18-4c25-4c77-9806-e5a7424b0f89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:51.917732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cab18-4c25-4c77-9806-e5a7424b0f89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:51.919203 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cab18-4c25-4c77-9806-e5a7424b0f89 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:51.937967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-b16cab18-4c25-4c77-9806-e5a7424b0f89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:51.937967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:51.937967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:51.937967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:51.937967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:51.937967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:51.937967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:51.937967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:51.937967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:51.937967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:51.937967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:51.937967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:51.937967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:51.937967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:51.937967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:51.938903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:51.938903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:51.938903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:51.938903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:51.938903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:51.938903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:51.938903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:51.938903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:51.938903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:51.938903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:51.938903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:51.938903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:51.938903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:51.938903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:51.938903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:51.938903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:51.938903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:51.939829 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:51.939829 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:51.939829 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:51.939829 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:51.939829 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 380/784] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:51.945736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cab18-4c25-4c77-9806-e5a7424b0f89 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:52.008968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a44a4-5bc0-4024-84d2-cb6bf6dc5b53 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:52.063953 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cab18-4c25-4c77-9806-e5a7424b0f89 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:52.080548 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3a9fc-d882-4bc6-a9d6-a6c5fcb816c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:52.081390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3a9fc-d882-4bc6-a9d6-a6c5fcb816c4 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:52.082068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3a9fc-d882-4bc6-a9d6-a6c5fcb816c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:52.082353 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3a9fc-d882-4bc6-a9d6-a6c5fcb816c4 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:52.083359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3a9fc-d882-4bc6-a9d6-a6c5fcb816c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:52.085190 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3a9fc-d882-4bc6-a9d6-a6c5fcb816c4 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:52.095321 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 405/785] 10.222.0.11 () {56 vars in 1087 bytes} [Wed May 4 21:33:51 2022] GET /identity/v3/services => generated 772 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:52.115709 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b24c22-d34b-4ec6-9423-2a9255713fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:52.116380 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b24c22-d34b-4ec6-9423-2a9255713fee None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:52.116659 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b24c22-d34b-4ec6-9423-2a9255713fee None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:52.116931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b24c22-d34b-4ec6-9423-2a9255713fee None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:52.117656 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b24c22-d34b-4ec6-9423-2a9255713fee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:52.117960 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b24c22-d34b-4ec6-9423-2a9255713fee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:52.119655 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b24c22-d34b-4ec6-9423-2a9255713fee None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:52.139962 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 381/786] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:52.145340 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3a9fc-d882-4bc6-a9d6-a6c5fcb816c4 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:52.280352 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3a9fc-d882-4bc6-a9d6-a6c5fcb816c4 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:52.325249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56088bf4-4300-4e9f-8cc3-981e1f66bba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:52.326075 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56088bf4-4300-4e9f-8cc3-981e1f66bba2 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:52.326360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56088bf4-4300-4e9f-8cc3-981e1f66bba2 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:52.326635 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56088bf4-4300-4e9f-8cc3-981e1f66bba2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:52.334840 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56088bf4-4300-4e9f-8cc3-981e1f66bba2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:52.336362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56088bf4-4300-4e9f-8cc3-981e1f66bba2 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:52.353121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-56088bf4-4300-4e9f-8cc3-981e1f66bba2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 21:33:52.353121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:52.353121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:52.353121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:52.353121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:52.353121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:52.353121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:52.353121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:52.353121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:52.353121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:52.353121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:52.353121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:52.353121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:52.353121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:52.353121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:52.353121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:52.354161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:52.354161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:52.354161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:52.354161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:52.354161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:52.354161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:52.354161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:52.354161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:52.354161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:52.354161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:52.354161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:52.354161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:52.354161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:52.354161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:52.354161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:52.354161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:52.354161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:52.354161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:52.355230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:52.355230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:52.355230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:52.355230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:52.355230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:52.355230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:52.355230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:52.355230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:52.355230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 21:33:52.355230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:52.355780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 406/787] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:33:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:52.363760 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b24c22-d34b-4ec6-9423-2a9255713fee None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:52.498786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b24c22-d34b-4ec6-9423-2a9255713fee None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:52.546311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ec87c-7d42-411d-981d-2d4b81b2a69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:52.546991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ec87c-7d42-411d-981d-2d4b81b2a69b None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:52.547354 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ec87c-7d42-411d-981d-2d4b81b2a69b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:52.547631 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ec87c-7d42-411d-981d-2d4b81b2a69b None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:52.548474 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ec87c-7d42-411d-981d-2d4b81b2a69b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:52.548781 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ec87c-7d42-411d-981d-2d4b81b2a69b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:52.550202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ec87c-7d42-411d-981d-2d4b81b2a69b None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:52.575929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 382/788] 10.222.0.11 () {56 vars in 1135 bytes} [Wed May 4 21:33:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:52.582643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56088bf4-4300-4e9f-8cc3-981e1f66bba2 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:52.751076 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56088bf4-4300-4e9f-8cc3-981e1f66bba2 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:52.798153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65507cf-bbaf-4351-8743-b9dabbd72c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:52.798952 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65507cf-bbaf-4351-8743-b9dabbd72c70 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:52.799257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65507cf-bbaf-4351-8743-b9dabbd72c70 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:52.799536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65507cf-bbaf-4351-8743-b9dabbd72c70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:52.814741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65507cf-bbaf-4351-8743-b9dabbd72c70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:52.816287 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65507cf-bbaf-4351-8743-b9dabbd72c70 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:52.838538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-e65507cf-bbaf-4351-8743-b9dabbd72c70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:52.838538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:52.838538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:52.838538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:52.838538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:52.838538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:52.838538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:52.838538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:52.838538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:52.838538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:52.838538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:52.838538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:52.838538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:52.838538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:52.838538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:52.840587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:52.840587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:52.840587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:52.840587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:52.840587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:52.840587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:52.840587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:52.840587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:52.840587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:52.840587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:52.840587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:52.840587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:52.840587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:52.840587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:52.840587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:52.840587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:52.840587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:52.842649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:52.842649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:52.842649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:52.842649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:52.842649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 407/789] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:52.848133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ec87c-7d42-411d-981d-2d4b81b2a69b None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:52.986492 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ec87c-7d42-411d-981d-2d4b81b2a69b None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:53.032611 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f99805-85c2-48ae-874b-0c61d51985e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:53.033688 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f99805-85c2-48ae-874b-0c61d51985e7 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:53.034168 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f99805-85c2-48ae-874b-0c61d51985e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:53.034657 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f99805-85c2-48ae-874b-0c61d51985e7 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:53.035625 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f99805-85c2-48ae-874b-0c61d51985e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:53.036134 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f99805-85c2-48ae-874b-0c61d51985e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:53.037728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f99805-85c2-48ae-874b-0c61d51985e7 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:53.053941 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 383/790] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:53.059918 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65507cf-bbaf-4351-8743-b9dabbd72c70 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:53.235082 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65507cf-bbaf-4351-8743-b9dabbd72c70 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:53.242380 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fd25f-395b-40e8-adb3-1197996f00d8 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:53.242954 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fd25f-395b-40e8-adb3-1197996f00d8 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:53.243549 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fd25f-395b-40e8-adb3-1197996f00d8 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:53.245463 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 384/791] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:53.251021 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a220b7-23e2-4716-b87f-c8835413530b None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:53.251342 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a220b7-23e2-4716-b87f-c8835413530b None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:53.251626 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a220b7-23e2-4716-b87f-c8835413530b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:53.274340 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d8e62-abfa-4f4e-81d8-3052312acd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:53.275264 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d8e62-abfa-4f4e-81d8-3052312acd8e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:53.275614 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d8e62-abfa-4f4e-81d8-3052312acd8e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:53.275914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d8e62-abfa-4f4e-81d8-3052312acd8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:53.283589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d8e62-abfa-4f4e-81d8-3052312acd8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:53.285277 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d8e62-abfa-4f4e-81d8-3052312acd8e None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:53.291226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-64a220b7-23e2-4716-b87f-c8835413530b None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:53.292434 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-64a220b7-23e2-4716-b87f-c8835413530b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:53.299656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-d78d8e62-abfa-4f4e-81d8-3052312acd8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:53.299656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:53.299656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:53.299656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:53.299656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:53.299656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:53.299656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:53.299656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:53.299656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:53.299656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:53.299656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:53.299656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:53.299656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:53.299656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:53.299656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:53.300552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:53.300552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:53.300552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:53.300552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:53.300552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:53.300552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:53.300552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:53.300552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:53.300552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:53.300552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:53.300552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:53.300552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:53.300552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:53.300552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:53.300552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:53.300552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:53.300552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:53.301430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:53.301430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:53.301430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:53.301430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:53.301430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:53.301430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:53.301430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:53.301430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:53.302286 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 408/792] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:53.310674 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d8e62-abfa-4f4e-81d8-3052312acd8e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:53.418759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 385/793] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:33:53.420202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36f456-45f5-42f2-879b-c92c79398f8f None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:53.420506 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36f456-45f5-42f2-879b-c92c79398f8f None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:53.420788 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36f456-45f5-42f2-879b-c92c79398f8f None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:53.422263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 386/794] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:53.427495 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caab47-a7df-4590-a780-75a1bf88795e None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:53.427996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caab47-a7df-4590-a780-75a1bf88795e None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:53.428495 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caab47-a7df-4590-a780-75a1bf88795e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:53.460988 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-a5caab47-a7df-4590-a780-75a1bf88795e None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:53.462722 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a5caab47-a7df-4590-a780-75a1bf88795e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:53.467652 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d8e62-abfa-4f4e-81d8-3052312acd8e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:53.502207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f4038-bbf7-4bf6-b3af-22432605223e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:53.503282 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f4038-bbf7-4bf6-b3af-22432605223e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:53.503768 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f4038-bbf7-4bf6-b3af-22432605223e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:53.504240 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f4038-bbf7-4bf6-b3af-22432605223e None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:53.505219 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f4038-bbf7-4bf6-b3af-22432605223e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:53.505765 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f4038-bbf7-4bf6-b3af-22432605223e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:53.507413 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f4038-bbf7-4bf6-b3af-22432605223e None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:53.520238 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 409/795] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:53.521377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f4038-bbf7-4bf6-b3af-22432605223e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:53.539803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 387/796] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:33:53.540916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5caab47-a7df-4590-a780-75a1bf88795e None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:53.630360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f4038-bbf7-4bf6-b3af-22432605223e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:53.659388 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5caab47-a7df-4590-a780-75a1bf88795e None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:53.675076 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f74be-0fe6-4f2b-b32f-9df5ee1365f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:53.675957 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f74be-0fe6-4f2b-b32f-9df5ee1365f7 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:53.676245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f74be-0fe6-4f2b-b32f-9df5ee1365f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:53.676518 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f74be-0fe6-4f2b-b32f-9df5ee1365f7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:53.677338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f74be-0fe6-4f2b-b32f-9df5ee1365f7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:53.678998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f74be-0fe6-4f2b-b32f-9df5ee1365f7 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:53.693840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195dd44-d64a-41f0-b5ed-b81788714150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:53.694356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-608f74be-0fe6-4f2b-b32f-9df5ee1365f7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 21:33:53.694356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:53.694356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:33:53.694356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:33:53.694356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:33:53.694356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:33:53.694356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:33:53.694356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:33:53.694356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 21:33:53.694356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:53.694356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:33:53.694356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:53.694356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:53.694356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:53.694356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:53.694356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:53.695307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:53.695307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:53.695307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:53.695307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:53.695307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:53.695307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:53.695307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:53.695307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:33:53.695307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:33:53.695307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:33:53.695307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:33:53.695307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:53.695307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:53.695307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:53.695307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:53.695307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:53.696142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:53.696142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:53.696142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:53.696142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:53.696142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:53.696142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:53.696142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:53.696142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:53.696142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:53.696142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:53.696142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:53.696142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:33:53.696142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:33:53.696142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 21:33:53.696142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:53.698193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195dd44-d64a-41f0-b5ed-b81788714150 None admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:53.698675 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195dd44-d64a-41f0-b5ed-b81788714150 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:53.699168 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195dd44-d64a-41f0-b5ed-b81788714150 None admin] PATH_INFO: `/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/8358da535a104873ad9f5676989a9e21/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:53.700705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 410/797] 10.222.0.11 () {56 vars in 1129 bytes} [Wed May 4 21:33:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:53.701486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f74be-0fe6-4f2b-b32f-9df5ee1365f7 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:53.702233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195dd44-d64a-41f0-b5ed-b81788714150 None admin] RBAC: Authorizing `identity:create_grant(project_id=3acb142d1aa34e18a018d3fdee8d7038, user_id=8358da535a104873ad9f5676989a9e21, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:53.703894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195dd44-d64a-41f0-b5ed-b81788714150 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:53.720109 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 388/798] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:33:53 2022] PUT /identity/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/8358da535a104873ad9f5676989a9e21/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:33:53.721461 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195dd44-d64a-41f0-b5ed-b81788714150 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:53.802979 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f74be-0fe6-4f2b-b32f-9df5ee1365f7 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:53.828339 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195dd44-d64a-41f0-b5ed-b81788714150 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:53.836291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a005a-3720-4c7a-8dc7-4b45eafda8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:53.837655 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a005a-3720-4c7a-8dc7-4b45eafda8df None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:53.838109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a005a-3720-4c7a-8dc7-4b45eafda8df None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:53.838525 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a005a-3720-4c7a-8dc7-4b45eafda8df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:53.850629 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a005a-3720-4c7a-8dc7-4b45eafda8df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:53.858646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-615a005a-3720-4c7a-8dc7-4b45eafda8df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:33:53.858646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:53.858646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:53.858646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:53.858646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:53.858646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:53.858646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:53.858646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:53.858646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:53.858646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:53.858646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:53.858646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:53.858646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:53.858646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:53.858646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:53.858646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:53.859706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:53.859706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:53.859706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:53.859706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:53.859706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:53.859706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:53.859706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:53.859706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:53.859706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:53.859706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:53.859706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:53.859706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:53.859706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:53.859706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:53.859706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:53.859706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:53.860543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:53.860543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:53.860543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:53.860543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:53.860543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:53.860543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:53.860543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:53.860543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:53.860543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:53.860543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:53.860543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:33:53.860543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:53.863263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 411/799] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:33:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:53.875097 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a005a-3720-4c7a-8dc7-4b45eafda8df None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:53.875326 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c484296-a15a-4a1b-bfaf-b2ee8d4503d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:53.875326 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c484296-a15a-4a1b-bfaf-b2ee8d4503d1 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:53.875326 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c484296-a15a-4a1b-bfaf-b2ee8d4503d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:53.875326 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c484296-a15a-4a1b-bfaf-b2ee8d4503d1 None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:53.875920 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c484296-a15a-4a1b-bfaf-b2ee8d4503d1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:53.875920 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c484296-a15a-4a1b-bfaf-b2ee8d4503d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:53.877699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c484296-a15a-4a1b-bfaf-b2ee8d4503d1 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:53.892126 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 389/800] 10.222.0.11 () {56 vars in 1124 bytes} [Wed May 4 21:33:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:53.899069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c484296-a15a-4a1b-bfaf-b2ee8d4503d1 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:54.048184 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c484296-a15a-4a1b-bfaf-b2ee8d4503d1 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:54.059084 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a005a-3720-4c7a-8dc7-4b45eafda8df None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:54.094906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068583c-efdf-4f62-a590-39635008d31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:54.095613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068583c-efdf-4f62-a590-39635008d31b None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:54.095896 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068583c-efdf-4f62-a590-39635008d31b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:54.096169 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068583c-efdf-4f62-a590-39635008d31b None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:54.096885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068583c-efdf-4f62-a590-39635008d31b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:54.097193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068583c-efdf-4f62-a590-39635008d31b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:54.098881 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068583c-efdf-4f62-a590-39635008d31b None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:54.105701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62481249-8755-4257-9be4-8637c6166648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:54.106377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62481249-8755-4257-9be4-8637c6166648 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:54.106660 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62481249-8755-4257-9be4-8637c6166648 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:54.106935 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62481249-8755-4257-9be4-8637c6166648 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:54.107723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62481249-8755-4257-9be4-8637c6166648 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:54.108031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62481249-8755-4257-9be4-8637c6166648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:54.109390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62481249-8755-4257-9be4-8637c6166648 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:54.114116 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 390/801] 10.222.0.11 () {56 vars in 1124 bytes} [Wed May 4 21:33:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:54.124508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068583c-efdf-4f62-a590-39635008d31b None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:54.130477 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 412/802] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:54.140059 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62481249-8755-4257-9be4-8637c6166648 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:54.226818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068583c-efdf-4f62-a590-39635008d31b None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:54.258935 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62481249-8755-4257-9be4-8637c6166648 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:54.261030 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecfc39-ea9a-424c-bf9e-56041032b49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:54.261647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecfc39-ea9a-424c-bf9e-56041032b49b None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:54.261931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecfc39-ea9a-424c-bf9e-56041032b49b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:54.262206 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecfc39-ea9a-424c-bf9e-56041032b49b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:54.263308 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecfc39-ea9a-424c-bf9e-56041032b49b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:54.264358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecfc39-ea9a-424c-bf9e-56041032b49b None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:54.287886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 391/803] 10.222.0.11 () {60 vars in 1144 bytes} [Wed May 4 21:33:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:33:54.295266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e53202-9627-458a-bb12-4aa8a6bd2efe None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:54.295266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e53202-9627-458a-bb12-4aa8a6bd2efe None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:54.295266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e53202-9627-458a-bb12-4aa8a6bd2efe None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:54.295266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 392/804] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:54.298410 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7074a81-89e5-4c52-956f-5c49673bfbf2 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:54.299574 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7074a81-89e5-4c52-956f-5c49673bfbf2 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:54.300659 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7074a81-89e5-4c52-956f-5c49673bfbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:54.331531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cf84b-102e-4788-b5ab-c72f62310308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:54.332403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cf84b-102e-4788-b5ab-c72f62310308 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:54.332688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cf84b-102e-4788-b5ab-c72f62310308 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:54.332964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cf84b-102e-4788-b5ab-c72f62310308 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:54.337292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-b7074a81-89e5-4c52-956f-5c49673bfbf2 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:54.340595 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b7074a81-89e5-4c52-956f-5c49673bfbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:54.356092 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cf84b-102e-4788-b5ab-c72f62310308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:54.357598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cf84b-102e-4788-b5ab-c72f62310308 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:54.391524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-421cf84b-102e-4788-b5ab-c72f62310308 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:54.391524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:54.391524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:54.391524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:54.391524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:54.391524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:54.391524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:54.391524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:54.391524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:54.391524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:54.391524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:54.391524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:54.391524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:54.391524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:54.391524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:54.392486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:54.392486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:54.392486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:54.392486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:54.392486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:54.392486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:54.392486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:54.392486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:54.392486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:54.392486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:54.392486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:54.392486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:54.392486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:54.392486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:54.392486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:54.392486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:54.392486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:54.393359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:54.393359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:54.393359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:54.393359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:54.399972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 413/805] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:54.405323 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cf84b-102e-4788-b5ab-c72f62310308 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:54.439281 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 393/806] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:33:54.474376 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7074a81-89e5-4c52-956f-5c49673bfbf2 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:54.558688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cf84b-102e-4788-b5ab-c72f62310308 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:54.589339 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7074a81-89e5-4c52-956f-5c49673bfbf2 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:54.592552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a28f98-a588-4c90-887f-f36dc9a5a9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:54.593336 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a28f98-a588-4c90-887f-f36dc9a5a9a9 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:54.593711 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a28f98-a588-4c90-887f-f36dc9a5a9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:54.594079 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a28f98-a588-4c90-887f-f36dc9a5a9a9 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:54.594897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a28f98-a588-4c90-887f-f36dc9a5a9a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:54.595341 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a28f98-a588-4c90-887f-f36dc9a5a9a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:54.596828 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a28f98-a588-4c90-887f-f36dc9a5a9a9 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:54.610886 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 414/807] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:54.619063 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a28f98-a588-4c90-887f-f36dc9a5a9a9 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:54.630730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38ccc0-e902-4326-90fe-7e5604373efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:54.631897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38ccc0-e902-4326-90fe-7e5604373efa None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:54.632193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38ccc0-e902-4326-90fe-7e5604373efa None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:54.632472 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38ccc0-e902-4326-90fe-7e5604373efa None admin] PATH_INFO: `/v3/roles/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:54.646073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38ccc0-e902-4326-90fe-7e5604373efa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:54.663082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-ee38ccc0-e902-4326-90fe-7e5604373efa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:54.663082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:54.663082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:54.663082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:54.663082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:54.663082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:54.663082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:54.663082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:54.663082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:54.663082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:54.663082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:54.663082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:54.663082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:54.663082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:54.663082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:54.663082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:54.664104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:54.664104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:54.664104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:54.664104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:54.664104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:54.664104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:54.664104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:54.664104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:54.664104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:54.664104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:54.664104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:54.664104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:54.664104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:54.664104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:54.664104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:54.664104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:54.664984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:54.664984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:54.664984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:54.664984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:54.664984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:54.664984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:54.664984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:54.664984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:54.664984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:54.664984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:54.664984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:54.664984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:54.664984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 394/808] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:54.668868 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38ccc0-e902-4326-90fe-7e5604373efa None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:54.749252 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a28f98-a588-4c90-887f-f36dc9a5a9a9 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:54.791870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38ccc0-e902-4326-90fe-7e5604373efa None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:54.792734 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d7b3a-3232-4062-af31-3520cfb25539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:54.793948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d7b3a-3232-4062-af31-3520cfb25539 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:54.795224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d7b3a-3232-4062-af31-3520cfb25539 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:54.795664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d7b3a-3232-4062-af31-3520cfb25539 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:54.804619 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d7b3a-3232-4062-af31-3520cfb25539 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:54.807404 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d7b3a-3232-4062-af31-3520cfb25539 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:54.826109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-584d7b3a-3232-4062-af31-3520cfb25539 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 21:33:54.826109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:54.826109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:54.826109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:54.826109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:54.826109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:54.826109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:54.826109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:54.826109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:54.826109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:54.826109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:54.826109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:54.826109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:54.826109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:54.826109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:54.826109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:54.827371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:54.827371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:54.827371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:54.827371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:54.827371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:54.827371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:54.827371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:54.827371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:54.827371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:54.827371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:54.827371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:54.827371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:54.827371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:54.827371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:54.827371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:54.827371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:54.827371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:54.827371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:54.828331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:54.828331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:54.828331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:54.828331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:54.828331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:54.828331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:54.828331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:54.828331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:54.828331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 21:33:54.828331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:54.828894 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 415/809] 10.222.0.11 () {56 vars in 1093 bytes} [Wed May 4 21:33:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:54.833947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008897c-0062-401e-af25-9470feb60b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:54.834145 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d7b3a-3232-4062-af31-3520cfb25539 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:54.835080 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008897c-0062-401e-af25-9470feb60b99 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:54.835575 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008897c-0062-401e-af25-9470feb60b99 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:54.836049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008897c-0062-401e-af25-9470feb60b99 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:54.837049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008897c-0062-401e-af25-9470feb60b99 None admin] RBAC: Adding query filter params (name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:54.837603 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008897c-0062-401e-af25-9470feb60b99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:54.839324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008897c-0062-401e-af25-9470feb60b99 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:54.848269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 395/810] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:33:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:54.855561 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008897c-0062-401e-af25-9470feb60b99 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:54.940174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d7b3a-3232-4062-af31-3520cfb25539 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:54.975053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def51cc3-deca-4b8a-b6c5-ce531f35095b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:54.975808 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def51cc3-deca-4b8a-b6c5-ce531f35095b None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:54.976096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def51cc3-deca-4b8a-b6c5-ce531f35095b None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:54.976373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def51cc3-deca-4b8a-b6c5-ce531f35095b None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:54.977259 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def51cc3-deca-4b8a-b6c5-ce531f35095b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:54.977690 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def51cc3-deca-4b8a-b6c5-ce531f35095b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:54.979157 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def51cc3-deca-4b8a-b6c5-ce531f35095b None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:54.997263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 416/811] 10.222.0.11 () {56 vars in 1133 bytes} [Wed May 4 21:33:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:55.002816 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def51cc3-deca-4b8a-b6c5-ce531f35095b None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:55.067917 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008897c-0062-401e-af25-9470feb60b99 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:55.104566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def51cc3-deca-4b8a-b6c5-ce531f35095b None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:55.106704 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdc16c-9183-4cfa-9acf-1bb2f057d335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:55.107550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdc16c-9183-4cfa-9acf-1bb2f057d335 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:55.107834 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdc16c-9183-4cfa-9acf-1bb2f057d335 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:55.108111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdc16c-9183-4cfa-9acf-1bb2f057d335 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:55.118852 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdc16c-9183-4cfa-9acf-1bb2f057d335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:55.120366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdc16c-9183-4cfa-9acf-1bb2f057d335 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:55.138135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-21fdc16c-9183-4cfa-9acf-1bb2f057d335 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:55.138135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:55.138135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:55.138135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:55.138135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:55.138135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:55.138135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:55.138135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:55.138135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:55.138135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:55.138135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:55.138135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:55.138135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:55.138135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:55.138135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:55.139119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:55.139119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:55.139119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:55.139119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:55.139119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:55.139119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:55.139119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:55.139119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:55.139119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:55.139119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:55.139119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:55.139119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:55.139119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:55.139119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:55.139119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:55.139119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:55.139119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:55.140032 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:55.140032 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:55.140032 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:55.140032 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:55.140268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaebc42-8a83-4245-9e81-9b92b7857b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:55.140268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaebc42-8a83-4245-9e81-9b92b7857b4e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:55.140268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaebc42-8a83-4245-9e81-9b92b7857b4e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:55.140268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaebc42-8a83-4245-9e81-9b92b7857b4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:55.144441 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 396/812] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:55.145601 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26560eae-d912-4005-8e5e-f411fb21956b None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:55.145895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26560eae-d912-4005-8e5e-f411fb21956b None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:55.146177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26560eae-d912-4005-8e5e-f411fb21956b None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:55.147734 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 397/813] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:55.148439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26560eae-d912-4005-8e5e-f411fb21956b None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:55.215106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaebc42-8a83-4245-9e81-9b92b7857b4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:55.216569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaebc42-8a83-4245-9e81-9b92b7857b4e None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:55.254275 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26560eae-d912-4005-8e5e-f411fb21956b None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:55.286738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621cdcd-2708-4139-a679-a31023b15a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:55.287453 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621cdcd-2708-4139-a679-a31023b15a67 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:55.287739 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621cdcd-2708-4139-a679-a31023b15a67 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:55.288028 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621cdcd-2708-4139-a679-a31023b15a67 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:55.288741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621cdcd-2708-4139-a679-a31023b15a67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:55.289049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621cdcd-2708-4139-a679-a31023b15a67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:55.290675 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621cdcd-2708-4139-a679-a31023b15a67 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:55.307242 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 398/814] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:55.308585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa8911-593c-4c61-a84b-50afbc59ad40 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:55.308878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa8911-593c-4c61-a84b-50afbc59ad40 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:55.309160 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa8911-593c-4c61-a84b-50afbc59ad40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:55.317681 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 417/815] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 21:33:55.318517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaebc42-8a83-4245-9e81-9b92b7857b4e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:55.330042 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-16fa8911-593c-4c61-a84b-50afbc59ad40 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:55.331264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-16fa8911-593c-4c61-a84b-50afbc59ad40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:55.407382 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 399/816] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:33:55.408574 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa8911-593c-4c61-a84b-50afbc59ad40 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:55.416869 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaebc42-8a83-4245-9e81-9b92b7857b4e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:55.455887 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19686c9d-4ddc-4177-ba09-8b432947e993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:55.456879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19686c9d-4ddc-4177-ba09-8b432947e993 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:55.457162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19686c9d-4ddc-4177-ba09-8b432947e993 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:55.457431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19686c9d-4ddc-4177-ba09-8b432947e993 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:55.466628 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19686c9d-4ddc-4177-ba09-8b432947e993 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:55.469032 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19686c9d-4ddc-4177-ba09-8b432947e993 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:55.488980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-19686c9d-4ddc-4177-ba09-8b432947e993 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:33:55.488980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:55.488980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:55.488980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:55.488980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:55.488980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:55.488980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:55.488980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:55.488980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:55.488980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:55.488980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:55.488980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:55.488980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:55.488980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:55.488980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:55.488980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:55.489982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:55.489982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:55.489982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:55.489982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:55.489982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:55.489982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:55.489982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:55.489982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:55.489982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:55.489982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:55.489982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:55.489982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:55.489982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:55.489982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:55.489982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:55.489982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:55.489982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:55.489982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:55.490919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:55.490919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:55.490919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:55.490919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:55.490919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:55.490919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:55.490919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:55.490919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:55.490919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:33:55.490919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:55.490919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 418/817] 10.222.0.11 () {56 vars in 1117 bytes} [Wed May 4 21:33:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:55.491559 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19686c9d-4ddc-4177-ba09-8b432947e993 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:55.527372 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa8911-593c-4c61-a84b-50afbc59ad40 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:55.561199 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcc5d0-b864-4480-af17-2df995474604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:55.562416 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcc5d0-b864-4480-af17-2df995474604 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:55.562889 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcc5d0-b864-4480-af17-2df995474604 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:55.563432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcc5d0-b864-4480-af17-2df995474604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:55.573929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcc5d0-b864-4480-af17-2df995474604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:55.575800 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcc5d0-b864-4480-af17-2df995474604 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:55.597390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-97fcc5d0-b864-4480-af17-2df995474604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:55.597390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:55.597390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:55.597390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:55.597390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:55.597390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:55.597390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:55.597390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:55.597390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:55.597390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:55.597390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:55.597390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:55.597390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:55.597390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:55.597390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:55.598264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:55.598264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:55.598264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:55.598264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:55.598264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:55.598264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:55.598264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:55.598264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:55.598264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:55.598264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:55.598264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:55.598264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:55.598264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:55.598264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:55.598264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:55.598264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:55.598264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:55.599511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:55.599511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:55.599511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:55.599511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:55.602146 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 400/818] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:55.603964 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcc5d0-b864-4480-af17-2df995474604 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:55.612600 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19686c9d-4ddc-4177-ba09-8b432947e993 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:55.656498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c2705-42eb-475c-8333-64ab8c1e6f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:55.657629 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c2705-42eb-475c-8333-64ab8c1e6f0b None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:55.658152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c2705-42eb-475c-8333-64ab8c1e6f0b None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:55.658575 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c2705-42eb-475c-8333-64ab8c1e6f0b None admin] PATH_INFO: `/v3/services/network` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:55.659820 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c2705-42eb-475c-8333-64ab8c1e6f0b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:55.661586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c2705-42eb-475c-8333-64ab8c1e6f0b None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:55.677488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-284c2705-42eb-475c-8333-64ab8c1e6f0b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 21:33:55.677488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:55.677488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:33:55.677488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:33:55.677488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:33:55.677488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:33:55.677488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:33:55.677488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:33:55.677488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 21:33:55.677488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:55.677488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:33:55.677488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:55.677488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:55.677488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:55.677488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:55.677488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:55.677488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:55.678778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:55.678778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:55.678778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:55.678778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:55.678778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:55.678778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:55.678778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:33:55.678778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:33:55.678778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:33:55.678778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:33:55.678778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:55.678778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:55.678778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:55.678778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:55.678778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:55.678778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:55.679844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:55.679844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:55.679844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:55.679844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:55.679844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:55.679844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:55.679844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:55.679844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:55.679844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:55.679844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:55.679844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:33:55.679844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:33:55.679844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 21:33:55.679844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:55.682346 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 419/819] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:55 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:55.683321 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c2705-42eb-475c-8333-64ab8c1e6f0b None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:55.712998 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcc5d0-b864-4480-af17-2df995474604 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:55.747084 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab2e14-ffd6-4661-b69d-c5a4dad0ddeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:55.747679 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab2e14-ffd6-4661-b69d-c5a4dad0ddeb None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:55.748062 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab2e14-ffd6-4661-b69d-c5a4dad0ddeb None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:55.748437 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab2e14-ffd6-4661-b69d-c5a4dad0ddeb None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:55.749385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab2e14-ffd6-4661-b69d-c5a4dad0ddeb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:55.749815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab2e14-ffd6-4661-b69d-c5a4dad0ddeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:55.751371 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab2e14-ffd6-4661-b69d-c5a4dad0ddeb None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:55.769288 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 401/820] 10.222.0.11 () {56 vars in 1149 bytes} [Wed May 4 21:33:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:55.770368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab2e14-ffd6-4661-b69d-c5a4dad0ddeb None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:55.800673 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c2705-42eb-475c-8333-64ab8c1e6f0b None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:55.833812 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc068d9-5442-4e05-82e7-c60d79edfd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:55.834700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc068d9-5442-4e05-82e7-c60d79edfd88 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:55.835115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc068d9-5442-4e05-82e7-c60d79edfd88 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:55.835507 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc068d9-5442-4e05-82e7-c60d79edfd88 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:55.837073 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc068d9-5442-4e05-82e7-c60d79edfd88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:55.837073 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc068d9-5442-4e05-82e7-c60d79edfd88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:55.838613 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc068d9-5442-4e05-82e7-c60d79edfd88 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:55.851806 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 420/821] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:55.852907 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc068d9-5442-4e05-82e7-c60d79edfd88 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:55.895530 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab2e14-ffd6-4661-b69d-c5a4dad0ddeb None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:55.931226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223001e2-5164-4578-9da6-b4dbdee9457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:55.932053 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223001e2-5164-4578-9da6-b4dbdee9457f None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:55.932497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223001e2-5164-4578-9da6-b4dbdee9457f None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:55.932871 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223001e2-5164-4578-9da6-b4dbdee9457f None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:55.933721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223001e2-5164-4578-9da6-b4dbdee9457f None admin] RBAC: Adding query filter params (name=network) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:55.934523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223001e2-5164-4578-9da6-b4dbdee9457f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:55.936073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223001e2-5164-4578-9da6-b4dbdee9457f None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:55.946067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 402/822] 10.222.0.11 () {56 vars in 1112 bytes} [Wed May 4 21:33:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:55.946067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223001e2-5164-4578-9da6-b4dbdee9457f None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:55.966396 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc068d9-5442-4e05-82e7-c60d79edfd88 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:56.008106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a8e98-5323-475c-9cbe-63945da5e36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:56.009183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a8e98-5323-475c-9cbe-63945da5e36b None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:56.009716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a8e98-5323-475c-9cbe-63945da5e36b None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:56.010461 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a8e98-5323-475c-9cbe-63945da5e36b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:56.022988 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a8e98-5323-475c-9cbe-63945da5e36b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:56.024975 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a8e98-5323-475c-9cbe-63945da5e36b None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:56.046046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-d41a8e98-5323-475c-9cbe-63945da5e36b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:56.046046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:56.046046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:56.046046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:56.046046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:56.046046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:56.046046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:56.046046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:56.046046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:56.046046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:56.046046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:56.046046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:56.046046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:56.046046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:56.046046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:56.047166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:56.047166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:56.047166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:56.047166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:56.047166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:56.047166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:56.047166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:56.047166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:56.047166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:56.047166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:56.047166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:56.047166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:56.047166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:56.047166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:56.047166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:56.047166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:56.047166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:56.048214 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:56.048214 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:56.048214 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:56.048214 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:56.050623 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 421/823] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:56.051667 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a8e98-5323-475c-9cbe-63945da5e36b None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:56.059360 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223001e2-5164-4578-9da6-b4dbdee9457f None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:56.108410 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b19d34-a71d-417e-8183-8f076b419308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:56.109958 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b19d34-a71d-417e-8183-8f076b419308 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:56.110398 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b19d34-a71d-417e-8183-8f076b419308 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:56.110818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b19d34-a71d-417e-8183-8f076b419308 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:56.118498 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b19d34-a71d-417e-8183-8f076b419308 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:56.120294 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b19d34-a71d-417e-8183-8f076b419308 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:56.134467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-d4b19d34-a71d-417e-8183-8f076b419308 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:56.134467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:56.134467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:56.134467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:56.134467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:56.134467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:56.134467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:56.134467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:56.134467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:56.134467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:56.134467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:56.134467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:56.134467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:56.134467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:56.134467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:56.135425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:56.135425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:56.135425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:56.135425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:56.135425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:56.135425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:56.135425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:56.135425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:56.135425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:56.135425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:56.135425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:56.135425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:56.135425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:56.135425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:56.135425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:56.135425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:56.135425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:56.136311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:56.136311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:56.136311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:56.136311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:56.136311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:56.136311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:56.136311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:56.136311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:56.139730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 403/824] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:56.140727 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b19d34-a71d-417e-8183-8f076b419308 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:56.164658 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a8e98-5323-475c-9cbe-63945da5e36b None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:56.199841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84d755-c288-4c0c-a18b-740a87eb4d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:56.200476 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d755-c288-4c0c-a18b-740a87eb4d9f None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:56.200764 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d755-c288-4c0c-a18b-740a87eb4d9f None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:56.201041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d755-c288-4c0c-a18b-740a87eb4d9f None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:56.201749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84d755-c288-4c0c-a18b-740a87eb4d9f None admin] RBAC: Adding query filter params (type=network) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:56.202059 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84d755-c288-4c0c-a18b-740a87eb4d9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:56.203455 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84d755-c288-4c0c-a18b-740a87eb4d9f None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:56.208536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 422/825] 10.222.0.11 () {56 vars in 1112 bytes} [Wed May 4 21:33:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:56.209324 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84d755-c288-4c0c-a18b-740a87eb4d9f None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:56.245932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b19d34-a71d-417e-8183-8f076b419308 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:56.279101 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2449b-1e32-4d5c-8ec9-b797d60ea052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:56.280164 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2449b-1e32-4d5c-8ec9-b797d60ea052 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:56.280662 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2449b-1e32-4d5c-8ec9-b797d60ea052 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:56.281130 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2449b-1e32-4d5c-8ec9-b797d60ea052 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:56.282065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2449b-1e32-4d5c-8ec9-b797d60ea052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:56.282576 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2449b-1e32-4d5c-8ec9-b797d60ea052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:56.284166 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2449b-1e32-4d5c-8ec9-b797d60ea052 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:56.296473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 404/826] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:56.297268 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2449b-1e32-4d5c-8ec9-b797d60ea052 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:56.307698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84d755-c288-4c0c-a18b-740a87eb4d9f None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:56.340340 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085c306-42a1-4921-9b2f-fa6e69498196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:56.341041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085c306-42a1-4921-9b2f-fa6e69498196 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:56.341289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085c306-42a1-4921-9b2f-fa6e69498196 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:56.341592 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085c306-42a1-4921-9b2f-fa6e69498196 None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:56.342358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085c306-42a1-4921-9b2f-fa6e69498196 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:56.342649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085c306-42a1-4921-9b2f-fa6e69498196 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:56.344123 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085c306-42a1-4921-9b2f-fa6e69498196 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:56.360385 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 423/827] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:56.360385 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a85e68-fd38-4681-a7e6-6a8866cab9b0 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:56.360385 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a85e68-fd38-4681-a7e6-6a8866cab9b0 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:56.360385 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a85e68-fd38-4681-a7e6-6a8866cab9b0 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:56.360385 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 424/828] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:56.360385 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a85e68-fd38-4681-a7e6-6a8866cab9b0 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:56.407955 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2449b-1e32-4d5c-8ec9-b797d60ea052 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:56.447029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41db1d-098f-421d-a5d4-8b01b7908232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:56.447765 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41db1d-098f-421d-a5d4-8b01b7908232 None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:56.448035 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41db1d-098f-421d-a5d4-8b01b7908232 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:56.448326 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41db1d-098f-421d-a5d4-8b01b7908232 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:56.449061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41db1d-098f-421d-a5d4-8b01b7908232 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:56.450478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41db1d-098f-421d-a5d4-8b01b7908232 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:56.467677 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a85e68-fd38-4681-a7e6-6a8866cab9b0 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:56.479080 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 405/829] 10.222.0.11 () {60 vars in 1144 bytes} [Wed May 4 21:33:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:33:56.479080 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41db1d-098f-421d-a5d4-8b01b7908232 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:56.536387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0341d02-6042-4e91-b1f0-ea2c405a037f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:56.537581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0341d02-6042-4e91-b1f0-ea2c405a037f None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:56.537874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0341d02-6042-4e91-b1f0-ea2c405a037f None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:56.538436 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0341d02-6042-4e91-b1f0-ea2c405a037f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:56.548995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0341d02-6042-4e91-b1f0-ea2c405a037f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:56.550549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0341d02-6042-4e91-b1f0-ea2c405a037f None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:56.569224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-d0341d02-6042-4e91-b1f0-ea2c405a037f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:56.569224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:56.569224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:56.569224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:56.569224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:56.569224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:56.569224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:56.569224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:56.569224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:56.569224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:56.569224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:56.569224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:56.569224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:56.569224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:56.569224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:56.570203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:56.570203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:56.570203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:56.570203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:56.570203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:56.570203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:56.570203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:56.570203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:56.570203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:56.570203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:56.570203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:56.570203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:56.570203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:56.570203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:56.570203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:56.570203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:56.570203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:56.571113 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:56.571113 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:56.571113 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:56.571113 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:56.571113 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:56.571113 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:56.571113 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:56.571113 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:56.571113 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 425/830] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:56.572264 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dc57b-493f-45dd-9649-cc6085d8d6e3 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:56.572625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dc57b-493f-45dd-9649-cc6085d8d6e3 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:56.574628 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dc57b-493f-45dd-9649-cc6085d8d6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:56.594351 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41db1d-098f-421d-a5d4-8b01b7908232 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:56.595916 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-5b4dc57b-493f-45dd-9649-cc6085d8d6e3 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:56.597279 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5b4dc57b-493f-45dd-9649-cc6085d8d6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:56.640150 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a50960-0805-4134-a33c-c69a2cc28f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:56.640848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a50960-0805-4134-a33c-c69a2cc28f3a None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:56.641137 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a50960-0805-4134-a33c-c69a2cc28f3a None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:56.641418 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a50960-0805-4134-a33c-c69a2cc28f3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:56.642273 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a50960-0805-4134-a33c-c69a2cc28f3a None admin] RBAC: Adding query filter params (role.id=59778f07f0504e90a60212f460e8c774, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=f4f207481ccb4cfcbbcffd9df73d2985) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:56.642592 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a50960-0805-4134-a33c-c69a2cc28f3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:56.644542 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a50960-0805-4134-a33c-c69a2cc28f3a None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:56.659172 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 406/831] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:33:56 2022] GET /identity/v3/role_assignments?user.id=f4f207481ccb4cfcbbcffd9df73d2985&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=59778f07f0504e90a60212f460e8c774 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:56.660531 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a50960-0805-4134-a33c-c69a2cc28f3a None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:56.687770 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 426/832] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:33:56.720171 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4dc57b-493f-45dd-9649-cc6085d8d6e3 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:56.805280 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a50960-0805-4134-a33c-c69a2cc28f3a None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:56.851725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f98cf-39b7-4a2b-b00c-e86179649231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:56.852976 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f98cf-39b7-4a2b-b00c-e86179649231 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:56.853483 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f98cf-39b7-4a2b-b00c-e86179649231 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:56.854055 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f98cf-39b7-4a2b-b00c-e86179649231 None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:56.855123 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f98cf-39b7-4a2b-b00c-e86179649231 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:56.855654 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f98cf-39b7-4a2b-b00c-e86179649231 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:56.857332 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f98cf-39b7-4a2b-b00c-e86179649231 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:56.869815 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4dc57b-493f-45dd-9649-cc6085d8d6e3 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:56.872109 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 407/833] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:56.878085 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f98cf-39b7-4a2b-b00c-e86179649231 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:56.905987 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbd267-249e-459f-9d45-7bb3d6238de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:56.906796 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbd267-249e-459f-9d45-7bb3d6238de2 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:56.907171 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbd267-249e-459f-9d45-7bb3d6238de2 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:56.907399 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbd267-249e-459f-9d45-7bb3d6238de2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:56.918154 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbd267-249e-459f-9d45-7bb3d6238de2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:56.925878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-41cbd267-249e-459f-9d45-7bb3d6238de2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:33:56.925878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:56.925878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:56.925878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:56.925878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:56.925878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:56.925878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:56.925878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:56.925878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:56.925878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:56.925878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:56.925878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:56.925878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:56.925878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:56.925878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:56.925878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:56.926897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:56.926897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:56.926897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:56.926897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:56.926897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:56.926897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:56.926897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:56.926897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:56.926897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:56.926897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:56.926897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:56.926897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:56.926897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:56.926897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:56.926897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:56.926897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:56.928109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:56.928109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:56.928109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:56.928109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:56.928109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:56.928109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:56.928109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:56.928109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:56.928109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:56.928109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:56.928109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:33:56.928109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:56.928109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 427/834] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:33:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:33:56.934581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbd267-249e-459f-9d45-7bb3d6238de2 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:57.003003 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f98cf-39b7-4a2b-b00c-e86179649231 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:57.039583 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbd267-249e-459f-9d45-7bb3d6238de2 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:57.041741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ced65-c435-4ef1-a139-291b213a3f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:57.042824 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ced65-c435-4ef1-a139-291b213a3f57 None admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:57.043290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ced65-c435-4ef1-a139-291b213a3f57 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:57.043720 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ced65-c435-4ef1-a139-291b213a3f57 None admin] PATH_INFO: `/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/82b2e79995f94ab880f5d798ddd649b1/roles/c1ee07ef1a1f4986afc3af5a357e2c4c` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:57.058048 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ced65-c435-4ef1-a139-291b213a3f57 None admin] RBAC: Authorizing `identity:create_grant(project_id=3acb142d1aa34e18a018d3fdee8d7038, user_id=82b2e79995f94ab880f5d798ddd649b1, role_id=c1ee07ef1a1f4986afc3af5a357e2c4c)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:57.059723 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ced65-c435-4ef1-a139-291b213a3f57 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:57.072878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc278e2a-5c30-42de-82a2-23085a4ee814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:57.083070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc278e2a-5c30-42de-82a2-23085a4ee814 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:57.083070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc278e2a-5c30-42de-82a2-23085a4ee814 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:57.083070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc278e2a-5c30-42de-82a2-23085a4ee814 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:57.083070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc278e2a-5c30-42de-82a2-23085a4ee814 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:57.083070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc278e2a-5c30-42de-82a2-23085a4ee814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:57.083070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc278e2a-5c30-42de-82a2-23085a4ee814 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:57.083595 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 408/835] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:33:56 2022] PUT /identity/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/82b2e79995f94ab880f5d798ddd649b1/roles/c1ee07ef1a1f4986afc3af5a357e2c4c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:33:57.083595 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d70696-f1ee-4c52-bc35-3d5af7171f1a None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:57.083595 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d70696-f1ee-4c52-bc35-3d5af7171f1a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:57.083595 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d70696-f1ee-4c52-bc35-3d5af7171f1a None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:57.083595 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 409/836] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:57.091074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859c6eb-a25a-46bd-af7d-94e05f8685c5 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:57.091074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859c6eb-a25a-46bd-af7d-94e05f8685c5 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:57.091074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859c6eb-a25a-46bd-af7d-94e05f8685c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:57.097209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 428/837] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:33:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:57.101777 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc278e2a-5c30-42de-82a2-23085a4ee814 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:57.110525 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-6859c6eb-a25a-46bd-af7d-94e05f8685c5 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:57.111805 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-6859c6eb-a25a-46bd-af7d-94e05f8685c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:57.191478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 410/838] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:33:57.209576 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859c6eb-a25a-46bd-af7d-94e05f8685c5 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:57.217096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc278e2a-5c30-42de-82a2-23085a4ee814 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:57.253848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c96ac-2833-41fc-bb8e-a1cda57e25bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:57.254592 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c96ac-2833-41fc-bb8e-a1cda57e25bf None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:57.254880 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c96ac-2833-41fc-bb8e-a1cda57e25bf None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:57.255193 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c96ac-2833-41fc-bb8e-a1cda57e25bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:57.267784 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c96ac-2833-41fc-bb8e-a1cda57e25bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:57.269411 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c96ac-2833-41fc-bb8e-a1cda57e25bf None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:57.290700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-6c6c96ac-2833-41fc-bb8e-a1cda57e25bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:57.290700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:57.290700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:57.290700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:57.290700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:57.290700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:57.290700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:57.290700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:57.290700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:57.290700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:57.290700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:57.290700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:57.290700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:57.290700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:57.290700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:57.291827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:57.291827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:57.291827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:57.291827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:57.291827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:57.291827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:57.291827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:57.291827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:57.291827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:57.291827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:57.291827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:57.291827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:57.291827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:57.291827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:57.291827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:57.291827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:57.291827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:57.292718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:57.292718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:57.292718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:57.292718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:57.292718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 429/839] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:57.298089 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c96ac-2833-41fc-bb8e-a1cda57e25bf None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:57.322656 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859c6eb-a25a-46bd-af7d-94e05f8685c5 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:57.361034 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4482f-77f1-405b-a813-7f4c9f70c800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:57.361843 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4482f-77f1-405b-a813-7f4c9f70c800 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:57.362129 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4482f-77f1-405b-a813-7f4c9f70c800 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:57.362409 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4482f-77f1-405b-a813-7f4c9f70c800 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:57.363148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4482f-77f1-405b-a813-7f4c9f70c800 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:57.364458 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4482f-77f1-405b-a813-7f4c9f70c800 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:57.378317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-edd4482f-77f1-405b-a813-7f4c9f70c800 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 21:33:57.378317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:57.378317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:33:57.378317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:33:57.378317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:33:57.378317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:33:57.378317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:33:57.378317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:33:57.378317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 21:33:57.378317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:57.378317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:33:57.378317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:57.378317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:57.378317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:57.378317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:57.378317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:57.378317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:57.379364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:57.379364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:57.379364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:57.379364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:57.379364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:57.379364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:57.379364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:33:57.379364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:33:57.379364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:33:57.379364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:33:57.379364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:57.379364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:57.379364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:57.379364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:57.379364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:57.379364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:57.380300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:57.380300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:57.380300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:57.380300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:57.380300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:57.380300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:57.380300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:57.380300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:57.380300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:57.380300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:57.380300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:33:57.380300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:33:57.380300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 21:33:57.380300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:57.380300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 411/840] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:33:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:33:57.387506 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4482f-77f1-405b-a813-7f4c9f70c800 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:57.427096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c96ac-2833-41fc-bb8e-a1cda57e25bf None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:57.464030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8864f-1778-4cbe-ba5a-e4330f24e556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:57.464779 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8864f-1778-4cbe-ba5a-e4330f24e556 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:57.465042 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8864f-1778-4cbe-ba5a-e4330f24e556 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:57.465374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8864f-1778-4cbe-ba5a-e4330f24e556 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:57.466103 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8864f-1778-4cbe-ba5a-e4330f24e556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:57.466416 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8864f-1778-4cbe-ba5a-e4330f24e556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:57.467819 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8864f-1778-4cbe-ba5a-e4330f24e556 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:57.485519 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 430/841] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:57.486541 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8864f-1778-4cbe-ba5a-e4330f24e556 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:57.511525 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4482f-77f1-405b-a813-7f4c9f70c800 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:57.546424 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71db38-1cac-4697-a340-b86e1be5eea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:57.547165 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71db38-1cac-4697-a340-b86e1be5eea0 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:57.547415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71db38-1cac-4697-a340-b86e1be5eea0 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:57.547716 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71db38-1cac-4697-a340-b86e1be5eea0 None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:57.548406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71db38-1cac-4697-a340-b86e1be5eea0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:57.548715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71db38-1cac-4697-a340-b86e1be5eea0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:57.550090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71db38-1cac-4697-a340-b86e1be5eea0 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:57.559267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 412/842] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:33:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:57.560370 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71db38-1cac-4697-a340-b86e1be5eea0 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:57.610585 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8864f-1778-4cbe-ba5a-e4330f24e556 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:57.646018 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc933881-3b94-4031-8786-69b24c6bb7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:57.647262 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc933881-3b94-4031-8786-69b24c6bb7e3 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:57.647790 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc933881-3b94-4031-8786-69b24c6bb7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:57.648974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc933881-3b94-4031-8786-69b24c6bb7e3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:57.660216 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc933881-3b94-4031-8786-69b24c6bb7e3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:57.662171 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc933881-3b94-4031-8786-69b24c6bb7e3 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:57.677888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-fc933881-3b94-4031-8786-69b24c6bb7e3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 21:33:57.677888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:57.677888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:57.677888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:57.677888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:57.677888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:57.677888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:57.677888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:57.677888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:57.677888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:57.677888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:57.677888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:57.677888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:33:57.677888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:33:57.677888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:33:57.677888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:33:57.678871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:57.678871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:57.678871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:33:57.678871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:57.678871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:33:57.678871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:33:57.678871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:57.678871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:57.678871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:57.678871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:57.678871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:57.678871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:57.678871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:57.678871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:57.678871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:57.678871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:57.678871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:57.678871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:57.680159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:57.680159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:57.680159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:33:57.680159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:33:57.680159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:33:57.680159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:33:57.680159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:33:57.680159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:33:57.680159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 21:33:57.680159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:57.680762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71db38-1cac-4697-a340-b86e1be5eea0 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:57.687951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 431/843] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:33:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:57.688981 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc933881-3b94-4031-8786-69b24c6bb7e3 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:57.719934 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff59bdb-7f7f-41eb-9192-0d8c168384db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:57.720902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff59bdb-7f7f-41eb-9192-0d8c168384db None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:57.721202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff59bdb-7f7f-41eb-9192-0d8c168384db None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:57.721482 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff59bdb-7f7f-41eb-9192-0d8c168384db None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:57.722465 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff59bdb-7f7f-41eb-9192-0d8c168384db None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:57.722779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff59bdb-7f7f-41eb-9192-0d8c168384db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:57.724520 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff59bdb-7f7f-41eb-9192-0d8c168384db None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:57.735135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 413/844] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:33:57 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:57.804638 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc933881-3b94-4031-8786-69b24c6bb7e3 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:57.845126 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d0db3-0cb6-4963-8f84-64e5a1ab54f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:57.846073 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d0db3-0cb6-4963-8f84-64e5a1ab54f3 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:57.846537 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d0db3-0cb6-4963-8f84-64e5a1ab54f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:57.846959 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d0db3-0cb6-4963-8f84-64e5a1ab54f3 None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:57.847982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d0db3-0cb6-4963-8f84-64e5a1ab54f3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:57.848759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d0db3-0cb6-4963-8f84-64e5a1ab54f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:57.850363 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d0db3-0cb6-4963-8f84-64e5a1ab54f3 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:57.872724 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 432/845] 10.222.0.11 () {56 vars in 1135 bytes} [Wed May 4 21:33:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:57.879336 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff59bdb-7f7f-41eb-9192-0d8c168384db None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:57.991837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff59bdb-7f7f-41eb-9192-0d8c168384db None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:58.028870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa922ef3-37b0-4414-a3f4-93177e9b3c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:58.029811 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa922ef3-37b0-4414-a3f4-93177e9b3c66 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:58.030263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa922ef3-37b0-4414-a3f4-93177e9b3c66 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:58.030695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa922ef3-37b0-4414-a3f4-93177e9b3c66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:58.098726 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa922ef3-37b0-4414-a3f4-93177e9b3c66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:58.100128 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa922ef3-37b0-4414-a3f4-93177e9b3c66 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:58.197594 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 414/846] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:33:57 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:33:58.203822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d0db3-0cb6-4963-8f84-64e5a1ab54f3 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:58.307679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d0db3-0cb6-4963-8f84-64e5a1ab54f3 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:58.341520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cc041-a681-4201-9869-d90d629057a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:58.342389 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cc041-a681-4201-9869-d90d629057a1 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:58.342674 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cc041-a681-4201-9869-d90d629057a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:58.342950 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cc041-a681-4201-9869-d90d629057a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:58.354466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cc041-a681-4201-9869-d90d629057a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:58.356021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cc041-a681-4201-9869-d90d629057a1 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:58.373503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-d52cc041-a681-4201-9869-d90d629057a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:58.373503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:58.373503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:58.373503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:58.373503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:58.373503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:58.373503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:58.373503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:58.373503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:58.373503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:58.373503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:58.373503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:58.373503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:33:58.373503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:33:58.373503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:33:58.374425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:33:58.374425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:58.374425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:58.374425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:58.374425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:58.374425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:58.374425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:58.374425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:58.374425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:58.374425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:58.374425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:58.374425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:58.374425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:58.374425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:58.374425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:58.374425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:58.374425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:58.375334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:33:58.375334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:33:58.375334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:33:58.375334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:58.375334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 433/847] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:58.383518 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa922ef3-37b0-4414-a3f4-93177e9b3c66 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:58.494485 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa922ef3-37b0-4414-a3f4-93177e9b3c66 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:58.529381 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a9cba-6899-4c82-898e-db20818c5a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:58.530038 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a9cba-6899-4c82-898e-db20818c5a51 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:58.530331 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a9cba-6899-4c82-898e-db20818c5a51 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:58.530601 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a9cba-6899-4c82-898e-db20818c5a51 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:58.531348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a9cba-6899-4c82-898e-db20818c5a51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:58.531656 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a9cba-6899-4c82-898e-db20818c5a51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:58.533023 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a9cba-6899-4c82-898e-db20818c5a51 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:58.544823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 415/848] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:58.550791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cc041-a681-4201-9869-d90d629057a1 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:58.650951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cc041-a681-4201-9869-d90d629057a1 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:58.686367 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc754bf-c4e7-4d13-b9c0-c625d5f30230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:58.687207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc754bf-c4e7-4d13-b9c0-c625d5f30230 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:58.687486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc754bf-c4e7-4d13-b9c0-c625d5f30230 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:58.687760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc754bf-c4e7-4d13-b9c0-c625d5f30230 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:58.694551 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc754bf-c4e7-4d13-b9c0-c625d5f30230 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:58.696032 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc754bf-c4e7-4d13-b9c0-c625d5f30230 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:58.709767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-ecc754bf-c4e7-4d13-b9c0-c625d5f30230 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:58.709767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:58.709767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:58.709767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:58.709767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:58.709767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:58.709767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:58.709767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:58.709767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:58.709767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:58.709767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:58.709767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:58.709767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:33:58.709767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:33:58.709767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:33:58.710688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:33:58.710688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:58.710688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:58.710688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:58.710688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:58.710688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:58.710688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:58.710688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:58.710688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:33:58.710688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:58.710688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:58.710688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:58.710688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:58.710688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:58.710688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:58.710688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:58.710688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:58.711665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:33:58.711665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:33:58.711665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:33:58.711665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:33:58.711665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:33:58.711665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:33:58.711665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:33:58.711665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:33:58.711665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 434/849] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:33:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:58.720385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a9cba-6899-4c82-898e-db20818c5a51 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:58.823667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a9cba-6899-4c82-898e-db20818c5a51 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:58.861527 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596aea22-4fe0-4b56-83ee-20264c60bb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:58.862202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596aea22-4fe0-4b56-83ee-20264c60bb8b None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:58.862482 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596aea22-4fe0-4b56-83ee-20264c60bb8b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:58.862755 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596aea22-4fe0-4b56-83ee-20264c60bb8b None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:58.863583 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596aea22-4fe0-4b56-83ee-20264c60bb8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:58.863861 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596aea22-4fe0-4b56-83ee-20264c60bb8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:58.865286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596aea22-4fe0-4b56-83ee-20264c60bb8b None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:58.877666 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 416/850] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:33:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:58.883664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc754bf-c4e7-4d13-b9c0-c625d5f30230 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:58.991928 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc754bf-c4e7-4d13-b9c0-c625d5f30230 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:59.026009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978831b3-f93e-4e2a-8f0c-aa26d4626f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:59.027147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978831b3-f93e-4e2a-8f0c-aa26d4626f28 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:59.027777 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978831b3-f93e-4e2a-8f0c-aa26d4626f28 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:59.028288 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978831b3-f93e-4e2a-8f0c-aa26d4626f28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:59.029307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978831b3-f93e-4e2a-8f0c-aa26d4626f28 None admin] RBAC: Adding query filter params (role.id=59778f07f0504e90a60212f460e8c774, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=8358da535a104873ad9f5676989a9e21) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:59.029823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978831b3-f93e-4e2a-8f0c-aa26d4626f28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:59.031464 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978831b3-f93e-4e2a-8f0c-aa26d4626f28 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:59.038089 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 435/851] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:33:58 2022] GET /identity/v3/role_assignments?user.id=8358da535a104873ad9f5676989a9e21&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=59778f07f0504e90a60212f460e8c774 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:59.146653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7048dd-0b4b-4373-b8ac-bcf5b12e568a None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:59.146986 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7048dd-0b4b-4373-b8ac-bcf5b12e568a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:59.147252 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7048dd-0b4b-4373-b8ac-bcf5b12e568a None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:59.148990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 417/852] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:59.154748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a8662-1179-43cc-a97e-743beb24144e None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:59.155392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a8662-1179-43cc-a97e-743beb24144e None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:59.155861 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a8662-1179-43cc-a97e-743beb24144e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:59.173935 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-161a8662-1179-43cc-a97e-743beb24144e None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:59.175572 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-161a8662-1179-43cc-a97e-743beb24144e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:59.252942 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 436/853] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:33:59.276440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7048dd-0b4b-4373-b8ac-bcf5b12e568a None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:59.376158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7048dd-0b4b-4373-b8ac-bcf5b12e568a None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:59.409335 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e2cb2-cbe4-4144-ba26-60a778b56ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:59.410155 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e2cb2-cbe4-4144-ba26-60a778b56ade None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:59.410439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e2cb2-cbe4-4144-ba26-60a778b56ade None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:59.410720 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e2cb2-cbe4-4144-ba26-60a778b56ade None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:59.411402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e2cb2-cbe4-4144-ba26-60a778b56ade None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:59.412774 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e2cb2-cbe4-4144-ba26-60a778b56ade None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:59.424789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-459e2cb2-cbe4-4144-ba26-60a778b56ade None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 21:33:59.424789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:59.424789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:33:59.424789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:33:59.424789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:33:59.424789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:33:59.424789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:33:59.424789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:33:59.424789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 21:33:59.424789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:59.424789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:33:59.424789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:59.424789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:59.424789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:59.424789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:59.424789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:59.425736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:59.425736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:59.425736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:59.425736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:59.425736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:59.425736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:59.425736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:59.425736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:33:59.425736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:33:59.425736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:33:59.425736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:33:59.425736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:59.425736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:59.425736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:59.425736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:59.425736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:59.426569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:59.426569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:59.426569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:59.426569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:59.426569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:59.426569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:59.426569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:59.426569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:59.426569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:59.426569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:59.426569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:59.426569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:33:59.426569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:33:59.426569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 21:33:59.426569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:59.426569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 418/854] 10.222.0.11 () {56 vars in 1132 bytes} [Wed May 4 21:33:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:33:59.435160 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a8662-1179-43cc-a97e-743beb24144e None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:59.442862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292cde-54bf-4ab9-9b25-fd7ee013cc99 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:59.442862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292cde-54bf-4ab9-9b25-fd7ee013cc99 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:59.442862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292cde-54bf-4ab9-9b25-fd7ee013cc99 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:59.442862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 419/855] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:33:59.452022 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e72750-f9a1-4cfe-a14a-c9a12e8f8fae None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:59.452022 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e72750-f9a1-4cfe-a14a-c9a12e8f8fae None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:59.452777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e72750-f9a1-4cfe-a14a-c9a12e8f8fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:59.474545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-85e72750-f9a1-4cfe-a14a-c9a12e8f8fae None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:59.475865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-85e72750-f9a1-4cfe-a14a-c9a12e8f8fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:59.537495 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a8662-1179-43cc-a97e-743beb24144e None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:59.557907 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 420/856] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:33:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:33:59.580987 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe67890-7148-46fe-9594-7f13bea6398e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:59.581343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe67890-7148-46fe-9594-7f13bea6398e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:59.581613 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe67890-7148-46fe-9594-7f13bea6398e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:59.581889 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe67890-7148-46fe-9594-7f13bea6398e None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:59.582652 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe67890-7148-46fe-9594-7f13bea6398e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:59.583011 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe67890-7148-46fe-9594-7f13bea6398e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:59.584423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe67890-7148-46fe-9594-7f13bea6398e None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:59.590231 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 437/857] 10.222.0.11 () {56 vars in 1126 bytes} [Wed May 4 21:33:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:59.591976 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e72750-f9a1-4cfe-a14a-c9a12e8f8fae None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:59.595173 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe67890-7148-46fe-9594-7f13bea6398e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:59.694935 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe67890-7148-46fe-9594-7f13bea6398e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:59.709830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e72750-f9a1-4cfe-a14a-c9a12e8f8fae None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:59.728213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c34260-e67d-40f1-88b0-e50c50ef9e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:59.728936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c34260-e67d-40f1-88b0-e50c50ef9e0c None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:59.729220 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c34260-e67d-40f1-88b0-e50c50ef9e0c None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:59.729494 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c34260-e67d-40f1-88b0-e50c50ef9e0c None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:59.730198 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c34260-e67d-40f1-88b0-e50c50ef9e0c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:59.730503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c34260-e67d-40f1-88b0-e50c50ef9e0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:59.731904 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c34260-e67d-40f1-88b0-e50c50ef9e0c None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:59.736643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 438/858] 10.222.0.11 () {56 vars in 1126 bytes} [Wed May 4 21:33:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:33:59.758548 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132799d-19bd-4068-9495-9caac3b5f08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:59.759435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132799d-19bd-4068-9495-9caac3b5f08c None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:59.759716 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132799d-19bd-4068-9495-9caac3b5f08c None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:59.759973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132799d-19bd-4068-9495-9caac3b5f08c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:59.772627 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132799d-19bd-4068-9495-9caac3b5f08c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:33:59.780672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-1132799d-19bd-4068-9495-9caac3b5f08c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:59.780672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:33:59.780672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:33:59.780672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:33:59.780672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:33:59.780672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:33:59.780672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:33:59.780672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:33:59.780672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:33:59.780672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:33:59.780672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:33:59.780672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:33:59.780672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:33:59.780672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:33:59.780672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:33:59.780672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:33:59.781730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:33:59.781730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:33:59.781730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:33:59.781730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:33:59.781730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:33:59.781730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:33:59.781730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:33:59.781730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:33:59.781730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:33:59.781730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:33:59.781730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:33:59.781730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:33:59.781730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:33:59.781730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:33:59.781730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:33:59.781730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:33:59.783202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:33:59.783202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:33:59.783202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:33:59.783202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:33:59.783202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:33:59.783202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:33:59.783202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:33:59.783202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:33:59.783202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:33:59.783202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:33:59.783202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:33:59.783202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:33:59.783202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 421/859] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:33:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:33:59.792338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c34260-e67d-40f1-88b0-e50c50ef9e0c None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:59.897337 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c34260-e67d-40f1-88b0-e50c50ef9e0c None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:59.934528 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f881a-8f20-43ce-ac54-b45cf101cd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:59.935613 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f881a-8f20-43ce-ac54-b45cf101cd71 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:59.936129 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f881a-8f20-43ce-ac54-b45cf101cd71 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:59.936608 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f881a-8f20-43ce-ac54-b45cf101cd71 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:59.937586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f881a-8f20-43ce-ac54-b45cf101cd71 None admin] RBAC: Adding query filter params (name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:33:59.938111 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f881a-8f20-43ce-ac54-b45cf101cd71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:59.939738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f881a-8f20-43ce-ac54-b45cf101cd71 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:59.954503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 439/860] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:33:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:33:59.956225 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132799d-19bd-4068-9495-9caac3b5f08c None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:00.101722 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132799d-19bd-4068-9495-9caac3b5f08c None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:00.157315 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a9276-317e-4a88-b7e7-d941072fb14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:00.158601 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a9276-317e-4a88-b7e7-d941072fb14e None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:00.159260 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a9276-317e-4a88-b7e7-d941072fb14e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:00.159744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a9276-317e-4a88-b7e7-d941072fb14e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:00.177789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a9276-317e-4a88-b7e7-d941072fb14e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:00.180430 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a9276-317e-4a88-b7e7-d941072fb14e None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:00.209955 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033464a6-4236-4d49-a192-1cf90c376678 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:00.210230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033464a6-4236-4d49-a192-1cf90c376678 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:00.210538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033464a6-4236-4d49-a192-1cf90c376678 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:00.211895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-294a9276-317e-4a88-b7e7-d941072fb14e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:00.211895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:00.211895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:00.211895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:00.211895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:00.211895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:00.211895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:00.211895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:00.211895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:00.211895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:00.211895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:00.211895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:00.211895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:34:00.211895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:34:00.211895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:34:00.213906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:34:00.213906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:00.213906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:00.213906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:00.213906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:00.213906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:00.213906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:00.213906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:00.213906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:00.213906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:00.213906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:00.213906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:00.213906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:00.213906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:00.213906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:00.213906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:00.213906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:00.215890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:34:00.215890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:34:00.215890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:00.215890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:00.216821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 440/861] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:00.217027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 422/862] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:34:00.217896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f647d-2720-4ce2-b46e-3be3206acfe7 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:00.218179 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f647d-2720-4ce2-b46e-3be3206acfe7 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:00.218455 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f647d-2720-4ce2-b46e-3be3206acfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:00.224578 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a9276-317e-4a88-b7e7-d941072fb14e None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:00.244521 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-824f647d-2720-4ce2-b46e-3be3206acfe7 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:00.245851 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-824f647d-2720-4ce2-b46e-3be3206acfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:00.319241 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 441/863] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:34:00.336814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f647d-2720-4ce2-b46e-3be3206acfe7 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:00.343015 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a9276-317e-4a88-b7e7-d941072fb14e None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:00.391798 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6960789-d24f-4b2a-85da-ab4317437a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:00.392952 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6960789-d24f-4b2a-85da-ab4317437a69 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:00.393504 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6960789-d24f-4b2a-85da-ab4317437a69 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:00.393953 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6960789-d24f-4b2a-85da-ab4317437a69 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:00.395336 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6960789-d24f-4b2a-85da-ab4317437a69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:00.395836 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6960789-d24f-4b2a-85da-ab4317437a69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:00.397757 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6960789-d24f-4b2a-85da-ab4317437a69 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:00.418293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 423/864] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:00.420535 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6960789-d24f-4b2a-85da-ab4317437a69 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:00.440828 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f647d-2720-4ce2-b46e-3be3206acfe7 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:00.474791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169102d-d75d-4b65-aeca-a770c00e2017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:00.475553 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169102d-d75d-4b65-aeca-a770c00e2017 None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:00.475893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169102d-d75d-4b65-aeca-a770c00e2017 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:00.476107 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169102d-d75d-4b65-aeca-a770c00e2017 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:00.476897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169102d-d75d-4b65-aeca-a770c00e2017 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:00.478425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169102d-d75d-4b65-aeca-a770c00e2017 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:00.503158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 442/865] 10.222.0.11 () {60 vars in 1141 bytes} [Wed May 4 21:34:00 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:34:00.541994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6960789-d24f-4b2a-85da-ab4317437a69 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:00.597719 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc857367-921c-4bea-81bb-75253cff3ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:00.599336 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc857367-921c-4bea-81bb-75253cff3ae7 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:00.599856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc857367-921c-4bea-81bb-75253cff3ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:00.600336 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc857367-921c-4bea-81bb-75253cff3ae7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:00.608913 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc857367-921c-4bea-81bb-75253cff3ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:00.610779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc857367-921c-4bea-81bb-75253cff3ae7 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:00.627132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-cc857367-921c-4bea-81bb-75253cff3ae7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:34:00.627132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:00.627132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:00.627132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:00.627132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:00.627132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:00.627132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:00.627132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:00.627132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:00.627132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:00.627132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:00.627132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:00.627132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:34:00.627132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:34:00.627132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:34:00.627132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:34:00.628131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:00.628131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:00.628131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:34:00.628131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:34:00.628131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:34:00.628131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:34:00.628131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:00.628131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:00.628131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:00.628131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:00.628131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:00.628131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:00.628131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:00.628131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:00.628131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:00.628131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:00.628131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:00.628131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:00.629054 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:00.629054 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:00.629054 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:34:00.629054 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:34:00.629054 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:34:00.629054 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:34:00.629054 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:34:00.629054 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:34:00.629054 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:34:00.629054 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:00.636310 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 424/866] 10.222.0.11 () {56 vars in 1117 bytes} [Wed May 4 21:34:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:00.638061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169102d-d75d-4b65-aeca-a770c00e2017 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:00.744508 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169102d-d75d-4b65-aeca-a770c00e2017 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:00.777442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e6918-4a26-4ac4-bf21-2ef237a8dc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:00.778122 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e6918-4a26-4ac4-bf21-2ef237a8dc1f None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:00.778404 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e6918-4a26-4ac4-bf21-2ef237a8dc1f None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:00.778681 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e6918-4a26-4ac4-bf21-2ef237a8dc1f None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:00.779616 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e6918-4a26-4ac4-bf21-2ef237a8dc1f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:00.779927 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e6918-4a26-4ac4-bf21-2ef237a8dc1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:00.781416 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e6918-4a26-4ac4-bf21-2ef237a8dc1f None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:00.798853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 443/867] 10.222.0.11 () {56 vars in 1149 bytes} [Wed May 4 21:34:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:00.804574 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc857367-921c-4bea-81bb-75253cff3ae7 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:00.902265 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc857367-921c-4bea-81bb-75253cff3ae7 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:00.935358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7332d4-f319-4a33-aa7b-20a387579fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:00.936369 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7332d4-f319-4a33-aa7b-20a387579fa9 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:00.936842 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7332d4-f319-4a33-aa7b-20a387579fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:00.937307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7332d4-f319-4a33-aa7b-20a387579fa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:01.002423 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7332d4-f319-4a33-aa7b-20a387579fa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:01.004348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7332d4-f319-4a33-aa7b-20a387579fa9 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:01.106666 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 425/868] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:34:00 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 21:34:01.108355 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e6918-4a26-4ac4-bf21-2ef237a8dc1f None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:01.204946 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e6918-4a26-4ac4-bf21-2ef237a8dc1f None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:01.240178 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe39b2-1c32-43c0-a2aa-416ca5e68180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:01.241283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe39b2-1c32-43c0-a2aa-416ca5e68180 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:01.241737 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe39b2-1c32-43c0-a2aa-416ca5e68180 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:01.242182 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe39b2-1c32-43c0-a2aa-416ca5e68180 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:01.253164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe39b2-1c32-43c0-a2aa-416ca5e68180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:01.254902 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe39b2-1c32-43c0-a2aa-416ca5e68180 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:01.272444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-9cfe39b2-1c32-43c0-a2aa-416ca5e68180 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:01.272444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:01.272444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:01.272444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:01.272444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:01.272444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:01.272444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:01.272444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:01.272444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:01.272444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:01.272444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:01.272444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:01.272444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:34:01.272444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:34:01.272444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:34:01.273359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:34:01.273359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:01.273359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:01.273359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:01.273359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:01.273359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:01.273359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:01.273359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:01.273359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:01.273359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:01.273359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:01.273359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:01.273359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:01.273359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:01.273359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:01.273359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:01.273359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:01.274279 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:34:01.274279 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:34:01.274279 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:01.274279 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:01.280704 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 444/869] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:01.282276 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7332d4-f319-4a33-aa7b-20a387579fa9 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:01.379911 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7332d4-f319-4a33-aa7b-20a387579fa9 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:01.414234 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfa9ca-3ef8-4395-b7d9-fa6f7a2f311c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:01.414938 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfa9ca-3ef8-4395-b7d9-fa6f7a2f311c None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:01.415254 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfa9ca-3ef8-4395-b7d9-fa6f7a2f311c None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:01.415533 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfa9ca-3ef8-4395-b7d9-fa6f7a2f311c None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:01.416363 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfa9ca-3ef8-4395-b7d9-fa6f7a2f311c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:01.416674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfa9ca-3ef8-4395-b7d9-fa6f7a2f311c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:01.418046 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfa9ca-3ef8-4395-b7d9-fa6f7a2f311c None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:01.429820 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 426/870] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:01.435693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe39b2-1c32-43c0-a2aa-416ca5e68180 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:01.542293 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe39b2-1c32-43c0-a2aa-416ca5e68180 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:01.589036 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9024d-8860-4a07-a772-1fcb328c275b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:01.590261 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9024d-8860-4a07-a772-1fcb328c275b None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:01.590772 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9024d-8860-4a07-a772-1fcb328c275b None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:01.591295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9024d-8860-4a07-a772-1fcb328c275b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:01.599664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9024d-8860-4a07-a772-1fcb328c275b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:01.601522 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9024d-8860-4a07-a772-1fcb328c275b None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:01.617587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-68b9024d-8860-4a07-a772-1fcb328c275b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:34:01.617587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:01.617587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:01.617587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:01.617587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:01.617587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:01.617587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:01.617587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:01.617587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:01.617587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:01.617587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:01.617587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:01.617587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:34:01.617587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:34:01.617587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:34:01.619361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:34:01.619361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:01.619361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:01.619361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:01.619361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:01.619361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:01.619361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:01.619361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:01.619361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:01.619361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:01.619361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:01.619361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:01.619361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:01.619361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:01.619361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:01.619361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:01.619361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:01.620349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:34:01.620349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:34:01.620349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:34:01.620349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:34:01.620349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:34:01.620349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:34:01.620349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:34:01.620349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:01.627136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 445/871] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:34:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:01.628566 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfa9ca-3ef8-4395-b7d9-fa6f7a2f311c None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:01.733178 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfa9ca-3ef8-4395-b7d9-fa6f7a2f311c None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:01.766750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5a77d-64f2-4ff6-b94f-af8753d7700f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:01.767451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5a77d-64f2-4ff6-b94f-af8753d7700f None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:01.767735 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5a77d-64f2-4ff6-b94f-af8753d7700f None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:01.768012 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5a77d-64f2-4ff6-b94f-af8753d7700f None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:01.768798 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5a77d-64f2-4ff6-b94f-af8753d7700f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:01.768894 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa4038-b5cc-4297-8f19-6821da90aebd None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:01.769107 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa4038-b5cc-4297-8f19-6821da90aebd None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:01.769206 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5a77d-64f2-4ff6-b94f-af8753d7700f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:01.769453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa4038-b5cc-4297-8f19-6821da90aebd None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:01.770536 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5a77d-64f2-4ff6-b94f-af8753d7700f None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:01.770884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 446/872] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:01.776319 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71695c-b04d-492d-a239-f25b2ab8a065 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:01.776850 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71695c-b04d-492d-a239-f25b2ab8a065 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:01.777343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71695c-b04d-492d-a239-f25b2ab8a065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:01.787090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 427/873] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:34:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:01.789874 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5a77d-64f2-4ff6-b94f-af8753d7700f None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:01.802192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-bb71695c-b04d-492d-a239-f25b2ab8a065 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:01.803968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-bb71695c-b04d-492d-a239-f25b2ab8a065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:01.892516 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5a77d-64f2-4ff6-b94f-af8753d7700f None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:01.898626 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 447/874] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:01 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:34:01.916171 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71695c-b04d-492d-a239-f25b2ab8a065 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:01.936746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e245d-5a9b-4695-a959-2cc3fed78a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:01.938022 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e245d-5a9b-4695-a959-2cc3fed78a75 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:01.938521 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e245d-5a9b-4695-a959-2cc3fed78a75 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:01.939183 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e245d-5a9b-4695-a959-2cc3fed78a75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:01.940797 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e245d-5a9b-4695-a959-2cc3fed78a75 None admin] RBAC: Adding query filter params (role.id=c1ee07ef1a1f4986afc3af5a357e2c4c, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=82b2e79995f94ab880f5d798ddd649b1) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:01.941340 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e245d-5a9b-4695-a959-2cc3fed78a75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:01.943532 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e245d-5a9b-4695-a959-2cc3fed78a75 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:01.955318 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 428/875] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:34:01 2022] GET /identity/v3/role_assignments?user.id=82b2e79995f94ab880f5d798ddd649b1&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=c1ee07ef1a1f4986afc3af5a357e2c4c => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:02.023550 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71695c-b04d-492d-a239-f25b2ab8a065 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:02.061876 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a4aaa-5e29-475c-9361-75e36a8e5a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:02.063061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a4aaa-5e29-475c-9361-75e36a8e5a03 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:02.063565 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a4aaa-5e29-475c-9361-75e36a8e5a03 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:02.064055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a4aaa-5e29-475c-9361-75e36a8e5a03 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:02.064944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a4aaa-5e29-475c-9361-75e36a8e5a03 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:02.066556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a4aaa-5e29-475c-9361-75e36a8e5a03 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:02.079995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-054a4aaa-5e29-475c-9361-75e36a8e5a03 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:34:02.079995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:02.079995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:34:02.079995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:34:02.079995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:34:02.079995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:34:02.079995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:34:02.079995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:02.079995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:34:02.079995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:02.079995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:34:02.079995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:02.079995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:02.079995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:02.079995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:02.079995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:02.079995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:02.081229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:02.081229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:02.081229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:02.081229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:02.081229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:02.081229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:02.081229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:34:02.081229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:34:02.081229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:34:02.081229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:34:02.081229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:02.081229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:02.081229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:02.081229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:02.081229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:02.081229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:02.082068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:02.082068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:02.082068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:02.082068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:02.082068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:02.082068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:02.082068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:02.082068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:02.082068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:02.082068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:02.082068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:34:02.082068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:02.082068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:34:02.082068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:02.085148 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 448/876] 10.222.0.11 () {56 vars in 1126 bytes} [Wed May 4 21:34:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:34:02.091112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e245d-5a9b-4695-a959-2cc3fed78a75 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:02.197532 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e245d-5a9b-4695-a959-2cc3fed78a75 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:02.234184 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d00c4-4f9f-4247-a3a9-1a5cbb33b94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:02.235148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d00c4-4f9f-4247-a3a9-1a5cbb33b94c None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:02.235613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d00c4-4f9f-4247-a3a9-1a5cbb33b94c None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:02.236027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d00c4-4f9f-4247-a3a9-1a5cbb33b94c None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:02.236882 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d00c4-4f9f-4247-a3a9-1a5cbb33b94c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:02.237348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d00c4-4f9f-4247-a3a9-1a5cbb33b94c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:02.238855 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d00c4-4f9f-4247-a3a9-1a5cbb33b94c None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:02.244029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 429/877] 10.222.0.11 () {56 vars in 1122 bytes} [Wed May 4 21:34:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:02.250173 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a4aaa-5e29-475c-9361-75e36a8e5a03 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:02.354926 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a4aaa-5e29-475c-9361-75e36a8e5a03 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:02.388349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e59d92-c96f-4b87-a3e8-1834f2c06cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:02.389022 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e59d92-c96f-4b87-a3e8-1834f2c06cbd None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:02.389303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e59d92-c96f-4b87-a3e8-1834f2c06cbd None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:02.389578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e59d92-c96f-4b87-a3e8-1834f2c06cbd None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:02.390289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e59d92-c96f-4b87-a3e8-1834f2c06cbd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:02.390598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e59d92-c96f-4b87-a3e8-1834f2c06cbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:02.392004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e59d92-c96f-4b87-a3e8-1834f2c06cbd None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:02.396936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 449/878] 10.222.0.11 () {56 vars in 1122 bytes} [Wed May 4 21:34:02 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:02.490439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cc61c-ea8f-4038-8521-04094ed80b69 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:02.490994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cc61c-ea8f-4038-8521-04094ed80b69 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:02.490994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cc61c-ea8f-4038-8521-04094ed80b69 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:02.492776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 430/879] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:02.498672 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e68de-3dce-4bc6-aba9-0e3efa518a59 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:02.498985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e68de-3dce-4bc6-aba9-0e3efa518a59 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:02.499261 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e68de-3dce-4bc6-aba9-0e3efa518a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:02.517173 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-0d9e68de-3dce-4bc6-aba9-0e3efa518a59 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:02.518371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-0d9e68de-3dce-4bc6-aba9-0e3efa518a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:02.590235 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 450/880] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:02 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:02.614800 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cc61c-ea8f-4038-8521-04094ed80b69 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:02.716138 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cc61c-ea8f-4038-8521-04094ed80b69 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:02.750245 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34ca2e-bf4a-4293-8342-828ba098b7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:02.750922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34ca2e-bf4a-4293-8342-828ba098b7fc None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:02.751237 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34ca2e-bf4a-4293-8342-828ba098b7fc None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:02.751514 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34ca2e-bf4a-4293-8342-828ba098b7fc None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:02.752245 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34ca2e-bf4a-4293-8342-828ba098b7fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:02.753615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34ca2e-bf4a-4293-8342-828ba098b7fc None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:02.771303 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 431/881] 10.222.0.11 () {60 vars in 1141 bytes} [Wed May 4 21:34:02 2022] POST /identity/v3/services => generated 269 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:34:03.042785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48429-d5c3-4f15-823b-16e5344c7575 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:03.043213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48429-d5c3-4f15-823b-16e5344c7575 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:03.043403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48429-d5c3-4f15-823b-16e5344c7575 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:03.045058 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 451/882] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:03.050234 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13878674-d857-45f5-957e-c970d72ef8f9 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:03.050531 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13878674-d857-45f5-957e-c970d72ef8f9 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:03.050813 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13878674-d857-45f5-957e-c970d72ef8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:03.068105 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-13878674-d857-45f5-957e-c970d72ef8f9 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:03.069299 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-13878674-d857-45f5-957e-c970d72ef8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:03.147174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 432/883] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:03.167739 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de48429-d5c3-4f15-823b-16e5344c7575 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:03.274978 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de48429-d5c3-4f15-823b-16e5344c7575 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:03.308267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fc82d-0686-450b-b1c1-3c8d4b41b5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:03.309038 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fc82d-0686-450b-b1c1-3c8d4b41b5fa None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:03.309316 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fc82d-0686-450b-b1c1-3c8d4b41b5fa None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:03.309634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fc82d-0686-450b-b1c1-3c8d4b41b5fa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:03.310292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fc82d-0686-450b-b1c1-3c8d4b41b5fa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:03.311690 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fc82d-0686-450b-b1c1-3c8d4b41b5fa None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:03.323403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-e69fc82d-0686-450b-b1c1-3c8d4b41b5fa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 21:34:03.323403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:03.323403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:34:03.323403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:34:03.323403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:34:03.323403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:34:03.323403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:34:03.323403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:03.323403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 21:34:03.323403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:03.323403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:34:03.323403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:03.323403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:03.323403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:03.323403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:03.323403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:03.323403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:03.325641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:03.325641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:03.325641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:03.325641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:03.325641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:03.325641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:03.325641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:34:03.325641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:34:03.325641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:34:03.325641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:34:03.325641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:03.325641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:03.325641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:03.325641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:03.325641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:03.325641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:03.327306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:03.327306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:03.327306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:03.327306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:03.327306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:03.327306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:03.327306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:03.327306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:03.327306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:03.327306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:03.327306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:34:03.327306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:03.327306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 21:34:03.327306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:03.327306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 452/884] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:34:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:03.330680 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13878674-d857-45f5-957e-c970d72ef8f9 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:03.428352 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13878674-d857-45f5-957e-c970d72ef8f9 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:03.461837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb226a-5043-4acf-adee-7100782e599b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:03.463063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb226a-5043-4acf-adee-7100782e599b None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:03.463358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb226a-5043-4acf-adee-7100782e599b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:03.463640 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb226a-5043-4acf-adee-7100782e599b None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:03.464365 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb226a-5043-4acf-adee-7100782e599b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:03.464680 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb226a-5043-4acf-adee-7100782e599b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:03.466069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb226a-5043-4acf-adee-7100782e599b None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:03.475781 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 433/885] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:34:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:03.481949 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fc82d-0686-450b-b1c1-3c8d4b41b5fa None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:03.594443 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fc82d-0686-450b-b1c1-3c8d4b41b5fa None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:03.627847 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced6817-682d-429b-86cb-f99b6d662636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:03.628518 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced6817-682d-429b-86cb-f99b6d662636 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:03.628798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced6817-682d-429b-86cb-f99b6d662636 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:03.629074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced6817-682d-429b-86cb-f99b6d662636 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:03.629779 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced6817-682d-429b-86cb-f99b6d662636 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:03.630084 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced6817-682d-429b-86cb-f99b6d662636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:03.631479 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced6817-682d-429b-86cb-f99b6d662636 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:03.636905 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 453/886] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:34:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:03.642510 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb226a-5043-4acf-adee-7100782e599b None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:03.741736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb226a-5043-4acf-adee-7100782e599b None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:03.775191 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba72d7d-ac01-4fec-85aa-4bc49fcac19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:03.775859 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba72d7d-ac01-4fec-85aa-4bc49fcac19c None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:03.776145 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba72d7d-ac01-4fec-85aa-4bc49fcac19c None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:03.776400 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba72d7d-ac01-4fec-85aa-4bc49fcac19c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:03.777193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba72d7d-ac01-4fec-85aa-4bc49fcac19c None admin] RBAC: Adding query filter params (interface=public, service_id=b502e402e1c649b69cb9cf56c06e0cb9, region_id=RegionOne) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:03.777504 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba72d7d-ac01-4fec-85aa-4bc49fcac19c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:03.778875 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba72d7d-ac01-4fec-85aa-4bc49fcac19c None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:03.786595 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 434/887] 10.222.0.11 () {56 vars in 1251 bytes} [Wed May 4 21:34:03 2022] GET /identity/v3/endpoints?service_id=b502e402e1c649b69cb9cf56c06e0cb9&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:03.792533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced6817-682d-429b-86cb-f99b6d662636 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:03.892901 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced6817-682d-429b-86cb-f99b6d662636 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:03.927667 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d739fa0-2c3d-4d46-bb41-3bca17494f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:03.928339 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d739fa0-2c3d-4d46-bb41-3bca17494f5b None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:03.928623 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d739fa0-2c3d-4d46-bb41-3bca17494f5b None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:03.928901 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d739fa0-2c3d-4d46-bb41-3bca17494f5b None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:03.929588 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d739fa0-2c3d-4d46-bb41-3bca17494f5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:03.931681 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d739fa0-2c3d-4d46-bb41-3bca17494f5b None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:03.943189 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 454/888] 10.222.0.11 () {56 vars in 1087 bytes} [Wed May 4 21:34:03 2022] GET /identity/v3/services => generated 1268 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:34:04.437624 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a64d8-ade6-44f3-80f1-77d8594b1c4d None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:04.438003 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a64d8-ade6-44f3-80f1-77d8594b1c4d None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:04.438197 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a64d8-ade6-44f3-80f1-77d8594b1c4d None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:04.439824 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 435/889] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:04.448414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273fb29-662d-4eb0-aaf0-de3fcb493de2 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:04.449273 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273fb29-662d-4eb0-aaf0-de3fcb493de2 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:04.449776 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273fb29-662d-4eb0-aaf0-de3fcb493de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:04.466547 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-4273fb29-662d-4eb0-aaf0-de3fcb493de2 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:04.468110 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-4273fb29-662d-4eb0-aaf0-de3fcb493de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:04.542635 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 455/890] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:34:04.566049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a64d8-ade6-44f3-80f1-77d8594b1c4d None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:04.678327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a64d8-ade6-44f3-80f1-77d8594b1c4d None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:04.704636 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327179de-8a7c-465b-bdbe-42dedbb550e9 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:04.704917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327179de-8a7c-465b-bdbe-42dedbb550e9 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:04.705106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327179de-8a7c-465b-bdbe-42dedbb550e9 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:04.706835 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 456/891] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:04.711603 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c95af-8aab-4fe0-899c-caec6952667e None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:04.712210 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c95af-8aab-4fe0-899c-caec6952667e None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:04.712663 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c95af-8aab-4fe0-899c-caec6952667e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:04.714722 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d0131-f91c-468f-9d1e-cd59e88066e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:04.715834 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d0131-f91c-468f-9d1e-cd59e88066e5 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:04.716387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d0131-f91c-468f-9d1e-cd59e88066e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:04.716847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d0131-f91c-468f-9d1e-cd59e88066e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:04.729382 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d0131-f91c-468f-9d1e-cd59e88066e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:34:04.730171 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-4c5c95af-8aab-4fe0-899c-caec6952667e None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:04.731497 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-4c5c95af-8aab-4fe0-899c-caec6952667e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:04.738025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-556d0131-f91c-468f-9d1e-cd59e88066e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:34:04.738025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:04.738025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:04.738025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:04.738025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:04.738025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:04.738025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:04.738025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:04.738025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:04.738025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:04.738025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:04.738025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:04.738025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:34:04.738025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:34:04.738025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:34:04.738025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:34:04.738993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:34:04.738993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:34:04.738993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:34:04.738993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:34:04.738993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:04.738993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:04.738993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:04.738993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:04.738993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:04.738993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:04.738993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:04.738993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:04.738993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:04.738993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:04.738993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:04.738993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:04.739878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:04.739878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:04.739878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:04.739878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:04.739878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:34:04.739878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:34:04.739878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:34:04.739878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:34:04.739878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:34:04.739878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:34:04.739878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:34:04.739878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:04.742191 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 436/892] 10.222.0.11 () {56 vars in 1120 bytes} [Wed May 4 21:34:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:04.748188 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d0131-f91c-468f-9d1e-cd59e88066e5 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:04.805046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 457/893] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:34:04.821736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c95af-8aab-4fe0-899c-caec6952667e None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:04.846304 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d0131-f91c-468f-9d1e-cd59e88066e5 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:04.881324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5fa4e-c676-4c28-9cde-81deb82aa09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:04.882277 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5fa4e-c676-4c28-9cde-81deb82aa09e None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:04.882707 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5fa4e-c676-4c28-9cde-81deb82aa09e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:04.883145 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5fa4e-c676-4c28-9cde-81deb82aa09e None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:04.884237 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5fa4e-c676-4c28-9cde-81deb82aa09e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:04.884691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5fa4e-c676-4c28-9cde-81deb82aa09e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:04.886196 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5fa4e-c676-4c28-9cde-81deb82aa09e None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:04.899074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 437/894] 10.222.0.11 () {56 vars in 1115 bytes} [Wed May 4 21:34:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:04.900183 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5fa4e-c676-4c28-9cde-81deb82aa09e None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:04.921117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c95af-8aab-4fe0-899c-caec6952667e None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:04.962125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d3ac9-abaf-4d76-b6ed-128ea29a3394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:04.962835 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d3ac9-abaf-4d76-b6ed-128ea29a3394 None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:04.963163 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d3ac9-abaf-4d76-b6ed-128ea29a3394 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:04.963440 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d3ac9-abaf-4d76-b6ed-128ea29a3394 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:04.964186 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d3ac9-abaf-4d76-b6ed-128ea29a3394 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:04.965585 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d3ac9-abaf-4d76-b6ed-128ea29a3394 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:04.987135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 458/895] 10.222.0.11 () {60 vars in 1141 bytes} [Wed May 4 21:34:04 2022] POST /identity/v3/services => generated 241 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:34:05.019189 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5fa4e-c676-4c28-9cde-81deb82aa09e None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:05.061743 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa2967-8af4-4759-857c-1f2b8a8ac4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:05.062967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa2967-8af4-4759-857c-1f2b8a8ac4e1 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:05.063477 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa2967-8af4-4759-857c-1f2b8a8ac4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:05.063962 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa2967-8af4-4759-857c-1f2b8a8ac4e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:05.076573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa2967-8af4-4759-857c-1f2b8a8ac4e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:05.078592 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa2967-8af4-4759-857c-1f2b8a8ac4e1 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:05.097587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-56fa2967-8af4-4759-857c-1f2b8a8ac4e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:05.097587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:05.097587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:05.097587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:05.097587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:05.097587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:05.097587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:05.097587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:05.097587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:05.097587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:05.097587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:05.097587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:05.097587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:34:05.097587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:34:05.097587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:34:05.098927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:34:05.098927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:05.098927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:05.098927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:05.098927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:05.098927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:05.098927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:05.098927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:05.098927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:05.098927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:05.098927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:05.098927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:05.098927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:05.098927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:05.098927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:05.098927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:05.098927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:05.099831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:34:05.099831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:34:05.099831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:05.099831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:05.101902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 438/896] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:05.109173 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d3ac9-abaf-4d76-b6ed-128ea29a3394 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:05.132919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985fbd1-476a-4611-b479-785c2e2f8a44 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:05.133577 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985fbd1-476a-4611-b479-785c2e2f8a44 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:05.134067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985fbd1-476a-4611-b479-785c2e2f8a44 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:05.135978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 439/897] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:05.144062 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1307d2-f0cb-4b03-bf49-73efa793a067 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:05.144710 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1307d2-f0cb-4b03-bf49-73efa793a067 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:05.145360 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1307d2-f0cb-4b03-bf49-73efa793a067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:05.168165 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-8f1307d2-f0cb-4b03-bf49-73efa793a067 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:05.170053 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-8f1307d2-f0cb-4b03-bf49-73efa793a067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:05.224527 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d3ac9-abaf-4d76-b6ed-128ea29a3394 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:05.247639 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 440/898] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:05.263846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c7adf-6e40-44bc-aff8-4206035c37b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:05.264514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c7adf-6e40-44bc-aff8-4206035c37b0 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:05.264792 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c7adf-6e40-44bc-aff8-4206035c37b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:05.265063 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c7adf-6e40-44bc-aff8-4206035c37b0 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:05.265781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c7adf-6e40-44bc-aff8-4206035c37b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:05.266083 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c7adf-6e40-44bc-aff8-4206035c37b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:05.267504 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c7adf-6e40-44bc-aff8-4206035c37b0 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:05.271391 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1307d2-f0cb-4b03-bf49-73efa793a067 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:05.281571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 459/899] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:05.287520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c7adf-6e40-44bc-aff8-4206035c37b0 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:05.384265 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c7adf-6e40-44bc-aff8-4206035c37b0 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:05.394674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1307d2-f0cb-4b03-bf49-73efa793a067 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:05.417894 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710d6b0-d6ef-4d00-bad8-4344a6e0f617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:05.419133 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710d6b0-d6ef-4d00-bad8-4344a6e0f617 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:05.419609 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710d6b0-d6ef-4d00-bad8-4344a6e0f617 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:05.420070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710d6b0-d6ef-4d00-bad8-4344a6e0f617 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:05.428998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710d6b0-d6ef-4d00-bad8-4344a6e0f617 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:05.430843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710d6b0-d6ef-4d00-bad8-4344a6e0f617 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:05.433913 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453ed2e-be17-4813-b1b9-198c1f59c769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:05.434974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453ed2e-be17-4813-b1b9-198c1f59c769 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:05.435506 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453ed2e-be17-4813-b1b9-198c1f59c769 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:05.436051 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453ed2e-be17-4813-b1b9-198c1f59c769 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:05.436901 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453ed2e-be17-4813-b1b9-198c1f59c769 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:05.438456 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453ed2e-be17-4813-b1b9-198c1f59c769 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:05.447841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-f710d6b0-d6ef-4d00-bad8-4344a6e0f617 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:34:05.447841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:05.447841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:05.447841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:05.447841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:05.447841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:05.447841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:05.447841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:05.447841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:05.447841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:05.447841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:05.447841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:05.447841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:34:05.447841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:34:05.447841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:34:05.447841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:34:05.449249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:05.449249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:05.449249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:34:05.449249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:34:05.449249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:34:05.449249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:34:05.449249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:05.449249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:05.449249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:05.449249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:05.449249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:05.449249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:05.449249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:05.449249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:05.449249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:05.449249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:05.449249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:05.449249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:05.450309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:05.450309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:05.450309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:34:05.450309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:34:05.450309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:34:05.450309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:34:05.450309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:34:05.450309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:34:05.450309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:34:05.450309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:05.450309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 460/900] 10.222.0.11 () {56 vars in 1117 bytes} [Wed May 4 21:34:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:34:05.454648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-3453ed2e-be17-4813-b1b9-198c1f59c769 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 21:34:05.454648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:05.454648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:34:05.454648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:34:05.454648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:34:05.454648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:34:05.454648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:34:05.454648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:05.454648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 21:34:05.454648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:05.454648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:34:05.454648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:05.454648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:05.454648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:05.454648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:05.454648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:05.455790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:05.455790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:05.455790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:05.455790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:05.455790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:05.455790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:05.455790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:05.455790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:34:05.455790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:34:05.455790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:34:05.455790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:34:05.455790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:05.455790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:05.455790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:05.455790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:05.455790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:05.456809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:05.456809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:05.456809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:05.456809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:05.456809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:05.456809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:05.456809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:05.456809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:05.456809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:05.456809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:05.456809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:05.456809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:34:05.456809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:05.456809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 21:34:05.456809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:05.457783 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710d6b0-d6ef-4d00-bad8-4344a6e0f617 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:05.459669 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 441/901] 10.222.0.11 () {56 vars in 1132 bytes} [Wed May 4 21:34:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:34:05.467541 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453ed2e-be17-4813-b1b9-198c1f59c769 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:05.559997 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710d6b0-d6ef-4d00-bad8-4344a6e0f617 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:05.567617 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453ed2e-be17-4813-b1b9-198c1f59c769 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:05.594632 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd975e-fdbe-47c3-85e5-0c34af742234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:05.595650 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd975e-fdbe-47c3-85e5-0c34af742234 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:05.596103 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd975e-fdbe-47c3-85e5-0c34af742234 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:05.596583 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd975e-fdbe-47c3-85e5-0c34af742234 None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:05.597631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd975e-fdbe-47c3-85e5-0c34af742234 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:05.598131 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd975e-fdbe-47c3-85e5-0c34af742234 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:05.600301 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd975e-fdbe-47c3-85e5-0c34af742234 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:05.603927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc4d59-a4fb-49c7-894d-fcd4650983c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:05.603927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc4d59-a4fb-49c7-894d-fcd4650983c0 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:05.604304 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc4d59-a4fb-49c7-894d-fcd4650983c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:05.604661 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc4d59-a4fb-49c7-894d-fcd4650983c0 None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:05.605442 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc4d59-a4fb-49c7-894d-fcd4650983c0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:05.605822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc4d59-a4fb-49c7-894d-fcd4650983c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:05.607313 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc4d59-a4fb-49c7-894d-fcd4650983c0 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:05.612482 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 442/902] 10.222.0.11 () {56 vars in 1126 bytes} [Wed May 4 21:34:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:05.617980 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc4d59-a4fb-49c7-894d-fcd4650983c0 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:05.621663 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 461/903] 10.222.0.11 () {56 vars in 1149 bytes} [Wed May 4 21:34:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:05.627325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd975e-fdbe-47c3-85e5-0c34af742234 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:05.721732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd975e-fdbe-47c3-85e5-0c34af742234 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:05.738944 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc4d59-a4fb-49c7-894d-fcd4650983c0 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:05.767862 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e067f-1e90-41e6-8533-c3a5ba4a9c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:05.769050 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e067f-1e90-41e6-8533-c3a5ba4a9c53 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:05.769565 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e067f-1e90-41e6-8533-c3a5ba4a9c53 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:05.770292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e067f-1e90-41e6-8533-c3a5ba4a9c53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:05.785273 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b619d-d6cd-42b7-978a-e1c904fa42e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:05.785962 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b619d-d6cd-42b7-978a-e1c904fa42e5 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:05.786245 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b619d-d6cd-42b7-978a-e1c904fa42e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:05.786519 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b619d-d6cd-42b7-978a-e1c904fa42e5 None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:05.787425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b619d-d6cd-42b7-978a-e1c904fa42e5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:05.787740 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b619d-d6cd-42b7-978a-e1c904fa42e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:05.789810 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b619d-d6cd-42b7-978a-e1c904fa42e5 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:05.795403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 443/904] 10.222.0.11 () {56 vars in 1126 bytes} [Wed May 4 21:34:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:05.801124 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b619d-d6cd-42b7-978a-e1c904fa42e5 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:05.859918 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e067f-1e90-41e6-8533-c3a5ba4a9c53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:05.862329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e067f-1e90-41e6-8533-c3a5ba4a9c53 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:05.917636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b619d-d6cd-42b7-978a-e1c904fa42e5 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:05.963465 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a22110-6df1-43a8-94ef-97e35b408acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:05.964675 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a22110-6df1-43a8-94ef-97e35b408acc None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:05.965120 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a22110-6df1-43a8-94ef-97e35b408acc None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:05.965539 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a22110-6df1-43a8-94ef-97e35b408acc None admin] PATH_INFO: `/v3/endpoints` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:05.966488 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a22110-6df1-43a8-94ef-97e35b408acc None admin] RBAC: Adding query filter params (interface=public, service_id=e52d9396c512478cb22ad6e3bb735991, region_id=RegionOne) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:05.966946 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a22110-6df1-43a8-94ef-97e35b408acc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:05.968545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a22110-6df1-43a8-94ef-97e35b408acc None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:05.971389 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 462/905] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:34:05 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:34:05.972273 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e067f-1e90-41e6-8533-c3a5ba4a9c53 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:05.975926 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 444/906] 10.222.0.11 () {56 vars in 1251 bytes} [Wed May 4 21:34:05 2022] GET /identity/v3/endpoints?service_id=e52d9396c512478cb22ad6e3bb735991&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:05.980322 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a22110-6df1-43a8-94ef-97e35b408acc None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:06.089439 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e067f-1e90-41e6-8533-c3a5ba4a9c53 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:06.090521 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a22110-6df1-43a8-94ef-97e35b408acc None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:06.133611 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bab383-d0e8-482b-aba8-c63aba13404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:06.134459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c010f4-d1f3-43a0-bf52-2bc014e54b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:06.135089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c010f4-d1f3-43a0-bf52-2bc014e54b62 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:06.135375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c010f4-d1f3-43a0-bf52-2bc014e54b62 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:06.135648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c010f4-d1f3-43a0-bf52-2bc014e54b62 None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:06.135963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bab383-d0e8-482b-aba8-c63aba13404a None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:06.136339 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c010f4-d1f3-43a0-bf52-2bc014e54b62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:06.136544 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bab383-d0e8-482b-aba8-c63aba13404a None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:06.136964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bab383-d0e8-482b-aba8-c63aba13404a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:06.137819 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c010f4-d1f3-43a0-bf52-2bc014e54b62 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:06.149282 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bab383-d0e8-482b-aba8-c63aba13404a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:06.151534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 445/907] 10.222.0.11 () {56 vars in 1087 bytes} [Wed May 4 21:34:05 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:34:06.151988 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bab383-d0e8-482b-aba8-c63aba13404a None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:06.172590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-82bab383-d0e8-482b-aba8-c63aba13404a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:06.172590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:06.172590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:06.172590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:06.172590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:06.172590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:06.172590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:06.172590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:06.172590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:06.172590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:06.172590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:06.172590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:06.172590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:34:06.172590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:34:06.172590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:34:06.173754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:34:06.173754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:06.173754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:06.173754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:06.173754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:06.173754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:06.173754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:06.173754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:06.173754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:06.173754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:06.173754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:06.173754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:06.173754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:06.173754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:06.173754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:06.173754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:06.173754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:06.174729 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:34:06.174729 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:34:06.174729 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:06.174729 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:06.176430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 463/908] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:06.185151 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c010f4-d1f3-43a0-bf52-2bc014e54b62 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:06.298372 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c010f4-d1f3-43a0-bf52-2bc014e54b62 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:06.301638 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a556ec6-a3f1-428a-af2a-c7223b05e176 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:06.301995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a556ec6-a3f1-428a-af2a-c7223b05e176 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:06.302279 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a556ec6-a3f1-428a-af2a-c7223b05e176 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:06.305442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 464/909] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:34:06.312303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34ebe5-359c-46a4-bf9f-3b7e5eb02319 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:06.312619 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34ebe5-359c-46a4-bf9f-3b7e5eb02319 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:06.312866 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34ebe5-359c-46a4-bf9f-3b7e5eb02319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:06.337267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-9f34ebe5-359c-46a4-bf9f-3b7e5eb02319 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:06.339402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-9f34ebe5-359c-46a4-bf9f-3b7e5eb02319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:06.343367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e59ec2-2efe-4341-99a7-95759c5a6c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:06.348669 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e59ec2-2efe-4341-99a7-95759c5a6c86 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:06.348969 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e59ec2-2efe-4341-99a7-95759c5a6c86 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:06.349256 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e59ec2-2efe-4341-99a7-95759c5a6c86 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:06.350002 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e59ec2-2efe-4341-99a7-95759c5a6c86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:06.350317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e59ec2-2efe-4341-99a7-95759c5a6c86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:06.352135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e59ec2-2efe-4341-99a7-95759c5a6c86 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:06.368958 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 446/910] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:06.375432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e59ec2-2efe-4341-99a7-95759c5a6c86 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:06.416266 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 465/911] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:06.439856 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34ebe5-359c-46a4-bf9f-3b7e5eb02319 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:06.481254 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e59ec2-2efe-4341-99a7-95759c5a6c86 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:06.515157 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e76e59-3de4-492b-a85b-aa16fe6cf81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:06.516256 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e76e59-3de4-492b-a85b-aa16fe6cf81d None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:06.516698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e76e59-3de4-492b-a85b-aa16fe6cf81d None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:06.517107 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e76e59-3de4-492b-a85b-aa16fe6cf81d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:06.525314 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e76e59-3de4-492b-a85b-aa16fe6cf81d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:06.526987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e76e59-3de4-492b-a85b-aa16fe6cf81d None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:06.541395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-71e76e59-3de4-492b-a85b-aa16fe6cf81d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:34:06.541395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:06.541395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:06.541395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:06.541395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:06.541395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:06.541395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:06.541395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:06.541395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:06.541395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:06.541395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:06.541395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:06.541395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:34:06.541395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:34:06.541395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:34:06.542467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:34:06.542467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:06.542467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:06.542467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:06.542467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:06.542467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:06.542467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:06.542467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:06.542467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:06.542467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:06.542467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:06.542467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:06.542467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:06.542467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:06.542467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:06.542467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:06.542467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:06.543608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:34:06.543608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:34:06.543608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:34:06.543608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:34:06.543608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:34:06.543608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:34:06.543608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:34:06.543608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:06.544038 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34ebe5-359c-46a4-bf9f-3b7e5eb02319 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:06.546078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 447/912] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:34:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:34:06.554113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e76e59-3de4-492b-a85b-aa16fe6cf81d None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:06.582077 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce66b7-708b-4d90-9fa9-517b00319f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:06.583401 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce66b7-708b-4d90-9fa9-517b00319f64 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:06.583876 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce66b7-708b-4d90-9fa9-517b00319f64 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:06.584270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce66b7-708b-4d90-9fa9-517b00319f64 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:06.585153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce66b7-708b-4d90-9fa9-517b00319f64 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:06.587492 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce66b7-708b-4d90-9fa9-517b00319f64 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:06.602798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-1dce66b7-708b-4d90-9fa9-517b00319f64 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 21:34:06.602798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:06.602798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:34:06.602798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:34:06.602798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:34:06.602798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:34:06.602798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:34:06.602798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:06.602798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 21:34:06.602798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:06.602798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:34:06.602798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:06.602798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:06.602798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:06.602798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:06.602798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:06.602798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:06.603855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:06.603855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:06.603855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:06.603855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:06.603855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:06.603855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:06.603855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:34:06.603855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:34:06.603855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:34:06.603855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:34:06.603855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:06.603855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:06.603855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:06.603855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:06.603855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:06.603855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:06.604689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:06.604689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:06.604689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:06.604689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:06.604689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:06.604689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:06.604689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:06.604689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:06.604689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:06.604689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:06.604689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:34:06.604689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:06.604689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 21:34:06.604689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:06.604689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 466/913] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:34:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:34:06.610576 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce66b7-708b-4d90-9fa9-517b00319f64 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:06.662674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e76e59-3de4-492b-a85b-aa16fe6cf81d None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:06.696171 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6be629-3137-4d8f-a5d5-7a8f90781691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:06.696786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6be629-3137-4d8f-a5d5-7a8f90781691 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:06.697067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6be629-3137-4d8f-a5d5-7a8f90781691 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:06.697356 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6be629-3137-4d8f-a5d5-7a8f90781691 None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:06.698108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6be629-3137-4d8f-a5d5-7a8f90781691 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:06.698409 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6be629-3137-4d8f-a5d5-7a8f90781691 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:06.699865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6be629-3137-4d8f-a5d5-7a8f90781691 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:06.711904 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 448/914] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:34:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:06.720192 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6be629-3137-4d8f-a5d5-7a8f90781691 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:06.733979 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce66b7-708b-4d90-9fa9-517b00319f64 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:06.766983 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94f819-d5cb-4549-a060-54466ae1761e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:06.767882 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94f819-d5cb-4549-a060-54466ae1761e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:06.768275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94f819-d5cb-4549-a060-54466ae1761e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:06.768639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94f819-d5cb-4549-a060-54466ae1761e None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:06.769436 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94f819-d5cb-4549-a060-54466ae1761e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:06.769864 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94f819-d5cb-4549-a060-54466ae1761e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:06.771356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94f819-d5cb-4549-a060-54466ae1761e None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:06.776667 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 467/915] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:34:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:06.783852 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94f819-d5cb-4549-a060-54466ae1761e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:06.819990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6be629-3137-4d8f-a5d5-7a8f90781691 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:06.856975 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c051aa-dc70-4bf3-9b48-750bd6f04928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:06.858080 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c051aa-dc70-4bf3-9b48-750bd6f04928 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:06.858566 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c051aa-dc70-4bf3-9b48-750bd6f04928 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:06.859130 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c051aa-dc70-4bf3-9b48-750bd6f04928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:06.860159 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c051aa-dc70-4bf3-9b48-750bd6f04928 None admin] RBAC: Adding query filter params (role.id=5a587c5dea3b4b7fbcaf94adf45c8b31, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=82b2e79995f94ab880f5d798ddd649b1) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:06.860674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c051aa-dc70-4bf3-9b48-750bd6f04928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:06.862298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c051aa-dc70-4bf3-9b48-750bd6f04928 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:06.869318 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 449/916] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:34:06 2022] GET /identity/v3/role_assignments?user.id=82b2e79995f94ab880f5d798ddd649b1&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=5a587c5dea3b4b7fbcaf94adf45c8b31 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:06.887561 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94f819-d5cb-4549-a060-54466ae1761e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:06.924839 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ff586-e9fa-49fe-bf55-b1e9e9d95a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:06.925569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff586-e9fa-49fe-bf55-b1e9e9d95a7e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:06.925858 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff586-e9fa-49fe-bf55-b1e9e9d95a7e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:06.926132 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff586-e9fa-49fe-bf55-b1e9e9d95a7e None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:06.926904 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ff586-e9fa-49fe-bf55-b1e9e9d95a7e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:06.927242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ff586-e9fa-49fe-bf55-b1e9e9d95a7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:06.928648 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ff586-e9fa-49fe-bf55-b1e9e9d95a7e None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:06.934873 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 468/917] 10.222.0.11 () {56 vars in 1114 bytes} [Wed May 4 21:34:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:06.940996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c051aa-dc70-4bf3-9b48-750bd6f04928 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:07.051526 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c051aa-dc70-4bf3-9b48-750bd6f04928 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:07.087647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef88497-95d8-4b8d-ab50-65d2fdabb40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:07.088361 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef88497-95d8-4b8d-ab50-65d2fdabb40a None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:07.088641 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef88497-95d8-4b8d-ab50-65d2fdabb40a None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:07.088915 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef88497-95d8-4b8d-ab50-65d2fdabb40a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:07.089663 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef88497-95d8-4b8d-ab50-65d2fdabb40a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:07.091014 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef88497-95d8-4b8d-ab50-65d2fdabb40a None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:07.112072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 450/918] 10.222.0.11 () {60 vars in 1144 bytes} [Wed May 4 21:34:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:34:07.427251 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a7d2a-e8cc-4787-93fc-42ae3091c942 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:07.427627 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a7d2a-e8cc-4787-93fc-42ae3091c942 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:07.427836 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a7d2a-e8cc-4787-93fc-42ae3091c942 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:07.429489 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 469/919] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:07.434770 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eebdf-0b1b-4143-bf06-1a273140570d None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:07.435077 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eebdf-0b1b-4143-bf06-1a273140570d None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:07.435357 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eebdf-0b1b-4143-bf06-1a273140570d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:07.451925 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-811eebdf-0b1b-4143-bf06-1a273140570d None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:07.453099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-811eebdf-0b1b-4143-bf06-1a273140570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:07.521664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 451/920] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:07.544345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a7d2a-e8cc-4787-93fc-42ae3091c942 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:07.658690 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a7d2a-e8cc-4787-93fc-42ae3091c942 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:07.692531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6f0c8-642e-496b-a191-47442f92573a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:07.693261 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6f0c8-642e-496b-a191-47442f92573a None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:07.693583 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6f0c8-642e-496b-a191-47442f92573a None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:07.693856 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6f0c8-642e-496b-a191-47442f92573a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:07.694500 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6f0c8-642e-496b-a191-47442f92573a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:07.696021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6f0c8-642e-496b-a191-47442f92573a None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:07.708203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-d7f6f0c8-642e-496b-a191-47442f92573a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:34:07.708203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:07.708203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:34:07.708203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:34:07.708203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:34:07.708203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:34:07.708203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:34:07.708203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:07.708203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:34:07.708203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:07.708203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:34:07.708203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:07.708203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:07.708203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:07.708203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:07.708203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:07.708203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:07.710502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:07.710502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:07.710502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:07.710502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:07.710502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:07.710502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:07.710502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:34:07.710502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:34:07.710502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:34:07.710502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:34:07.710502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:07.710502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:07.710502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:07.710502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:07.710502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:07.710502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:07.713283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:07.713283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:07.713283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:07.713283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:07.713283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:07.713283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:07.713283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:07.713283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:07.713283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:07.713283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:07.713283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:34:07.713283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:07.713283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:34:07.713283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:07.713283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 470/921] 10.222.0.11 () {56 vars in 1126 bytes} [Wed May 4 21:34:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:07.718546 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811eebdf-0b1b-4143-bf06-1a273140570d None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:07.815132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811eebdf-0b1b-4143-bf06-1a273140570d None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:07.853817 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97d505-134d-4f6e-bd50-0b901f33e5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:07.854562 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97d505-134d-4f6e-bd50-0b901f33e5b8 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:07.854841 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97d505-134d-4f6e-bd50-0b901f33e5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:07.855141 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97d505-134d-4f6e-bd50-0b901f33e5b8 None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:07.855854 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97d505-134d-4f6e-bd50-0b901f33e5b8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:07.856158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97d505-134d-4f6e-bd50-0b901f33e5b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:07.857536 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97d505-134d-4f6e-bd50-0b901f33e5b8 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:07.862808 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 452/922] 10.222.0.11 () {56 vars in 1122 bytes} [Wed May 4 21:34:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:07.868654 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6f0c8-642e-496b-a191-47442f92573a None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:07.967888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6f0c8-642e-496b-a191-47442f92573a None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:08.003537 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3875b8-5af1-4291-91cf-45e1fc54088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:08.004640 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3875b8-5af1-4291-91cf-45e1fc54088f None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:08.005123 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3875b8-5af1-4291-91cf-45e1fc54088f None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:08.005587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3875b8-5af1-4291-91cf-45e1fc54088f None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:08.006500 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3875b8-5af1-4291-91cf-45e1fc54088f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:08.007018 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3875b8-5af1-4291-91cf-45e1fc54088f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:08.008747 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3875b8-5af1-4291-91cf-45e1fc54088f None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:08.014903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 471/923] 10.222.0.11 () {56 vars in 1122 bytes} [Wed May 4 21:34:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:08.021144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97d505-134d-4f6e-bd50-0b901f33e5b8 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:08.123195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97d505-134d-4f6e-bd50-0b901f33e5b8 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:08.156390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edc1fa-9df2-4768-a3fc-c58240d36a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:08.157066 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edc1fa-9df2-4768-a3fc-c58240d36a4b None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:08.163067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edc1fa-9df2-4768-a3fc-c58240d36a4b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:08.163067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edc1fa-9df2-4768-a3fc-c58240d36a4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:08.163067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edc1fa-9df2-4768-a3fc-c58240d36a4b None admin] RBAC: Adding query filter params (interface=public, service_id=6441952653494094a383bbcc8e9711b5, region_id=RegionOne) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:08.163067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edc1fa-9df2-4768-a3fc-c58240d36a4b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:08.163067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edc1fa-9df2-4768-a3fc-c58240d36a4b None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:08.166744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 453/924] 10.222.0.11 () {56 vars in 1251 bytes} [Wed May 4 21:34:08 2022] GET /identity/v3/endpoints?service_id=6441952653494094a383bbcc8e9711b5&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:08.172245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3875b8-5af1-4291-91cf-45e1fc54088f None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:08.269976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3875b8-5af1-4291-91cf-45e1fc54088f None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:08.302878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b3e48-0b92-422c-8d2a-278636b87a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:08.303940 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b3e48-0b92-422c-8d2a-278636b87a70 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:08.304453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b3e48-0b92-422c-8d2a-278636b87a70 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:08.304934 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b3e48-0b92-422c-8d2a-278636b87a70 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:08.305874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b3e48-0b92-422c-8d2a-278636b87a70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:08.307653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b3e48-0b92-422c-8d2a-278636b87a70 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:08.314550 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 472/925] 10.222.0.11 () {56 vars in 1087 bytes} [Wed May 4 21:34:08 2022] GET /identity/v3/services => generated 1497 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:34:08.555678 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec6a9c-d182-498e-8a22-02f7ea1395ad None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:08.555854 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec6a9c-d182-498e-8a22-02f7ea1395ad None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:08.556133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec6a9c-d182-498e-8a22-02f7ea1395ad None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:08.557756 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 454/926] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:08.563002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d830d-ca25-42a8-8039-b12197326a76 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:08.563486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d830d-ca25-42a8-8039-b12197326a76 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:08.563720 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d830d-ca25-42a8-8039-b12197326a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:08.587062 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-f93d830d-ca25-42a8-8039-b12197326a76 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:08.588427 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-f93d830d-ca25-42a8-8039-b12197326a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:08.654248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 473/927] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:08.677142 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec6a9c-d182-498e-8a22-02f7ea1395ad None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:08.779302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec6a9c-d182-498e-8a22-02f7ea1395ad None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:08.813388 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b289639-88e9-4d26-b5c8-afdee5efb603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:08.814570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b289639-88e9-4d26-b5c8-afdee5efb603 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:08.815072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b289639-88e9-4d26-b5c8-afdee5efb603 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:08.815542 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b289639-88e9-4d26-b5c8-afdee5efb603 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:08.816379 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b289639-88e9-4d26-b5c8-afdee5efb603 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:08.817952 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b289639-88e9-4d26-b5c8-afdee5efb603 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:08.834415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-1b289639-88e9-4d26-b5c8-afdee5efb603 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 21:34:08.834415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:08.834415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:34:08.834415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:34:08.834415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:34:08.834415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:34:08.834415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:34:08.834415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:08.834415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 21:34:08.834415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:08.834415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:34:08.834415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:08.834415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:08.834415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:08.834415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:08.834415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:08.835425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:08.835425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:08.835425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:08.835425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:08.835425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:08.835425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:08.835425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:08.835425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:34:08.835425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:34:08.835425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:34:08.835425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:34:08.835425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:08.835425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:08.835425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:08.835425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:08.835425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:08.836272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:08.836272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:08.836272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:08.836272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:08.836272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:08.836272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:08.836272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:08.836272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:08.836272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:08.836272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:08.836272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:08.836272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:34:08.836272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:08.836272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 21:34:08.836272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:08.839950 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 455/928] 10.222.0.11 () {56 vars in 1132 bytes} [Wed May 4 21:34:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:08.846111 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d830d-ca25-42a8-8039-b12197326a76 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:08.945231 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d830d-ca25-42a8-8039-b12197326a76 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:08.981923 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd5010-6743-480a-b076-071b3934dd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:08.982602 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd5010-6743-480a-b076-071b3934dd72 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:08.982882 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd5010-6743-480a-b076-071b3934dd72 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:08.983182 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd5010-6743-480a-b076-071b3934dd72 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:08.983895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd5010-6743-480a-b076-071b3934dd72 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:08.984200 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd5010-6743-480a-b076-071b3934dd72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:08.985570 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd5010-6743-480a-b076-071b3934dd72 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:08.990722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 474/929] 10.222.0.11 () {56 vars in 1126 bytes} [Wed May 4 21:34:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:08.996645 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b289639-88e9-4d26-b5c8-afdee5efb603 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:09.097143 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b289639-88e9-4d26-b5c8-afdee5efb603 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:09.128675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76531791-3e4d-4946-be7d-edd3fecf361e None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:09.129019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76531791-3e4d-4946-be7d-edd3fecf361e None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:09.129335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76531791-3e4d-4946-be7d-edd3fecf361e None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:09.130928 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 475/930] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:34:09.131030 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5617a-357d-4017-ae00-59595233409b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:09.131722 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5617a-357d-4017-ae00-59595233409b None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:09.132003 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5617a-357d-4017-ae00-59595233409b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:09.135061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5617a-357d-4017-ae00-59595233409b None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:09.135061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5617a-357d-4017-ae00-59595233409b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:09.135061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5617a-357d-4017-ae00-59595233409b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:09.135061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5617a-357d-4017-ae00-59595233409b None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:09.140282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 456/931] 10.222.0.11 () {56 vars in 1126 bytes} [Wed May 4 21:34:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:09.140720 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9466f-35b9-4165-abe8-5f2db0956f16 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:09.141221 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9466f-35b9-4165-abe8-5f2db0956f16 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:09.141691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9466f-35b9-4165-abe8-5f2db0956f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:09.145604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5617a-357d-4017-ae00-59595233409b None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:09.159649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-bfe9466f-35b9-4165-abe8-5f2db0956f16 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:09.160597 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-bfe9466f-35b9-4165-abe8-5f2db0956f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:09.235389 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 476/932] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:09.252527 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9466f-35b9-4165-abe8-5f2db0956f16 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:09.253931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5617a-357d-4017-ae00-59595233409b None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:09.290125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb0b46-8e3f-469d-9ab5-d36fb18af57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:09.291242 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb0b46-8e3f-469d-9ab5-d36fb18af57b None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:09.291723 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb0b46-8e3f-469d-9ab5-d36fb18af57b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:09.292251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb0b46-8e3f-469d-9ab5-d36fb18af57b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:09.293415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb0b46-8e3f-469d-9ab5-d36fb18af57b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:09.295003 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb0b46-8e3f-469d-9ab5-d36fb18af57b None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:09.320617 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 457/933] 10.222.0.11 () {60 vars in 1144 bytes} [Wed May 4 21:34:09 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:34:09.379815 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9466f-35b9-4165-abe8-5f2db0956f16 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:09.426252 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b525b-87ac-4f0d-b289-e04914701136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:09.427602 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b525b-87ac-4f0d-b289-e04914701136 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:09.428216 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b525b-87ac-4f0d-b289-e04914701136 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:09.428758 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b525b-87ac-4f0d-b289-e04914701136 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:09.441532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b525b-87ac-4f0d-b289-e04914701136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:34:09.450976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-3e4b525b-87ac-4f0d-b289-e04914701136 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:34:09.450976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:09.450976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:09.450976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:09.450976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:09.450976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:09.450976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:09.450976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:09.450976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:09.450976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:09.450976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:09.450976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:09.450976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:34:09.450976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:34:09.450976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:34:09.450976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:34:09.452053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:34:09.452053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:34:09.452053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:34:09.452053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:34:09.452053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:09.452053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:09.452053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:09.452053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:09.452053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:09.452053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:09.452053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:09.452053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:09.452053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:09.452053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:09.452053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:09.452053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:09.452884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:09.452884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:09.452884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:09.452884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:09.452884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:34:09.452884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:34:09.452884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:34:09.452884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:34:09.452884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:34:09.452884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:34:09.452884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:34:09.452884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:09.455938 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 477/934] 10.222.0.11 () {56 vars in 1120 bytes} [Wed May 4 21:34:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:34:09.462564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb0b46-8e3f-469d-9ab5-d36fb18af57b None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:09.515081 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44f816-bee6-4af2-a4d3-0d5f90f48451 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:09.515409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44f816-bee6-4af2-a4d3-0d5f90f48451 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:09.515576 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44f816-bee6-4af2-a4d3-0d5f90f48451 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:09.519762 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 478/935] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:09.524108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f757e-bcde-4750-a3dd-de73970989fe None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:09.524405 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f757e-bcde-4750-a3dd-de73970989fe None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:09.524689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f757e-bcde-4750-a3dd-de73970989fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:09.543226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-ac5f757e-bcde-4750-a3dd-de73970989fe None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:09.544401 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ac5f757e-bcde-4750-a3dd-de73970989fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:09.585257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb0b46-8e3f-469d-9ab5-d36fb18af57b None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:09.617834 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 479/936] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:34:09.625057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319cbc8-e87f-4850-b6c0-1e75cae16ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:09.625735 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319cbc8-e87f-4850-b6c0-1e75cae16ef5 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:09.626027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319cbc8-e87f-4850-b6c0-1e75cae16ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:09.626304 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319cbc8-e87f-4850-b6c0-1e75cae16ef5 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:09.627064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319cbc8-e87f-4850-b6c0-1e75cae16ef5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:09.627389 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319cbc8-e87f-4850-b6c0-1e75cae16ef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:09.628930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319cbc8-e87f-4850-b6c0-1e75cae16ef5 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:09.637553 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 458/937] 10.222.0.11 () {56 vars in 1115 bytes} [Wed May 4 21:34:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:09.638738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f757e-bcde-4750-a3dd-de73970989fe None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:09.643783 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319cbc8-e87f-4850-b6c0-1e75cae16ef5 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:09.741065 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f757e-bcde-4750-a3dd-de73970989fe None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:09.770501 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319cbc8-e87f-4850-b6c0-1e75cae16ef5 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:09.775930 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e86bfe-daa9-4443-8629-10c53b4869e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:09.776782 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e86bfe-daa9-4443-8629-10c53b4869e0 None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:09.777166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e86bfe-daa9-4443-8629-10c53b4869e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:09.777604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e86bfe-daa9-4443-8629-10c53b4869e0 None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:09.778429 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e86bfe-daa9-4443-8629-10c53b4869e0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:09.779997 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e86bfe-daa9-4443-8629-10c53b4869e0 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:09.781475 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: WARNING keystone.server.flask.common [None req-d4e86bfe-daa9-4443-8629-10c53b4869e0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 04 21:34:09.800498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.sql.core [None req-d4e86bfe-daa9-4443-8629-10c53b4869e0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 21:34:09.800498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 21:34:09.800498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [parameters: {'id': '1aa88831d8d74f8d84299a3153e693da', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 21:34:09.800498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86613) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 21:34:09.809067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc48a9-c230-4797-9488-f151429119da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:09.810053 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc48a9-c230-4797-9488-f151429119da None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:09.810456 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc48a9-c230-4797-9488-f151429119da None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:09.810854 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc48a9-c230-4797-9488-f151429119da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:09.820903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-d4e86bfe-daa9-4443-8629-10c53b4869e0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1aa88831d8d74f8d84299a3153e693da.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1aa88831d8d74f8d84299a3153e693da. May 04 21:34:09.820903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:09.820903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 21:34:09.820903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 21:34:09.820903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 21:34:09.820903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 21:34:09.820903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 21:34:09.820903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application result = self._query(query) May 04 21:34:09.820903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 21:34:09.820903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application conn.query(q) May 04 21:34:09.820903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 21:34:09.820903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 21:34:09.820903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 21:34:09.822563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application result.read() May 04 21:34:09.822563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 21:34:09.822563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 21:34:09.822563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 21:34:09.822563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 21:34:09.822563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 21:34:09.822563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 21:34:09.822563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 21:34:09.822563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 21:34:09.822563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 21:34:09.822563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:09.822563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 21:34:09.822563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:09.822563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:09.822563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 21:34:09.822563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 21:34:09.822563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 04 21:34:09.822563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return project_ref.to_dict() May 04 21:34:09.824769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 21:34:09.824769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application next(self.gen) May 04 21:34:09.824769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 21:34:09.824769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application yield resource May 04 21:34:09.824769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 21:34:09.824769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application next(self.gen) May 04 21:34:09.824769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 21:34:09.824769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self.session.rollback() May 04 21:34:09.824769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 21:34:09.824769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self.force_reraise() May 04 21:34:09.824769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 21:34:09.824769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise self.value May 04 21:34:09.824769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 21:34:09.824769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 21:34:09.824769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 21:34:09.824769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application session.commit() May 04 21:34:09.824769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 21:34:09.826716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 21:34:09.826716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 21:34:09.826716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._prepare_impl() May 04 21:34:09.826716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 21:34:09.826716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self.session.flush() May 04 21:34:09.826716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 21:34:09.826716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._flush(objects) May 04 21:34:09.826716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 21:34:09.826716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 21:34:09.826716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 21:34:09.826716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application compat.raise_( May 04 21:34:09.826716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 21:34:09.826716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception May 04 21:34:09.826716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 21:34:09.826716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application flush_context.execute() May 04 21:34:09.826716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 21:34:09.826716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rec.execute(self) May 04 21:34:09.828356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 21:34:09.828356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 21:34:09.828356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 21:34:09.828356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 21:34:09.828356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 21:34:09.828356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 21:34:09.828356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 21:34:09.828356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 21:34:09.828356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 21:34:09.828356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 21:34:09.828356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 21:34:09.828356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 21:34:09.828356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 21:34:09.828356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 21:34:09.828356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 21:34:09.840759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 21:34:09.840759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 21:34:09.840759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception May 04 21:34:09.840759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 21:34:09.840759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 21:34:09.840759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 21:34:09.840759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 21:34:09.840759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 21:34:09.840759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application result = self._query(query) May 04 21:34:09.840759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 21:34:09.840759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application conn.query(q) May 04 21:34:09.840759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 21:34:09.840759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 21:34:09.840759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 21:34:09.840759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application result.read() May 04 21:34:09.840759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 21:34:09.840759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 21:34:09.842348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 21:34:09.842348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 21:34:09.842348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 21:34:09.842348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 21:34:09.842348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 21:34:09.842348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 21:34:09.842348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 21:34:09.842348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 21:34:09.842348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [parameters: {'id': '1aa88831d8d74f8d84299a3153e693da', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 21:34:09.842348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 21:34:09.842348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:09.842348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:34:09.842348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:09.842348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:09.842348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 04 21:34:09.843996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 04 21:34:09.843996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 21:34:09.843996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 21:34:09.843996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 04 21:34:09.843996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:09.843996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:34:09.843996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:09.843996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:09.843996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:09.843996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:09.843996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:09.843996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:09.843996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:09.843996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:09.843996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:09.843996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:09.843996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:09.845634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:09.845634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 04 21:34:09.845634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 04 21:34:09.845634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:09.845634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:09.845634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 04 21:34:09.845634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.Conflict( May 04 21:34:09.845634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1aa88831d8d74f8d84299a3153e693da. May 04 21:34:09.845634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:09.846597 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc48a9-c230-4797-9488-f151429119da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:09.846597 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc48a9-c230-4797-9488-f151429119da None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:09.846847 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 480/938] 10.222.0.11 () {60 vars in 1140 bytes} [Wed May 4 21:34:09 2022] POST /identity/v3/projects => generated 262 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:09.846847 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e86bfe-daa9-4443-8629-10c53b4869e0 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:09.847112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-8afc48a9-c230-4797-9488-f151429119da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:09.847112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:09.847112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:09.847112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:09.847112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:09.847112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:09.847112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:09.847112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:09.847112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:09.847112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:09.847112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:09.847112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:09.847112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:34:09.847112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:34:09.847112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:34:09.848818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:34:09.848818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:09.848818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:09.848818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:09.848818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:09.848818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:09.848818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:09.848818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:09.848818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:09.848818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:09.848818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:09.848818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:09.848818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:09.848818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:09.848818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:09.848818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:09.848818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:09.850072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:34:09.850072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:34:09.850072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:09.850072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:09.850072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 459/939] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:09.856701 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc48a9-c230-4797-9488-f151429119da None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:09.943728 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e86bfe-daa9-4443-8629-10c53b4869e0 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:09.964468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc48a9-c230-4797-9488-f151429119da None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:09.977905 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39dc87-8bb7-42da-850f-324fc9731738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:09.978926 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39dc87-8bb7-42da-850f-324fc9731738 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:09.979376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39dc87-8bb7-42da-850f-324fc9731738 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:09.979807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39dc87-8bb7-42da-850f-324fc9731738 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:09.986560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39dc87-8bb7-42da-850f-324fc9731738 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:09.988376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39dc87-8bb7-42da-850f-324fc9731738 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:10.001408 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd14d4-fd66-4b0c-8acf-5bb0c90a3696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:10.002077 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd14d4-fd66-4b0c-8acf-5bb0c90a3696 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:10.002360 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd14d4-fd66-4b0c-8acf-5bb0c90a3696 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:10.002636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd14d4-fd66-4b0c-8acf-5bb0c90a3696 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:10.003389 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd14d4-fd66-4b0c-8acf-5bb0c90a3696 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:10.003694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd14d4-fd66-4b0c-8acf-5bb0c90a3696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:10.004008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-ec39dc87-8bb7-42da-850f-324fc9731738 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:34:10.004008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:10.004008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:10.004008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:10.004008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:10.004008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:10.004008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:10.004008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:10.004008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:10.004008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:10.004008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:10.004008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:10.004008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:34:10.004008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:34:10.004008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:34:10.005057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:34:10.005057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:10.005057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:10.005057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:10.005057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:10.005057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:10.005057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:10.005057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:10.005057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:10.005057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:10.005057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:10.005057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:10.005057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:10.005057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:10.005057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:10.005057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:10.005057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:10.006164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:34:10.006164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:34:10.006164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:34:10.006164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:34:10.006164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:34:10.006164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:34:10.006164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:34:10.006164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:10.006578 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd14d4-fd66-4b0c-8acf-5bb0c90a3696 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:10.008247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 481/940] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:34:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:10.019221 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39dc87-8bb7-42da-850f-324fc9731738 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:10.019400 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 460/941] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:10.024639 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd14d4-fd66-4b0c-8acf-5bb0c90a3696 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:10.120422 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39dc87-8bb7-42da-850f-324fc9731738 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:10.141248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd14d4-fd66-4b0c-8acf-5bb0c90a3696 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:10.154400 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd627a62-e9c0-4beb-abf3-82f338e8ded2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:10.155149 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd627a62-e9c0-4beb-abf3-82f338e8ded2 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:10.155434 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd627a62-e9c0-4beb-abf3-82f338e8ded2 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:10.155766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd627a62-e9c0-4beb-abf3-82f338e8ded2 None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:10.156517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd627a62-e9c0-4beb-abf3-82f338e8ded2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:10.156895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd627a62-e9c0-4beb-abf3-82f338e8ded2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:10.158386 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd627a62-e9c0-4beb-abf3-82f338e8ded2 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:10.177593 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7073b-b276-48dc-9071-a9fd3c59853b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:10.178713 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7073b-b276-48dc-9071-a9fd3c59853b None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:10.179313 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7073b-b276-48dc-9071-a9fd3c59853b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:10.179764 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7073b-b276-48dc-9071-a9fd3c59853b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:10.186486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 482/942] 10.222.0.11 () {56 vars in 1112 bytes} [Wed May 4 21:34:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:10.188406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7073b-b276-48dc-9071-a9fd3c59853b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:10.190086 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7073b-b276-48dc-9071-a9fd3c59853b None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:10.207629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-d3c7073b-b276-48dc-9071-a9fd3c59853b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:34:10.207629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:10.207629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:10.207629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:10.207629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:10.207629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:10.207629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:10.207629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:10.207629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:10.207629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:10.207629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:10.207629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:10.207629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:34:10.207629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:34:10.207629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:34:10.207629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:34:10.208667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:10.208667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:10.208667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:34:10.208667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:34:10.208667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:34:10.208667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:34:10.208667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:10.208667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:10.208667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:10.208667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:10.208667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:10.208667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:10.208667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:10.208667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:10.208667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:10.208667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:10.208667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:10.208667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:10.209613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:10.209613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:10.209613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:34:10.209613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:34:10.209613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:34:10.209613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:34:10.209613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:34:10.209613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:34:10.209613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:34:10.209613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:10.212819 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 461/943] 10.222.0.11 () {56 vars in 1117 bytes} [Wed May 4 21:34:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:10.220509 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd627a62-e9c0-4beb-abf3-82f338e8ded2 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:10.328730 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd627a62-e9c0-4beb-abf3-82f338e8ded2 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:10.365685 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6eba7-9f9e-4859-ba89-e55fab4bb9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:10.366373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6eba7-9f9e-4859-ba89-e55fab4bb9a2 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:10.366659 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6eba7-9f9e-4859-ba89-e55fab4bb9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:10.366937 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6eba7-9f9e-4859-ba89-e55fab4bb9a2 None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:10.367983 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6eba7-9f9e-4859-ba89-e55fab4bb9a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:10.368377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6eba7-9f9e-4859-ba89-e55fab4bb9a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:10.370435 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6eba7-9f9e-4859-ba89-e55fab4bb9a2 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:10.392688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 483/944] 10.222.0.11 () {56 vars in 1149 bytes} [Wed May 4 21:34:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:10.394160 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7073b-b276-48dc-9071-a9fd3c59853b None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:10.500644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7073b-b276-48dc-9071-a9fd3c59853b None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:10.537659 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340eb17c-854f-4ff4-a507-dbcac4f51d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:10.538454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340eb17c-854f-4ff4-a507-dbcac4f51d03 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:10.538734 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340eb17c-854f-4ff4-a507-dbcac4f51d03 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:10.539006 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340eb17c-854f-4ff4-a507-dbcac4f51d03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:10.549495 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340eb17c-854f-4ff4-a507-dbcac4f51d03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:10.550989 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340eb17c-854f-4ff4-a507-dbcac4f51d03 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:10.568435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-340eb17c-854f-4ff4-a507-dbcac4f51d03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:10.568435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:10.568435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:10.568435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:10.568435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:10.568435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:10.568435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:10.568435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:10.568435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:10.568435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:10.568435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:10.568435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:10.568435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:34:10.568435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:34:10.568435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:34:10.569349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:34:10.569349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:10.569349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:10.569349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:10.569349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:10.569349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:10.569349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:10.569349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:10.569349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:10.569349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:10.569349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:10.569349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:10.569349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:10.569349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:10.569349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:10.569349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:10.569349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:10.570395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:34:10.570395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:34:10.570395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:10.570395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:10.570395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 462/945] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:10.577308 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6eba7-9f9e-4859-ba89-e55fab4bb9a2 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:10.675524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6eba7-9f9e-4859-ba89-e55fab4bb9a2 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:10.690583 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde095f-677b-4cbc-9ff6-774fef964c72 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:10.690903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde095f-677b-4cbc-9ff6-774fef964c72 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:10.691177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde095f-677b-4cbc-9ff6-774fef964c72 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:10.693040 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 463/946] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:34:10.697894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6148f-b47d-4a8f-b703-bbea54d15de8 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:10.698182 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6148f-b47d-4a8f-b703-bbea54d15de8 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:10.698458 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6148f-b47d-4a8f-b703-bbea54d15de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:10.714955 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d05e7-464a-4f9c-bea3-2839d5955d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:10.715999 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d05e7-464a-4f9c-bea3-2839d5955d17 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:10.716496 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d05e7-464a-4f9c-bea3-2839d5955d17 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:10.716964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d05e7-464a-4f9c-bea3-2839d5955d17 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:10.717694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-32f6148f-b47d-4a8f-b703-bbea54d15de8 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:10.718113 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d05e7-464a-4f9c-bea3-2839d5955d17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:10.718616 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d05e7-464a-4f9c-bea3-2839d5955d17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:10.718876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-32f6148f-b47d-4a8f-b703-bbea54d15de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:10.720388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d05e7-464a-4f9c-bea3-2839d5955d17 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:10.739158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 484/947] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:10.740656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d05e7-464a-4f9c-bea3-2839d5955d17 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:10.805282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 464/948] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:10.827077 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6148f-b47d-4a8f-b703-bbea54d15de8 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:10.855197 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d05e7-464a-4f9c-bea3-2839d5955d17 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:10.895491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbbd92-2740-4193-9de1-7dbb7458ee8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:10.896816 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbbd92-2740-4193-9de1-7dbb7458ee8a None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:10.897784 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbbd92-2740-4193-9de1-7dbb7458ee8a None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:10.898264 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbbd92-2740-4193-9de1-7dbb7458ee8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:10.906749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbbd92-2740-4193-9de1-7dbb7458ee8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:10.908513 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbbd92-2740-4193-9de1-7dbb7458ee8a None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:10.926415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-3ecbbd92-2740-4193-9de1-7dbb7458ee8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:34:10.926415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:10.926415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:10.926415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:10.926415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:10.926415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:10.926415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:10.926415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:10.926415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:10.926415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:10.926415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:10.926415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:10.926415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:34:10.926415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:34:10.926415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:34:10.927384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:34:10.927384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:10.927384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:10.927384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:10.927384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:10.927384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:10.927384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:10.927384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:10.927384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:10.927384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:10.927384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:10.927384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:10.927384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:10.927384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:10.927384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:10.927384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:10.927384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:10.928295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:34:10.928295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:34:10.928295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:34:10.928295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:34:10.928295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:34:10.928295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:34:10.928295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:34:10.928295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:10.931381 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 485/949] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:34:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:34:10.936782 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbbd92-2740-4193-9de1-7dbb7458ee8a None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:10.945495 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6148f-b47d-4a8f-b703-bbea54d15de8 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:10.980197 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9137979-89ca-4f23-a633-15dc7bbb320d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:10.981411 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9137979-89ca-4f23-a633-15dc7bbb320d None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:10.981922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9137979-89ca-4f23-a633-15dc7bbb320d None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:10.982401 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9137979-89ca-4f23-a633-15dc7bbb320d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:10.983297 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9137979-89ca-4f23-a633-15dc7bbb320d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:10.984940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9137979-89ca-4f23-a633-15dc7bbb320d None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:10.997741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-a9137979-89ca-4f23-a633-15dc7bbb320d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:34:10.997741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:10.997741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:34:10.997741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:34:10.997741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:34:10.997741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:34:10.997741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:34:10.997741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:10.997741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:34:10.997741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:10.997741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:34:10.997741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:10.997741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:10.997741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:10.997741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:10.997741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:10.997741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:10.998804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:10.998804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:10.998804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:10.998804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:10.998804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:10.998804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:10.998804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:34:10.998804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:34:10.998804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:34:10.998804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:34:10.998804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:10.998804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:10.998804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:10.998804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:10.998804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:10.998804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:10.999694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:10.999694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:10.999694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:10.999694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:10.999694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:10.999694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:10.999694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:10.999694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:10.999694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:10.999694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:10.999694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:34:10.999694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:10.999694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:34:10.999694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:11.002628 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 465/950] 10.222.0.11 () {56 vars in 1126 bytes} [Wed May 4 21:34:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:34:11.009046 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9137979-89ca-4f23-a633-15dc7bbb320d None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:11.051985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbbd92-2740-4193-9de1-7dbb7458ee8a None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:11.096434 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf0713-e427-4031-8db8-ea1d7f3b2da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:11.097468 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf0713-e427-4031-8db8-ea1d7f3b2da5 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:11.098623 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf0713-e427-4031-8db8-ea1d7f3b2da5 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:11.099140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf0713-e427-4031-8db8-ea1d7f3b2da5 None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:11.100594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf0713-e427-4031-8db8-ea1d7f3b2da5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:11.101182 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf0713-e427-4031-8db8-ea1d7f3b2da5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:11.103394 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf0713-e427-4031-8db8-ea1d7f3b2da5 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:11.119215 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 486/951] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:34:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:11.124088 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9137979-89ca-4f23-a633-15dc7bbb320d None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:11.125175 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf0713-e427-4031-8db8-ea1d7f3b2da5 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:11.165613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c89983-438c-4769-8af2-a62ddc1ce9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:11.166597 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c89983-438c-4769-8af2-a62ddc1ce9a1 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:11.167342 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c89983-438c-4769-8af2-a62ddc1ce9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:11.167528 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c89983-438c-4769-8af2-a62ddc1ce9a1 None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:11.168197 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c89983-438c-4769-8af2-a62ddc1ce9a1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:11.168508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c89983-438c-4769-8af2-a62ddc1ce9a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:11.171126 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c89983-438c-4769-8af2-a62ddc1ce9a1 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:11.180834 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 466/952] 10.222.0.11 () {56 vars in 1122 bytes} [Wed May 4 21:34:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:11.181885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c89983-438c-4769-8af2-a62ddc1ce9a1 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:11.234366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf0713-e427-4031-8db8-ea1d7f3b2da5 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:11.269926 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da5208-333e-42c4-b7b2-47332d2114cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:11.270932 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da5208-333e-42c4-b7b2-47332d2114cb None admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:11.271180 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da5208-333e-42c4-b7b2-47332d2114cb None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:11.271460 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da5208-333e-42c4-b7b2-47332d2114cb None admin] PATH_INFO: `/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/82b2e79995f94ab880f5d798ddd649b1/roles/5a587c5dea3b4b7fbcaf94adf45c8b31` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:11.273827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da5208-333e-42c4-b7b2-47332d2114cb None admin] RBAC: Authorizing `identity:create_grant(project_id=3acb142d1aa34e18a018d3fdee8d7038, user_id=82b2e79995f94ab880f5d798ddd649b1, role_id=5a587c5dea3b4b7fbcaf94adf45c8b31)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:11.276107 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da5208-333e-42c4-b7b2-47332d2114cb None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:11.299361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 487/953] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:34:11 2022] PUT /identity/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/82b2e79995f94ab880f5d798ddd649b1/roles/5a587c5dea3b4b7fbcaf94adf45c8b31 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:34:11.312974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c89983-438c-4769-8af2-a62ddc1ce9a1 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:11.351504 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a1b09-d539-44a5-b05e-aceb34e0d50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:11.352672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a1b09-d539-44a5-b05e-aceb34e0d50b None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:11.353203 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a1b09-d539-44a5-b05e-aceb34e0d50b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:11.353709 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a1b09-d539-44a5-b05e-aceb34e0d50b None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:11.354639 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a1b09-d539-44a5-b05e-aceb34e0d50b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:11.355196 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a1b09-d539-44a5-b05e-aceb34e0d50b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:11.356881 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a1b09-d539-44a5-b05e-aceb34e0d50b None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:11.363201 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 467/954] 10.222.0.11 () {56 vars in 1122 bytes} [Wed May 4 21:34:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:11.369683 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da5208-333e-42c4-b7b2-47332d2114cb None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:11.480458 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da5208-333e-42c4-b7b2-47332d2114cb None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:11.516120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724462eb-2dbf-45d4-87d6-7a38dd9ca634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:11.517162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724462eb-2dbf-45d4-87d6-7a38dd9ca634 None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:11.517666 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724462eb-2dbf-45d4-87d6-7a38dd9ca634 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:11.518137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724462eb-2dbf-45d4-87d6-7a38dd9ca634 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:11.519124 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724462eb-2dbf-45d4-87d6-7a38dd9ca634 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:11.520738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724462eb-2dbf-45d4-87d6-7a38dd9ca634 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:11.545214 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 488/955] 10.222.0.11 () {60 vars in 1144 bytes} [Wed May 4 21:34:11 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:34:11.654243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be39e4f-5654-4a12-9382-974d79ffaa3f None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:11.654421 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be39e4f-5654-4a12-9382-974d79ffaa3f None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:11.654765 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be39e4f-5654-4a12-9382-974d79ffaa3f None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:11.656496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 468/956] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:11.662298 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244ed5-219b-4cc0-875c-678ac3d81b52 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:11.662591 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244ed5-219b-4cc0-875c-678ac3d81b52 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:11.662922 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244ed5-219b-4cc0-875c-678ac3d81b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:11.681630 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-a1244ed5-219b-4cc0-875c-678ac3d81b52 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:11.683221 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a1244ed5-219b-4cc0-875c-678ac3d81b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:11.766190 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 489/957] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:11.788406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be39e4f-5654-4a12-9382-974d79ffaa3f None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:11.888990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be39e4f-5654-4a12-9382-974d79ffaa3f None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:11.921596 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbec1b-5836-46b3-876b-53b721e7b9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:11.922407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbec1b-5836-46b3-876b-53b721e7b9bb None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:11.922689 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbec1b-5836-46b3-876b-53b721e7b9bb None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:11.922966 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbec1b-5836-46b3-876b-53b721e7b9bb None admin] PATH_INFO: `/v3/services/compute` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:11.923661 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbec1b-5836-46b3-876b-53b721e7b9bb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:11.925024 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbec1b-5836-46b3-876b-53b721e7b9bb None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:11.937321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-8dbbec1b-5836-46b3-876b-53b721e7b9bb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 21:34:11.937321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:11.937321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:34:11.937321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:34:11.937321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:34:11.937321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:34:11.937321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:34:11.937321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:11.937321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 21:34:11.937321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:11.937321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:34:11.937321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:11.937321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:11.937321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:11.937321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:11.937321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:11.937321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:11.938337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:11.938337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:11.938337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:11.938337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:11.938337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:11.938337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:11.938337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:34:11.938337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:34:11.938337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:34:11.938337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:34:11.938337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:11.938337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:11.938337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:11.938337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:11.938337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:11.938337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:11.939213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:11.939213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:11.939213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:11.939213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:11.939213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:11.939213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:11.939213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:11.939213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:11.939213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:11.939213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:11.939213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:34:11.939213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:11.939213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 21:34:11.939213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:11.939213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 469/958] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:34:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:11.944832 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1244ed5-219b-4cc0-875c-678ac3d81b52 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:12.041355 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1244ed5-219b-4cc0-875c-678ac3d81b52 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:12.073998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76a0ef-5867-4a50-8d1a-e8d48c6841a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:12.074733 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76a0ef-5867-4a50-8d1a-e8d48c6841a0 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:12.075001 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76a0ef-5867-4a50-8d1a-e8d48c6841a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:12.075311 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76a0ef-5867-4a50-8d1a-e8d48c6841a0 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:12.076018 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76a0ef-5867-4a50-8d1a-e8d48c6841a0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:12.076332 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76a0ef-5867-4a50-8d1a-e8d48c6841a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:12.077711 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76a0ef-5867-4a50-8d1a-e8d48c6841a0 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:12.083304 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 490/959] 10.222.0.11 () {56 vars in 1112 bytes} [Wed May 4 21:34:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:12.089050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbec1b-5836-46b3-876b-53b721e7b9bb None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:12.186805 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbec1b-5836-46b3-876b-53b721e7b9bb None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:12.220224 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50babc-b8a1-46cd-9989-30244f668c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:12.220902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50babc-b8a1-46cd-9989-30244f668c39 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:12.221187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50babc-b8a1-46cd-9989-30244f668c39 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:12.221462 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50babc-b8a1-46cd-9989-30244f668c39 None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:12.222175 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50babc-b8a1-46cd-9989-30244f668c39 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:12.222483 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50babc-b8a1-46cd-9989-30244f668c39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:12.224215 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50babc-b8a1-46cd-9989-30244f668c39 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:12.229421 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 470/960] 10.222.0.11 () {56 vars in 1112 bytes} [Wed May 4 21:34:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:12.624432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107748b0-abcf-45b5-a4cd-7edf4c586fa7 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:12.624719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107748b0-abcf-45b5-a4cd-7edf4c586fa7 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:12.625000 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107748b0-abcf-45b5-a4cd-7edf4c586fa7 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:12.626714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 491/961] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:12.631949 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82189df6-1663-40bf-8216-9d4407f9b18f None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:12.632393 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82189df6-1663-40bf-8216-9d4407f9b18f None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:12.632764 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82189df6-1663-40bf-8216-9d4407f9b18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:12.649674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-82189df6-1663-40bf-8216-9d4407f9b18f None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:12.651134 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-82189df6-1663-40bf-8216-9d4407f9b18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:12.715364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 471/962] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:12.739537 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107748b0-abcf-45b5-a4cd-7edf4c586fa7 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:12.837156 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107748b0-abcf-45b5-a4cd-7edf4c586fa7 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:12.869481 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c62c8-820e-45ce-a1ec-49b25da2b334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:12.870421 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c62c8-820e-45ce-a1ec-49b25da2b334 None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:12.870922 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c62c8-820e-45ce-a1ec-49b25da2b334 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:12.871413 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c62c8-820e-45ce-a1ec-49b25da2b334 None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:12.872325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c62c8-820e-45ce-a1ec-49b25da2b334 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:12.873941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c62c8-820e-45ce-a1ec-49b25da2b334 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:12.887258 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.sql.core [None req-221c62c8-820e-45ce-a1ec-49b25da2b334 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 21:34:12.887258 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 21:34:12.887258 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [parameters: {'user_id': 'e5775a6b074b4f108bef7f70ac227cf8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 21:34:12.887258 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86613) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 21:34:12.895556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-221c62c8-820e-45ce-a1ec-49b25da2b334 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 21:34:12.895556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:12.895556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 21:34:12.895556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 21:34:12.895556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 21:34:12.895556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 21:34:12.895556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 21:34:12.895556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application result = self._query(query) May 04 21:34:12.895556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 21:34:12.895556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application conn.query(q) May 04 21:34:12.895556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 21:34:12.895556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 21:34:12.895556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 21:34:12.895556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application result.read() May 04 21:34:12.895556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 21:34:12.896423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 21:34:12.896423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 21:34:12.896423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 21:34:12.896423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 21:34:12.896423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 21:34:12.896423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 21:34:12.896423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 21:34:12.896423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 21:34:12.896423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:12.896423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 21:34:12.896423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:12.896423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:12.896423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 21:34:12.896423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 21:34:12.896423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 04 21:34:12.896423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 04 21:34:12.896423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 21:34:12.896423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application next(self.gen) May 04 21:34:12.897354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 21:34:12.897354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application yield resource May 04 21:34:12.897354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 21:34:12.897354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application next(self.gen) May 04 21:34:12.897354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 21:34:12.897354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self.session.rollback() May 04 21:34:12.897354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 21:34:12.897354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self.force_reraise() May 04 21:34:12.897354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 21:34:12.897354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise self.value May 04 21:34:12.897354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 21:34:12.897354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 21:34:12.897354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 21:34:12.897354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application session.commit() May 04 21:34:12.897354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 21:34:12.897354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 21:34:12.897354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 21:34:12.898305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._prepare_impl() May 04 21:34:12.898305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 21:34:12.898305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self.session.flush() May 04 21:34:12.898305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 21:34:12.898305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._flush(objects) May 04 21:34:12.898305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 21:34:12.898305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 21:34:12.898305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 21:34:12.898305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application compat.raise_( May 04 21:34:12.898305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 21:34:12.898305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception May 04 21:34:12.898305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 21:34:12.898305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application flush_context.execute() May 04 21:34:12.898305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 21:34:12.898305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rec.execute(self) May 04 21:34:12.898305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 21:34:12.898305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 21:34:12.899270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 21:34:12.899270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 21:34:12.899270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 04 21:34:12.899270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application result = connection._execute_20( May 04 21:34:12.899270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 21:34:12.899270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 21:34:12.899270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 21:34:12.899270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 21:34:12.899270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 21:34:12.899270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 21:34:12.899270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 21:34:12.899270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 21:34:12.899270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 21:34:12.899270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 21:34:12.899270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 21:34:12.899270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception May 04 21:34:12.900137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 21:34:12.900137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 21:34:12.900137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 21:34:12.900137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 21:34:12.900137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 21:34:12.900137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application result = self._query(query) May 04 21:34:12.900137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 21:34:12.900137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application conn.query(q) May 04 21:34:12.900137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 21:34:12.900137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 21:34:12.900137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 21:34:12.900137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application result.read() May 04 21:34:12.900137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 21:34:12.900137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 21:34:12.900137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 21:34:12.900137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 21:34:12.900984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 21:34:12.900984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 21:34:12.900984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 21:34:12.900984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 21:34:12.900984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 21:34:12.900984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 21:34:12.900984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e5775a6b074b4f108bef7f70ac227cf8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 21:34:12.900984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 21:34:12.900984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:12.900984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:34:12.900984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:12.900984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:12.900984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:12.900984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:12.900984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:12.901791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:12.901791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:12.901791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:12.901791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:12.901791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:12.901791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:12.901791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:12.901791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 04 21:34:12.901791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 04 21:34:12.901791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:12.901791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:12.901791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:34:12.901791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:34:12.901791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:34:12.901791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:34:12.901791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 04 21:34:12.901791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 04 21:34:12.902712 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 04 21:34:12.902712 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 04 21:34:12.902712 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 21:34:12.902712 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 21:34:12.902712 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 21:34:12.902712 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:12.906088 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 492/963] 10.222.0.11 () {60 vars in 1131 bytes} [Wed May 4 21:34:12 2022] POST /identity/v3/users => generated 160 bytes in 167 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:12.912085 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82189df6-1663-40bf-8216-9d4407f9b18f None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:13.016145 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82189df6-1663-40bf-8216-9d4407f9b18f None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:13.050072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f848f01-3b5c-4000-98da-098e1e7fcc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:13.051302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f848f01-3b5c-4000-98da-098e1e7fcc49 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:13.051780 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f848f01-3b5c-4000-98da-098e1e7fcc49 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:13.052243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f848f01-3b5c-4000-98da-098e1e7fcc49 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:13.063063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f848f01-3b5c-4000-98da-098e1e7fcc49 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:13.063063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f848f01-3b5c-4000-98da-098e1e7fcc49 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:13.077459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-3f848f01-3b5c-4000-98da-098e1e7fcc49 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 21:34:13.077459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:13.077459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:13.077459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:13.077459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:13.077459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:13.077459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:13.077459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:13.077459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:13.077459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:13.077459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:13.077459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:13.077459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:34:13.077459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:34:13.077459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:34:13.077459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:34:13.078636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:13.078636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:13.078636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:34:13.078636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:34:13.078636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:34:13.078636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:34:13.078636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:13.078636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:13.078636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:13.078636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:13.078636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:13.078636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:13.078636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:13.078636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:13.078636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:13.078636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:13.078636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:13.078636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:13.079738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:13.079738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:13.079738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:34:13.079738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:34:13.079738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:34:13.079738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:34:13.079738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:34:13.079738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:34:13.079738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 21:34:13.079738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:13.079738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 472/964] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:34:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:34:13.087477 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c62c8-820e-45ce-a1ec-49b25da2b334 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:13.187649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c62c8-820e-45ce-a1ec-49b25da2b334 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:13.220272 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f6d82-c491-4521-8396-fc4394a43035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:13.221314 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f6d82-c491-4521-8396-fc4394a43035 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:13.221789 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f6d82-c491-4521-8396-fc4394a43035 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:13.222256 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f6d82-c491-4521-8396-fc4394a43035 None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:13.223602 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f6d82-c491-4521-8396-fc4394a43035 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:13.224122 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f6d82-c491-4521-8396-fc4394a43035 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:13.225928 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f6d82-c491-4521-8396-fc4394a43035 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:13.264841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 493/965] 10.222.0.11 () {56 vars in 1101 bytes} [Wed May 4 21:34:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:13.692230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a65306-2bab-4fa5-968b-8a04b6f1a2f0 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:13.692816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a65306-2bab-4fa5-968b-8a04b6f1a2f0 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:13.692816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a65306-2bab-4fa5-968b-8a04b6f1a2f0 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:13.694387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 473/966] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:13.700519 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab22f7-b2b9-492a-a785-5cb77d595ea9 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:13.700854 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab22f7-b2b9-492a-a785-5cb77d595ea9 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:13.701085 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab22f7-b2b9-492a-a785-5cb77d595ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:13.719890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-0eab22f7-b2b9-492a-a785-5cb77d595ea9 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:13.721466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-0eab22f7-b2b9-492a-a785-5cb77d595ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:13.789951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 494/967] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:13.813534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a65306-2bab-4fa5-968b-8a04b6f1a2f0 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:13.889402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a324f8-5b55-46ed-81dd-9ac245d74da9 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:13.889606 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a324f8-5b55-46ed-81dd-9ac245d74da9 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:13.889836 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a324f8-5b55-46ed-81dd-9ac245d74da9 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:13.891509 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 495/968] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:34:13.896408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723a92f-af93-4799-85af-c55d53998a27 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:13.896708 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723a92f-af93-4799-85af-c55d53998a27 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:13.896994 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723a92f-af93-4799-85af-c55d53998a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:13.913519 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-7723a92f-af93-4799-85af-c55d53998a27 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:13.915115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-7723a92f-af93-4799-85af-c55d53998a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:13.917098 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a65306-2bab-4fa5-968b-8a04b6f1a2f0 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:13.949722 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323e197-b331-4987-ac1a-c02792cc4702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:13.950529 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323e197-b331-4987-ac1a-c02792cc4702 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:13.950812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323e197-b331-4987-ac1a-c02792cc4702 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:13.951112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323e197-b331-4987-ac1a-c02792cc4702 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:13.961026 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323e197-b331-4987-ac1a-c02792cc4702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:34:13.969270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-5323e197-b331-4987-ac1a-c02792cc4702 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:34:13.969270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:13.969270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:13.969270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:13.969270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:13.969270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:13.969270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:13.969270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:13.969270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:13.969270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:13.969270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:13.969270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:13.969270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:34:13.969270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:34:13.969270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:34:13.969270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:34:13.970216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:34:13.970216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:34:13.970216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:34:13.970216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:34:13.970216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:13.970216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:13.970216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:13.970216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:13.970216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:13.970216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:13.970216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:13.970216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:13.970216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:13.970216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:13.970216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:13.970216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:13.971230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:13.971230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:13.971230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:13.971230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:13.971230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:34:13.971230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:34:13.971230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:34:13.971230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:34:13.971230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:34:13.971230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:34:13.971230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:34:13.971230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:13.971230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 474/969] 10.222.0.11 () {56 vars in 1120 bytes} [Wed May 4 21:34:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:13.976781 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323e197-b331-4987-ac1a-c02792cc4702 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:13.983157 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 496/970] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:34:14.005332 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723a92f-af93-4799-85af-c55d53998a27 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:14.076026 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323e197-b331-4987-ac1a-c02792cc4702 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:14.108690 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723a92f-af93-4799-85af-c55d53998a27 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:14.110546 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956a32e-d9f1-4653-9f89-852632cd3927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:14.111261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956a32e-d9f1-4653-9f89-852632cd3927 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:14.111542 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956a32e-d9f1-4653-9f89-852632cd3927 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:14.111814 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956a32e-d9f1-4653-9f89-852632cd3927 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:14.112582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956a32e-d9f1-4653-9f89-852632cd3927 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:14.112887 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956a32e-d9f1-4653-9f89-852632cd3927 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:14.114246 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956a32e-d9f1-4653-9f89-852632cd3927 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:14.122756 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 475/971] 10.222.0.11 () {56 vars in 1115 bytes} [Wed May 4 21:34:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:14.128592 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956a32e-d9f1-4653-9f89-852632cd3927 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:14.148117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749d5ae-123a-4daa-8316-478c1c823df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:14.149086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749d5ae-123a-4daa-8316-478c1c823df3 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:14.149286 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749d5ae-123a-4daa-8316-478c1c823df3 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:14.149603 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749d5ae-123a-4daa-8316-478c1c823df3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:14.150269 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749d5ae-123a-4daa-8316-478c1c823df3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:14.151703 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749d5ae-123a-4daa-8316-478c1c823df3 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:14.163563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-c749d5ae-123a-4daa-8316-478c1c823df3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:34:14.163563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:14.163563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:34:14.163563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:34:14.163563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:34:14.163563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:34:14.163563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:34:14.163563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:14.163563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:34:14.163563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:14.163563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:34:14.163563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:14.163563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:14.163563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:14.163563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:14.163563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:14.163563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:14.164707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:14.164707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:14.164707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:14.164707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:14.164707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:14.164707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:14.164707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:34:14.164707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:34:14.164707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:34:14.164707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:34:14.164707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:14.164707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:14.164707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:14.164707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:14.164707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:14.164707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:14.165679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:14.165679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:14.165679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:14.165679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:14.165679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:14.165679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:14.165679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:14.165679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:14.165679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:14.165679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:14.165679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:34:14.165679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:14.165679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:34:14.165679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:14.165679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 497/972] 10.222.0.11 () {56 vars in 1126 bytes} [Wed May 4 21:34:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:34:14.170856 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749d5ae-123a-4daa-8316-478c1c823df3 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:14.233527 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956a32e-d9f1-4653-9f89-852632cd3927 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:14.265103 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23343a-1c0a-43db-8a8e-f94a3752e9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:14.265912 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23343a-1c0a-43db-8a8e-f94a3752e9a2 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:14.266274 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23343a-1c0a-43db-8a8e-f94a3752e9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:14.266522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23343a-1c0a-43db-8a8e-f94a3752e9a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:14.268320 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749d5ae-123a-4daa-8316-478c1c823df3 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:14.276885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23343a-1c0a-43db-8a8e-f94a3752e9a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:14.278342 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23343a-1c0a-43db-8a8e-f94a3752e9a2 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:14.294906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-df23343a-1c0a-43db-8a8e-f94a3752e9a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:14.294906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:14.294906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:14.294906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:14.294906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:14.294906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:14.294906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:14.294906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:14.294906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:14.294906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:14.294906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:14.294906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:14.294906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:34:14.294906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:34:14.294906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:34:14.295848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:34:14.295848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:14.295848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:14.295848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:14.295848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:14.295848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:14.295848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:14.295848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:14.295848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:14.295848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:14.295848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:14.295848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:14.295848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:14.295848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:14.295848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:14.295848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:14.295848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:14.296953 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:34:14.296953 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:34:14.296953 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:14.296953 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:14.296953 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 476/973] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:14.301598 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23343a-1c0a-43db-8a8e-f94a3752e9a2 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:14.304171 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cadf1f-9f3d-49f1-909b-a14d104f781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:14.304853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cadf1f-9f3d-49f1-909b-a14d104f781c None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:14.305271 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cadf1f-9f3d-49f1-909b-a14d104f781c None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:14.305586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cadf1f-9f3d-49f1-909b-a14d104f781c None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:14.306268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cadf1f-9f3d-49f1-909b-a14d104f781c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:14.306584 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cadf1f-9f3d-49f1-909b-a14d104f781c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:14.307996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cadf1f-9f3d-49f1-909b-a14d104f781c None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:14.313043 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 498/974] 10.222.0.11 () {56 vars in 1122 bytes} [Wed May 4 21:34:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:14.318539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cadf1f-9f3d-49f1-909b-a14d104f781c None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:14.412662 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23343a-1c0a-43db-8a8e-f94a3752e9a2 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:14.419004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cadf1f-9f3d-49f1-909b-a14d104f781c None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:14.447411 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44d32e-c0c9-49db-8f22-18650dc28722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:14.448079 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44d32e-c0c9-49db-8f22-18650dc28722 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:14.448365 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44d32e-c0c9-49db-8f22-18650dc28722 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:14.448642 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44d32e-c0c9-49db-8f22-18650dc28722 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:14.449358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44d32e-c0c9-49db-8f22-18650dc28722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:14.449674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44d32e-c0c9-49db-8f22-18650dc28722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:14.451022 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44d32e-c0c9-49db-8f22-18650dc28722 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:14.452148 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132a139-0543-4a3e-8fda-9afd613ee9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:14.452824 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132a139-0543-4a3e-8fda-9afd613ee9fc None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:14.453112 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132a139-0543-4a3e-8fda-9afd613ee9fc None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:14.453395 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132a139-0543-4a3e-8fda-9afd613ee9fc None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:14.454104 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132a139-0543-4a3e-8fda-9afd613ee9fc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:14.454419 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132a139-0543-4a3e-8fda-9afd613ee9fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:14.455809 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132a139-0543-4a3e-8fda-9afd613ee9fc None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:14.460888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 499/975] 10.222.0.11 () {56 vars in 1122 bytes} [Wed May 4 21:34:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:14.467070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132a139-0543-4a3e-8fda-9afd613ee9fc None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:14.468594 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 477/976] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:14.474347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44d32e-c0c9-49db-8f22-18650dc28722 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:14.565648 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132a139-0543-4a3e-8fda-9afd613ee9fc None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:14.571204 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44d32e-c0c9-49db-8f22-18650dc28722 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:14.598840 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35117b67-b15e-4ddb-a638-9fa05e064f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:14.599532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35117b67-b15e-4ddb-a638-9fa05e064f07 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:14.599811 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35117b67-b15e-4ddb-a638-9fa05e064f07 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:14.600084 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35117b67-b15e-4ddb-a638-9fa05e064f07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:14.600878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35117b67-b15e-4ddb-a638-9fa05e064f07 None admin] RBAC: Adding query filter params (interface=admin, service_id=6441952653494094a383bbcc8e9711b5, region_id=RegionOne) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:14.601190 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35117b67-b15e-4ddb-a638-9fa05e064f07 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:14.602751 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35117b67-b15e-4ddb-a638-9fa05e064f07 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:14.605478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7eb3b0-b9eb-4ce4-ad1b-6898ce19a2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:14.606301 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb3b0-b9eb-4ce4-ad1b-6898ce19a2ac None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:14.606578 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb3b0-b9eb-4ce4-ad1b-6898ce19a2ac None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:14.606846 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb3b0-b9eb-4ce4-ad1b-6898ce19a2ac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:14.607746 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 500/977] 10.222.0.11 () {56 vars in 1249 bytes} [Wed May 4 21:34:14 2022] GET /identity/v3/endpoints?service_id=6441952653494094a383bbcc8e9711b5&interface=admin®ion_id=RegionOne => generated 193 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:14.613048 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04349b3f-c695-4a1a-bd2d-84753a33a498 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:14.613344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04349b3f-c695-4a1a-bd2d-84753a33a498 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:14.613627 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04349b3f-c695-4a1a-bd2d-84753a33a498 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:14.614003 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7eb3b0-b9eb-4ce4-ad1b-6898ce19a2ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:14.614957 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 501/978] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:14.615465 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7eb3b0-b9eb-4ce4-ad1b-6898ce19a2ac None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:14.615675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04349b3f-c695-4a1a-bd2d-84753a33a498 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:14.630604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-db7eb3b0-b9eb-4ce4-ad1b-6898ce19a2ac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:34:14.630604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:14.630604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:14.630604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:14.630604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:14.630604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:14.630604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:14.630604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:14.630604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:14.630604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:14.630604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:14.630604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:14.630604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:34:14.630604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:34:14.630604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:34:14.630604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:34:14.631615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:14.631615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:14.631615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:34:14.631615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:34:14.631615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:34:14.631615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:34:14.631615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:14.631615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:14.631615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:14.631615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:14.631615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:14.631615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:14.631615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:14.631615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:14.631615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:14.631615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:14.631615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:14.631615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:14.632538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:14.632538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:14.632538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:34:14.632538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:34:14.632538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:34:14.632538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:34:14.632538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:34:14.632538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:34:14.632538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:34:14.632538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:14.632538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 478/979] 10.222.0.11 () {56 vars in 1117 bytes} [Wed May 4 21:34:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:34:14.633414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0afcd1-9c4e-4be9-bc96-1a8ccd8335d9 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:14.633886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0afcd1-9c4e-4be9-bc96-1a8ccd8335d9 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:14.634105 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0afcd1-9c4e-4be9-bc96-1a8ccd8335d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:14.649912 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-7b0afcd1-9c4e-4be9-bc96-1a8ccd8335d9 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:14.651098 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-7b0afcd1-9c4e-4be9-bc96-1a8ccd8335d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:14.715687 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 479/980] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:14.716504 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0afcd1-9c4e-4be9-bc96-1a8ccd8335d9 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:14.726664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04349b3f-c695-4a1a-bd2d-84753a33a498 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:14.762226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7225e8-86ea-4401-8357-06a233837e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:14.762907 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7225e8-86ea-4401-8357-06a233837e5a None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:14.763198 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7225e8-86ea-4401-8357-06a233837e5a None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:14.763454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7225e8-86ea-4401-8357-06a233837e5a None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:14.764128 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7225e8-86ea-4401-8357-06a233837e5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:14.765503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7225e8-86ea-4401-8357-06a233837e5a None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:14.771529 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 502/981] 10.222.0.11 () {56 vars in 1087 bytes} [Wed May 4 21:34:14 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:34:14.772261 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7225e8-86ea-4401-8357-06a233837e5a None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:14.812227 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0afcd1-9c4e-4be9-bc96-1a8ccd8335d9 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:14.848807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587be43-236f-4dbb-ab93-138adc0e031d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:14.849504 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587be43-236f-4dbb-ab93-138adc0e031d None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:14.849788 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587be43-236f-4dbb-ab93-138adc0e031d None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:14.850064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587be43-236f-4dbb-ab93-138adc0e031d None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:14.850931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587be43-236f-4dbb-ab93-138adc0e031d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:14.851281 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587be43-236f-4dbb-ab93-138adc0e031d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:14.852813 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587be43-236f-4dbb-ab93-138adc0e031d None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:14.871875 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 480/982] 10.222.0.11 () {56 vars in 1149 bytes} [Wed May 4 21:34:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:14.877731 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587be43-236f-4dbb-ab93-138adc0e031d None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:14.881494 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7225e8-86ea-4401-8357-06a233837e5a None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:14.915800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ce4bd-62b9-45a9-b4ba-626092ad7ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:14.916486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ce4bd-62b9-45a9-b4ba-626092ad7ca9 None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:14.916769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ce4bd-62b9-45a9-b4ba-626092ad7ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:14.917043 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ce4bd-62b9-45a9-b4ba-626092ad7ca9 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:14.917774 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ce4bd-62b9-45a9-b4ba-626092ad7ca9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:14.919212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ce4bd-62b9-45a9-b4ba-626092ad7ca9 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:14.933918 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 503/983] 10.222.0.11 () {60 vars in 1141 bytes} [Wed May 4 21:34:14 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:34:14.994934 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587be43-236f-4dbb-ab93-138adc0e031d None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:15.037838 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d4111-5bc8-4ab3-a1fe-4756c38d2632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:15.038502 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d4111-5bc8-4ab3-a1fe-4756c38d2632 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:15.038834 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d4111-5bc8-4ab3-a1fe-4756c38d2632 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:15.039141 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d4111-5bc8-4ab3-a1fe-4756c38d2632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:15.112694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d4111-5bc8-4ab3-a1fe-4756c38d2632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:15.114212 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d4111-5bc8-4ab3-a1fe-4756c38d2632 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:15.212770 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 481/984] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:34:14 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 21:34:15.218462 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ce4bd-62b9-45a9-b4ba-626092ad7ca9 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:15.316272 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ce4bd-62b9-45a9-b4ba-626092ad7ca9 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:15.350056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b5e05-d4ad-4df6-87aa-556a795a70a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:15.351247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b5e05-d4ad-4df6-87aa-556a795a70a5 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:15.351837 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b5e05-d4ad-4df6-87aa-556a795a70a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:15.352381 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b5e05-d4ad-4df6-87aa-556a795a70a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:15.362799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b5e05-d4ad-4df6-87aa-556a795a70a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:15.364521 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b5e05-d4ad-4df6-87aa-556a795a70a5 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:15.381254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-0c6b5e05-d4ad-4df6-87aa-556a795a70a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:15.381254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:15.381254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:15.381254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:15.381254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:15.381254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:15.381254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:15.381254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:15.381254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:15.381254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:15.381254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:15.381254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:15.381254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:34:15.381254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:34:15.381254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:34:15.382153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:34:15.382153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:15.382153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:15.382153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:15.382153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:15.382153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:15.382153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:15.382153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:15.382153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:15.382153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:15.382153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:15.382153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:15.382153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:15.382153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:15.382153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:15.382153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:15.382153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:15.383101 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:34:15.383101 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:34:15.383101 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:15.383101 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:15.385572 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 504/985] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:15.391082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d4111-5bc8-4ab3-a1fe-4756c38d2632 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:15.488057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d4111-5bc8-4ab3-a1fe-4756c38d2632 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:15.522660 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc6ae7-b758-4d3c-9245-dcd53a939e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:15.523355 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc6ae7-b758-4d3c-9245-dcd53a939e6c None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:15.523637 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc6ae7-b758-4d3c-9245-dcd53a939e6c None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:15.523957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc6ae7-b758-4d3c-9245-dcd53a939e6c None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:15.524664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc6ae7-b758-4d3c-9245-dcd53a939e6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:15.525039 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc6ae7-b758-4d3c-9245-dcd53a939e6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:15.526407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc6ae7-b758-4d3c-9245-dcd53a939e6c None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:15.537412 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 482/986] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:15.542904 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b5e05-d4ad-4df6-87aa-556a795a70a5 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:15.655396 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b5e05-d4ad-4df6-87aa-556a795a70a5 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:15.692560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a8daf-93fb-4e40-9120-2506c95304b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:15.693364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a8daf-93fb-4e40-9120-2506c95304b9 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:15.693650 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a8daf-93fb-4e40-9120-2506c95304b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:15.693905 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a8daf-93fb-4e40-9120-2506c95304b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:15.701273 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a8daf-93fb-4e40-9120-2506c95304b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:15.702728 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a8daf-93fb-4e40-9120-2506c95304b9 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:15.717463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-a40a8daf-93fb-4e40-9120-2506c95304b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:34:15.717463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:15.717463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:15.717463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:15.717463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:15.717463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:15.717463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:15.717463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:15.717463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:15.717463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:15.717463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:15.717463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:15.717463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:34:15.717463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:34:15.717463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:34:15.718387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:34:15.718387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:15.718387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:15.718387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:15.718387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:15.718387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:15.718387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:15.718387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:15.718387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:15.718387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:15.718387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:15.718387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:15.718387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:15.718387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:15.718387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:15.718387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:15.718387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:15.719675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:34:15.719675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:34:15.719675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:34:15.719675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:34:15.719675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:34:15.719675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:34:15.719675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:34:15.719675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:15.723693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 505/987] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:34:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:15.724853 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc6ae7-b758-4d3c-9245-dcd53a939e6c None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:15.826225 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc6ae7-b758-4d3c-9245-dcd53a939e6c None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:15.861232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcacdf-d7ac-42c4-82bb-a76b74f3b179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:15.861819 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcacdf-d7ac-42c4-82bb-a76b74f3b179 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:15.862102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcacdf-d7ac-42c4-82bb-a76b74f3b179 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:15.862353 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcacdf-d7ac-42c4-82bb-a76b74f3b179 None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:15.863201 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcacdf-d7ac-42c4-82bb-a76b74f3b179 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:15.863503 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcacdf-d7ac-42c4-82bb-a76b74f3b179 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:15.864915 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcacdf-d7ac-42c4-82bb-a76b74f3b179 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:15.879239 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 483/988] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:34:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:15.884441 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a8daf-93fb-4e40-9120-2506c95304b9 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:15.988972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a8daf-93fb-4e40-9120-2506c95304b9 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:16.022874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd61a0e-bf89-4202-898b-b89a77c3b871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:16.023558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd61a0e-bf89-4202-898b-b89a77c3b871 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:16.023865 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd61a0e-bf89-4202-898b-b89a77c3b871 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:16.024136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd61a0e-bf89-4202-898b-b89a77c3b871 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:16.024963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd61a0e-bf89-4202-898b-b89a77c3b871 None admin] RBAC: Adding query filter params (role.id=5a587c5dea3b4b7fbcaf94adf45c8b31, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=82b2e79995f94ab880f5d798ddd649b1) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:16.025273 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd61a0e-bf89-4202-898b-b89a77c3b871 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:16.026808 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd61a0e-bf89-4202-898b-b89a77c3b871 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:16.032838 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 506/989] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:34:15 2022] GET /identity/v3/role_assignments?user.id=82b2e79995f94ab880f5d798ddd649b1&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=5a587c5dea3b4b7fbcaf94adf45c8b31 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:17.059367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b1dcd-0f7c-4b2a-9dbf-fb5c4f9fc71c None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:17.059938 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b1dcd-0f7c-4b2a-9dbf-fb5c4f9fc71c None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:17.059938 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b1dcd-0f7c-4b2a-9dbf-fb5c4f9fc71c None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:17.061243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 484/990] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:17.066748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57023265-4905-48d7-a8ad-025ef995a2c9 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:17.067208 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57023265-4905-48d7-a8ad-025ef995a2c9 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:17.067382 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57023265-4905-48d7-a8ad-025ef995a2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:17.085279 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-57023265-4905-48d7-a8ad-025ef995a2c9 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:17.086558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-57023265-4905-48d7-a8ad-025ef995a2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:17.155998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 507/991] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:17.178842 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b1dcd-0f7c-4b2a-9dbf-fb5c4f9fc71c None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:17.189839 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c342bd-9aac-4b6a-a27d-1e4cd37f5006 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:17.190130 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c342bd-9aac-4b6a-a27d-1e4cd37f5006 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:17.190401 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c342bd-9aac-4b6a-a27d-1e4cd37f5006 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:17.191955 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 508/992] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:34:17.196850 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f4470-5949-40ee-8d09-25ea56944ccf None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:17.197141 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f4470-5949-40ee-8d09-25ea56944ccf None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:17.197425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f4470-5949-40ee-8d09-25ea56944ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:17.214660 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-265f4470-5949-40ee-8d09-25ea56944ccf None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:17.215947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-265f4470-5949-40ee-8d09-25ea56944ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:17.281778 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b1dcd-0f7c-4b2a-9dbf-fb5c4f9fc71c None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:17.285746 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 509/993] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:34:17.308144 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f4470-5949-40ee-8d09-25ea56944ccf None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:17.314802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26890897-96f2-4351-b001-81b682ef7085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:17.315574 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26890897-96f2-4351-b001-81b682ef7085 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:17.316128 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26890897-96f2-4351-b001-81b682ef7085 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:17.316128 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26890897-96f2-4351-b001-81b682ef7085 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:17.316763 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26890897-96f2-4351-b001-81b682ef7085 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:17.318136 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26890897-96f2-4351-b001-81b682ef7085 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:17.329712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-26890897-96f2-4351-b001-81b682ef7085 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:34:17.329712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:17.329712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:34:17.329712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:34:17.329712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:34:17.329712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:34:17.329712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:34:17.329712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:17.329712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:34:17.329712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:17.329712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:34:17.329712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:17.329712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:17.329712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:17.329712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:17.329712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:17.329712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:17.330711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:17.330711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:17.330711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:17.330711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:17.330711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:17.330711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:17.330711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:34:17.330711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:34:17.330711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:34:17.330711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:34:17.330711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:17.330711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:17.330711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:17.330711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:17.330711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:17.330711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:17.336695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:17.336695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:17.336695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:17.336695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:17.336695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:17.336695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:17.336695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:17.336695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:17.336695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:17.336695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:17.336695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:34:17.336695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:17.336695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:34:17.336695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:17.336695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 485/994] 10.222.0.11 () {56 vars in 1126 bytes} [Wed May 4 21:34:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:17.338757 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26890897-96f2-4351-b001-81b682ef7085 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:17.404824 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f4470-5949-40ee-8d09-25ea56944ccf None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:17.432590 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26890897-96f2-4351-b001-81b682ef7085 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:17.437197 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3db8c-a9c7-442c-8f21-7b27d371ec48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:17.438000 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3db8c-a9c7-442c-8f21-7b27d371ec48 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:17.438276 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3db8c-a9c7-442c-8f21-7b27d371ec48 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:17.438545 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3db8c-a9c7-442c-8f21-7b27d371ec48 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:17.439225 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3db8c-a9c7-442c-8f21-7b27d371ec48 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:17.440598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3db8c-a9c7-442c-8f21-7b27d371ec48 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:17.452245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-03b3db8c-a9c7-442c-8f21-7b27d371ec48 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 21:34:17.452245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:17.452245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:34:17.452245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:34:17.452245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:34:17.452245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:34:17.452245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:34:17.452245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:17.452245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 21:34:17.452245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:17.452245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:34:17.452245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:17.452245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:17.452245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:17.452245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:17.452245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:17.452245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:17.453246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:17.453246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:17.453246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:17.453246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:17.453246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:17.453246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:17.453246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:34:17.453246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:34:17.453246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:34:17.453246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:34:17.453246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:17.453246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:17.453246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:17.453246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:17.453246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:17.453246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:17.459530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:17.459530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:17.459530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:17.459530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:17.459530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:17.459530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:17.459530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:17.459530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:17.459530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:17.459530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:17.459530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:34:17.459530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:17.459530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 21:34:17.459530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:17.459530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 510/995] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:34:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:34:17.460368 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3db8c-a9c7-442c-8f21-7b27d371ec48 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:17.465229 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f7b69-eac4-4df4-892c-4272f462c654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:17.465899 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f7b69-eac4-4df4-892c-4272f462c654 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:17.466184 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f7b69-eac4-4df4-892c-4272f462c654 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:17.466460 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f7b69-eac4-4df4-892c-4272f462c654 None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:17.467269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f7b69-eac4-4df4-892c-4272f462c654 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:17.467582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f7b69-eac4-4df4-892c-4272f462c654 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:17.469105 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f7b69-eac4-4df4-892c-4272f462c654 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:17.475346 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 486/996] 10.222.0.11 () {56 vars in 1122 bytes} [Wed May 4 21:34:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:17.479934 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f7b69-eac4-4df4-892c-4272f462c654 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:17.555539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3db8c-a9c7-442c-8f21-7b27d371ec48 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:17.575432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f7b69-eac4-4df4-892c-4272f462c654 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:17.590986 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efa1c3-8897-4d9c-83e5-8039fae5f73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:17.591694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efa1c3-8897-4d9c-83e5-8039fae5f73b None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:17.591983 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efa1c3-8897-4d9c-83e5-8039fae5f73b None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:17.592254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efa1c3-8897-4d9c-83e5-8039fae5f73b None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:17.592952 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efa1c3-8897-4d9c-83e5-8039fae5f73b None admin] RBAC: Adding query filter params (name=compute) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:17.593257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efa1c3-8897-4d9c-83e5-8039fae5f73b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:17.594607 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efa1c3-8897-4d9c-83e5-8039fae5f73b None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:17.599944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 511/997] 10.222.0.11 () {56 vars in 1112 bytes} [Wed May 4 21:34:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:17.605342 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efa1c3-8897-4d9c-83e5-8039fae5f73b None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:17.609801 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824ddc3-d54b-4d68-af50-62ed691b8a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:17.610478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824ddc3-d54b-4d68-af50-62ed691b8a93 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:17.610763 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824ddc3-d54b-4d68-af50-62ed691b8a93 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:17.611137 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824ddc3-d54b-4d68-af50-62ed691b8a93 None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:17.611768 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824ddc3-d54b-4d68-af50-62ed691b8a93 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:17.612105 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824ddc3-d54b-4d68-af50-62ed691b8a93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:17.613513 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824ddc3-d54b-4d68-af50-62ed691b8a93 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:17.623541 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 487/998] 10.222.0.11 () {56 vars in 1122 bytes} [Wed May 4 21:34:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:17.624242 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824ddc3-d54b-4d68-af50-62ed691b8a93 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:17.703096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efa1c3-8897-4d9c-83e5-8039fae5f73b None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:17.718379 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824ddc3-d54b-4d68-af50-62ed691b8a93 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:17.733294 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d35f1d-72d6-4a6c-8b88-1b91ac843853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:17.733964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d35f1d-72d6-4a6c-8b88-1b91ac843853 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:17.734246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d35f1d-72d6-4a6c-8b88-1b91ac843853 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:17.734520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d35f1d-72d6-4a6c-8b88-1b91ac843853 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:17.735242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d35f1d-72d6-4a6c-8b88-1b91ac843853 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:17.735554 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d35f1d-72d6-4a6c-8b88-1b91ac843853 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:17.736917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d35f1d-72d6-4a6c-8b88-1b91ac843853 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:17.741604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 512/999] 10.222.0.11 () {56 vars in 1112 bytes} [Wed May 4 21:34:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:17.747579 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d35f1d-72d6-4a6c-8b88-1b91ac843853 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:17.752958 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdc25d-cb54-4a42-a6f0-34e36f2598c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:17.753617 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdc25d-cb54-4a42-a6f0-34e36f2598c4 None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:17.753899 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdc25d-cb54-4a42-a6f0-34e36f2598c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:17.754174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdc25d-cb54-4a42-a6f0-34e36f2598c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:17.754910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdc25d-cb54-4a42-a6f0-34e36f2598c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:17.756336 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdc25d-cb54-4a42-a6f0-34e36f2598c4 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:17.779177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 488/1000] 10.222.0.11 () {60 vars in 1144 bytes} [Wed May 4 21:34:17 2022] POST /identity/v3/endpoints => generated 325 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:34:17.851651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d35f1d-72d6-4a6c-8b88-1b91ac843853 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:17.893863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57825a1-294f-4b85-befc-8b3111a0cbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:17.894725 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57825a1-294f-4b85-befc-8b3111a0cbbb None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:17.895145 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57825a1-294f-4b85-befc-8b3111a0cbbb None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:17.895465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57825a1-294f-4b85-befc-8b3111a0cbbb None admin] PATH_INFO: `/v3/endpoints` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:17.896276 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57825a1-294f-4b85-befc-8b3111a0cbbb None admin] RBAC: Adding query filter params (interface=public, service_id=45cbdb37514c420787a46bd98748f1d7, region_id=RegionOne) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:17.896588 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57825a1-294f-4b85-befc-8b3111a0cbbb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:17.897960 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57825a1-294f-4b85-befc-8b3111a0cbbb None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:17.908378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 513/1001] 10.222.0.11 () {56 vars in 1251 bytes} [Wed May 4 21:34:17 2022] GET /identity/v3/endpoints?service_id=45cbdb37514c420787a46bd98748f1d7&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:17.909781 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdc25d-cb54-4a42-a6f0-34e36f2598c4 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:18.012285 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdc25d-cb54-4a42-a6f0-34e36f2598c4 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:18.043840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05537c5-4965-4184-b25d-713696c041f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:18.044507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05537c5-4965-4184-b25d-713696c041f9 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:18.044786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05537c5-4965-4184-b25d-713696c041f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:18.045059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05537c5-4965-4184-b25d-713696c041f9 None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:18.045736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05537c5-4965-4184-b25d-713696c041f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:18.047149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05537c5-4965-4184-b25d-713696c041f9 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:18.053275 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 489/1002] 10.222.0.11 () {56 vars in 1087 bytes} [Wed May 4 21:34:17 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:34:18.291747 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b563f5-8818-43da-9b02-f3c34bdb06f6 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:18.292315 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b563f5-8818-43da-9b02-f3c34bdb06f6 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:18.292315 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b563f5-8818-43da-9b02-f3c34bdb06f6 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:18.293818 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 514/1003] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:18.298770 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf1295-4762-44db-8058-370c5babe1f6 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:18.299179 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf1295-4762-44db-8058-370c5babe1f6 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:18.299379 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf1295-4762-44db-8058-370c5babe1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:18.315625 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-c6cf1295-4762-44db-8058-370c5babe1f6 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:18.316795 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c6cf1295-4762-44db-8058-370c5babe1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:18.381761 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 490/1004] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:18 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:18.403906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b563f5-8818-43da-9b02-f3c34bdb06f6 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:18.505405 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b563f5-8818-43da-9b02-f3c34bdb06f6 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:18.537066 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1e413-87f0-4d03-acfc-d9d7be0c8439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:18.537863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1e413-87f0-4d03-acfc-d9d7be0c8439 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:18.538147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1e413-87f0-4d03-acfc-d9d7be0c8439 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:18.538421 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1e413-87f0-4d03-acfc-d9d7be0c8439 None admin] PATH_INFO: `/v3/services/image` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:18.539095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1e413-87f0-4d03-acfc-d9d7be0c8439 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:18.540856 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1e413-87f0-4d03-acfc-d9d7be0c8439 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:18.558574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-54c1e413-87f0-4d03-acfc-d9d7be0c8439 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 21:34:18.558574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:18.558574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:34:18.558574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:34:18.558574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:34:18.558574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:34:18.558574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:34:18.558574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:18.558574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 21:34:18.558574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:18.558574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:34:18.558574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:18.558574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:18.558574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:18.558574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:18.558574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:18.558574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:18.559823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:18.559823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:18.559823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:18.559823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:18.559823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:18.559823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:18.559823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:34:18.559823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:34:18.559823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:34:18.559823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:34:18.559823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:18.559823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:18.559823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:18.559823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:18.559823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:18.559823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:18.560653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:18.560653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:18.560653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:18.560653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:18.560653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:18.560653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:18.560653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:18.560653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:18.560653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:18.560653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:18.560653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:34:18.560653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:18.560653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 21:34:18.560653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:18.560653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 515/1005] 10.222.0.11 () {56 vars in 1105 bytes} [Wed May 4 21:34:18 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:18.569962 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf1295-4762-44db-8058-370c5babe1f6 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:18.669573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf1295-4762-44db-8058-370c5babe1f6 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:18.704113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb38325-fa3e-49c5-9bca-4fc5c4dbf953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:18.705131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb38325-fa3e-49c5-9bca-4fc5c4dbf953 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:18.705611 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb38325-fa3e-49c5-9bca-4fc5c4dbf953 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:18.706088 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb38325-fa3e-49c5-9bca-4fc5c4dbf953 None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:18.706996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb38325-fa3e-49c5-9bca-4fc5c4dbf953 None admin] RBAC: Adding query filter params (name=image) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:18.707548 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb38325-fa3e-49c5-9bca-4fc5c4dbf953 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:18.709125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb38325-fa3e-49c5-9bca-4fc5c4dbf953 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:18.718684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 491/1006] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:18.720053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1e413-87f0-4d03-acfc-d9d7be0c8439 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:18.820623 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1e413-87f0-4d03-acfc-d9d7be0c8439 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:18.854674 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ef942-e7e5-43a8-8032-55edef6542b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:18.855368 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ef942-e7e5-43a8-8032-55edef6542b8 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:18.855650 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ef942-e7e5-43a8-8032-55edef6542b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:18.855924 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ef942-e7e5-43a8-8032-55edef6542b8 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:18.858132 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ef942-e7e5-43a8-8032-55edef6542b8 None admin] RBAC: Adding query filter params (type=image) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:18.858132 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ef942-e7e5-43a8-8032-55edef6542b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:18.858403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ef942-e7e5-43a8-8032-55edef6542b8 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:18.863277 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 516/1007] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:18 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:20.039829 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1d1dd-dd51-4d5b-a73e-2ecda213ba3a None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:20.040412 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1d1dd-dd51-4d5b-a73e-2ecda213ba3a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:20.040412 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1d1dd-dd51-4d5b-a73e-2ecda213ba3a None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:20.041767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 492/1008] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:20.046842 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6277-fd62-4d2e-98e4-304938caddb1 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:20.047298 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6277-fd62-4d2e-98e4-304938caddb1 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:20.047396 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6277-fd62-4d2e-98e4-304938caddb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:20.064906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-e49f6277-fd62-4d2e-98e4-304938caddb1 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:20.066077 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-e49f6277-fd62-4d2e-98e4-304938caddb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:20.138242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 517/1009] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:20 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:20.161254 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1d1dd-dd51-4d5b-a73e-2ecda213ba3a None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:20.263187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1d1dd-dd51-4d5b-a73e-2ecda213ba3a None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:20.293376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4036a-937b-4c0c-9fa2-8149d9035b96 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:20.293859 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4036a-937b-4c0c-9fa2-8149d9035b96 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:20.294207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4036a-937b-4c0c-9fa2-8149d9035b96 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:20.295828 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 518/1010] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:20.296458 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34d442-2f14-434f-8aac-2a3dfdd3b587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:20.297252 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34d442-2f14-434f-8aac-2a3dfdd3b587 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:20.297534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34d442-2f14-434f-8aac-2a3dfdd3b587 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:20.297810 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34d442-2f14-434f-8aac-2a3dfdd3b587 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:20.299010 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34d442-2f14-434f-8aac-2a3dfdd3b587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:20.300464 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34d442-2f14-434f-8aac-2a3dfdd3b587 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:20.300888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5da93e-f324-447d-950e-7d3d04fc8301 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:20.301181 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5da93e-f324-447d-950e-7d3d04fc8301 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:20.301449 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5da93e-f324-447d-950e-7d3d04fc8301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:20.302161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 493/1011] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:20.307663 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34d442-2f14-434f-8aac-2a3dfdd3b587 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:20.318734 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-fb5da93e-f324-447d-950e-7d3d04fc8301 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:20.320009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-fb5da93e-f324-447d-950e-7d3d04fc8301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:20.387019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 519/1012] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:20 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:34:20.407907 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34d442-2f14-434f-8aac-2a3dfdd3b587 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:20.410062 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5da93e-f324-447d-950e-7d3d04fc8301 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:20.441492 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35936226-9362-4880-a8af-c98d50b87405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:20.442164 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35936226-9362-4880-a8af-c98d50b87405 None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:20.442450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35936226-9362-4880-a8af-c98d50b87405 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:20.442731 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35936226-9362-4880-a8af-c98d50b87405 None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:20.443489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35936226-9362-4880-a8af-c98d50b87405 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:20.444923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35936226-9362-4880-a8af-c98d50b87405 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:20.472634 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 494/1013] 10.222.0.11 () {60 vars in 1141 bytes} [Wed May 4 21:34:20 2022] POST /identity/v3/projects => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:34:20.509258 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5da93e-f324-447d-950e-7d3d04fc8301 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:20.546645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580d45e-8a1b-4d51-bb15-0af1bbfb3a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:20.547401 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580d45e-8a1b-4d51-bb15-0af1bbfb3a22 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:20.547687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580d45e-8a1b-4d51-bb15-0af1bbfb3a22 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:20.547961 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580d45e-8a1b-4d51-bb15-0af1bbfb3a22 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:20.548696 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580d45e-8a1b-4d51-bb15-0af1bbfb3a22 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:20.550129 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580d45e-8a1b-4d51-bb15-0af1bbfb3a22 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:20.562499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-3580d45e-8a1b-4d51-bb15-0af1bbfb3a22 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 21:34:20.562499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:20.562499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:34:20.562499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:34:20.562499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:34:20.562499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:34:20.562499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:34:20.562499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:20.562499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 21:34:20.562499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:20.562499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:34:20.562499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:20.562499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:20.562499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:20.562499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:20.562499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:20.562499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:20.563843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:20.563843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:20.563843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:20.563843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:20.563843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:20.563843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:20.563843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:34:20.563843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:34:20.563843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:34:20.563843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:34:20.563843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:20.563843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:20.563843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:20.563843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:20.563843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:20.563843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:20.564687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:20.564687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:20.564687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:20.564687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:20.564687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:20.564687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:20.564687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:20.564687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:20.564687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:20.564687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:20.564687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:34:20.564687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:20.564687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 21:34:20.564687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:20.570149 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 520/1014] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:34:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:34:20.571725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35936226-9362-4880-a8af-c98d50b87405 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:20.679146 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35936226-9362-4880-a8af-c98d50b87405 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:20.714651 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de66c0-a96c-495d-ac80-1c6dab57da8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:20.715364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de66c0-a96c-495d-ac80-1c6dab57da8f None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:20.715664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de66c0-a96c-495d-ac80-1c6dab57da8f None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:20.715934 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de66c0-a96c-495d-ac80-1c6dab57da8f None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:20.716651 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de66c0-a96c-495d-ac80-1c6dab57da8f None admin] RBAC: Adding query filter params (name=compute) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:20.716963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de66c0-a96c-495d-ac80-1c6dab57da8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:20.718335 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de66c0-a96c-495d-ac80-1c6dab57da8f None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:20.727124 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 495/1015] 10.222.0.11 () {56 vars in 1112 bytes} [Wed May 4 21:34:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:20.729775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580d45e-8a1b-4d51-bb15-0af1bbfb3a22 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:20.828744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580d45e-8a1b-4d51-bb15-0af1bbfb3a22 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:20.862428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525207f-a0eb-4bae-b15a-026a117e1934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:20.863123 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525207f-a0eb-4bae-b15a-026a117e1934 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:20.863418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525207f-a0eb-4bae-b15a-026a117e1934 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:20.863690 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525207f-a0eb-4bae-b15a-026a117e1934 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:20.864391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525207f-a0eb-4bae-b15a-026a117e1934 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:20.864698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525207f-a0eb-4bae-b15a-026a117e1934 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:20.866053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525207f-a0eb-4bae-b15a-026a117e1934 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:20.871211 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 521/1016] 10.222.0.11 () {56 vars in 1112 bytes} [Wed May 4 21:34:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:20.876676 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de66c0-a96c-495d-ac80-1c6dab57da8f None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:20.981563 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de66c0-a96c-495d-ac80-1c6dab57da8f None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:21.014038 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddd8ec-3efd-402d-91cb-d6a87902a0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:21.014696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddd8ec-3efd-402d-91cb-d6a87902a0a3 None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:21.014977 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddd8ec-3efd-402d-91cb-d6a87902a0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:21.015298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddd8ec-3efd-402d-91cb-d6a87902a0a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:21.016037 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddd8ec-3efd-402d-91cb-d6a87902a0a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:21.017409 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddd8ec-3efd-402d-91cb-d6a87902a0a3 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:21.036383 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 496/1017] 10.222.0.11 () {60 vars in 1144 bytes} [Wed May 4 21:34:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:34:21.105555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c193e-673a-4066-a461-458264742edd None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:21.106089 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c193e-673a-4066-a461-458264742edd None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:21.106089 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c193e-673a-4066-a461-458264742edd None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:21.107772 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 522/1018] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:21.113518 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27bc98-7b3b-47a7-955c-d12508955c1f None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:21.114050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27bc98-7b3b-47a7-955c-d12508955c1f None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:21.114050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27bc98-7b3b-47a7-955c-d12508955c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:21.132763 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-9c27bc98-7b3b-47a7-955c-d12508955c1f None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:21.134072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-9c27bc98-7b3b-47a7-955c-d12508955c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:21.211121 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 497/1019] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:21 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:34:21.233032 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c193e-673a-4066-a461-458264742edd None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:21.337944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c193e-673a-4066-a461-458264742edd None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:21.374668 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92846df6-1285-4540-a549-32134991ce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:21.375273 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92846df6-1285-4540-a549-32134991ce7d None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:21.375554 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92846df6-1285-4540-a549-32134991ce7d None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:21.375826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92846df6-1285-4540-a549-32134991ce7d None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:21.376542 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92846df6-1285-4540-a549-32134991ce7d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:21.377932 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92846df6-1285-4540-a549-32134991ce7d None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:21.393573 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 523/1020] 10.222.0.11 () {60 vars in 1141 bytes} [Wed May 4 21:34:21 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:34:22.828129 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c5c3e-3786-4c66-84c5-a5328cc2fe14 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:22.828653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c5c3e-3786-4c66-84c5-a5328cc2fe14 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:22.828732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c5c3e-3786-4c66-84c5-a5328cc2fe14 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:22.830125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 498/1021] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:22.836232 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97828ed8-bda3-4aca-a7e5-2274667ce77b None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:22.836698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97828ed8-bda3-4aca-a7e5-2274667ce77b None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:22.836698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97828ed8-bda3-4aca-a7e5-2274667ce77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:22.854501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-97828ed8-bda3-4aca-a7e5-2274667ce77b None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:22.855734 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-97828ed8-bda3-4aca-a7e5-2274667ce77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:22.943417 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 524/1022] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:22.969324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c5c3e-3786-4c66-84c5-a5328cc2fe14 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:23.086610 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c5c3e-3786-4c66-84c5-a5328cc2fe14 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:23.125626 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26093bd-1aac-46b0-bdc4-4208323c5570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:23.126875 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26093bd-1aac-46b0-bdc4-4208323c5570 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:23.127381 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26093bd-1aac-46b0-bdc4-4208323c5570 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:23.127962 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26093bd-1aac-46b0-bdc4-4208323c5570 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:23.129438 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26093bd-1aac-46b0-bdc4-4208323c5570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:23.131023 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26093bd-1aac-46b0-bdc4-4208323c5570 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:23.133247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 499/1023] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:23.139215 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97828ed8-bda3-4aca-a7e5-2274667ce77b None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:23.256569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97828ed8-bda3-4aca-a7e5-2274667ce77b None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:23.294105 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9ba8e-5269-4b86-a4ce-23a6d4f03d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:23.295218 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9ba8e-5269-4b86-a4ce-23a6d4f03d89 None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:23.295729 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9ba8e-5269-4b86-a4ce-23a6d4f03d89 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:23.296208 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9ba8e-5269-4b86-a4ce-23a6d4f03d89 None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:23.297164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9ba8e-5269-4b86-a4ce-23a6d4f03d89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:23.298877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9ba8e-5269-4b86-a4ce-23a6d4f03d89 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:23.323807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 525/1024] 10.222.0.11 () {60 vars in 1132 bytes} [Wed May 4 21:34:23 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:34:23.492902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3baba-0aeb-4a83-b3ef-041d6bbb28fa None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:23.493313 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3baba-0aeb-4a83-b3ef-041d6bbb28fa None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:23.493446 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3baba-0aeb-4a83-b3ef-041d6bbb28fa None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:23.495013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 500/1025] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:34:23.500594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186531a5-d1ce-49d2-a0f8-4c312c056ccf None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:23.501456 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186531a5-d1ce-49d2-a0f8-4c312c056ccf None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:23.501456 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186531a5-d1ce-49d2-a0f8-4c312c056ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:23.518723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-186531a5-d1ce-49d2-a0f8-4c312c056ccf None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:23.519961 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-186531a5-d1ce-49d2-a0f8-4c312c056ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:23.592534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 526/1026] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:23.616589 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3baba-0aeb-4a83-b3ef-041d6bbb28fa None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:23.718995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3baba-0aeb-4a83-b3ef-041d6bbb28fa None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:23.748698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd258a4d-f75a-407d-bd28-6e2a41fd8472 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:23.748941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd258a4d-f75a-407d-bd28-6e2a41fd8472 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:23.749274 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd258a4d-f75a-407d-bd28-6e2a41fd8472 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:23.751186 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 527/1027] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:23.753243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec759b3-1b7c-40aa-b666-1d86150c542b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:23.754057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec759b3-1b7c-40aa-b666-1d86150c542b None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:23.754567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec759b3-1b7c-40aa-b666-1d86150c542b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:23.754672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec759b3-1b7c-40aa-b666-1d86150c542b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:23.755771 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f7f0a-26f0-494b-a6ca-58c9165bfbb2 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:23.756056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f7f0a-26f0-494b-a6ca-58c9165bfbb2 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:23.756323 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f7f0a-26f0-494b-a6ca-58c9165bfbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:23.765085 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec759b3-1b7c-40aa-b666-1d86150c542b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:34:23.772826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-654f7f0a-26f0-494b-a6ca-58c9165bfbb2 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:23.773112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-dec759b3-1b7c-40aa-b666-1d86150c542b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:34:23.773112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:23.773112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:23.773112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:23.773112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:23.773112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:23.773112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:23.773112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:23.773112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:23.773112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:23.773112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:23.773112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:23.773112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:34:23.773112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:34:23.773112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:34:23.773112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:34:23.774282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:34:23.774282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:34:23.774282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:34:23.774282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:34:23.774282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:23.774282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:23.774282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:23.774282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:23.774282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:23.774282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:23.774282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:23.774282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:23.774282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:23.774282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:23.774282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:23.774282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:23.775163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:23.775163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:23.775163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:23.775163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:23.775163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:34:23.775163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:34:23.775163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:34:23.775163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:34:23.775163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:34:23.775163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:34:23.775163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:34:23.775163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:23.775934 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-654f7f0a-26f0-494b-a6ca-58c9165bfbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:23.776624 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 501/1028] 10.222.0.11 () {56 vars in 1120 bytes} [Wed May 4 21:34:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:23.780564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec759b3-1b7c-40aa-b666-1d86150c542b None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:23.839365 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 528/1029] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:34:23.862005 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f7f0a-26f0-494b-a6ca-58c9165bfbb2 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:23.875342 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec759b3-1b7c-40aa-b666-1d86150c542b None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:23.907401 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43b02f-6205-47ba-a79f-6d5d842031e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:23.908071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43b02f-6205-47ba-a79f-6d5d842031e4 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:23.908356 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43b02f-6205-47ba-a79f-6d5d842031e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:23.908635 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43b02f-6205-47ba-a79f-6d5d842031e4 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:23.909376 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43b02f-6205-47ba-a79f-6d5d842031e4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:23.909687 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43b02f-6205-47ba-a79f-6d5d842031e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:23.911063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43b02f-6205-47ba-a79f-6d5d842031e4 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:23.919071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 502/1030] 10.222.0.11 () {56 vars in 1115 bytes} [Wed May 4 21:34:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:23.924454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43b02f-6205-47ba-a79f-6d5d842031e4 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:23.957059 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f7f0a-26f0-494b-a6ca-58c9165bfbb2 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:23.989639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405da619-8932-4aba-8fd8-d3ada69062f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:23.990523 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405da619-8932-4aba-8fd8-d3ada69062f1 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:23.990873 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405da619-8932-4aba-8fd8-d3ada69062f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:23.991184 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405da619-8932-4aba-8fd8-d3ada69062f1 None admin] PATH_INFO: `/v3/services/image` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:23.991843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405da619-8932-4aba-8fd8-d3ada69062f1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:23.993429 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405da619-8932-4aba-8fd8-d3ada69062f1 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:24.004947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-405da619-8932-4aba-8fd8-d3ada69062f1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 21:34:24.004947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:24.004947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:34:24.004947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:34:24.004947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:34:24.004947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:34:24.004947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:34:24.004947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:24.004947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 21:34:24.004947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:24.004947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:34:24.004947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:24.004947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:24.004947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:24.004947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:24.004947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:24.004947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:24.005917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:24.005917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:24.005917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:24.005917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:24.005917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:24.005917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:24.005917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:34:24.005917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:34:24.005917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:34:24.005917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:34:24.005917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:24.005917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:24.005917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:24.005917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:24.005917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:24.005917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:24.006757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:24.006757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:24.006757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:24.006757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:24.006757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:24.006757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:24.006757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:24.006757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:24.006757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:24.006757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:24.006757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:34:24.006757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:24.006757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 21:34:24.006757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:24.006757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 529/1031] 10.222.0.11 () {56 vars in 1105 bytes} [Wed May 4 21:34:23 2022] GET /identity/v3/services/image => generated 86 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:24.014455 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405da619-8932-4aba-8fd8-d3ada69062f1 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:24.025950 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43b02f-6205-47ba-a79f-6d5d842031e4 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:24.058681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fccec7-920d-421a-9974-e0947371fdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:24.059503 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fccec7-920d-421a-9974-e0947371fdf6 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:24.059781 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fccec7-920d-421a-9974-e0947371fdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:24.060074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fccec7-920d-421a-9974-e0947371fdf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:24.071324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fccec7-920d-421a-9974-e0947371fdf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:24.072769 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fccec7-920d-421a-9974-e0947371fdf6 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:24.089480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-87fccec7-920d-421a-9974-e0947371fdf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:24.089480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:24.089480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:24.089480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:24.089480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:24.089480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:24.089480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:24.089480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:24.089480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:24.089480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:24.089480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:24.089480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:24.089480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:34:24.089480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:34:24.089480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:34:24.090604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:34:24.090604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:24.090604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:24.090604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:24.090604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:24.090604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:24.090604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:24.090604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:24.090604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:24.090604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:24.090604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:24.090604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:24.090604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:24.090604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:24.090604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:24.090604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:24.090604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:24.096338 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:34:24.096338 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:34:24.096338 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:24.096338 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:24.096338 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 503/1032] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:34:24.096338 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fccec7-920d-421a-9974-e0947371fdf6 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:24.120162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405da619-8932-4aba-8fd8-d3ada69062f1 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:24.152916 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcc839-376f-48e0-afdb-00e7da800624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:24.153591 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcc839-376f-48e0-afdb-00e7da800624 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:24.153875 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcc839-376f-48e0-afdb-00e7da800624 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:24.154154 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcc839-376f-48e0-afdb-00e7da800624 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:24.154861 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcc839-376f-48e0-afdb-00e7da800624 None admin] RBAC: Adding query filter params (name=image) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:24.155205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcc839-376f-48e0-afdb-00e7da800624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:24.156578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcc839-376f-48e0-afdb-00e7da800624 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:24.161426 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 530/1033] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:24.167315 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcc839-376f-48e0-afdb-00e7da800624 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:24.198070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fccec7-920d-421a-9974-e0947371fdf6 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:24.231412 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cb0f5-bbc1-4454-8932-7556a1c20d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:24.232087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cb0f5-bbc1-4454-8932-7556a1c20d0b None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:24.232374 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cb0f5-bbc1-4454-8932-7556a1c20d0b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:24.232654 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cb0f5-bbc1-4454-8932-7556a1c20d0b None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:24.233376 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870cb0f5-bbc1-4454-8932-7556a1c20d0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:24.233689 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870cb0f5-bbc1-4454-8932-7556a1c20d0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:24.235078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870cb0f5-bbc1-4454-8932-7556a1c20d0b None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:24.253412 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 504/1034] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:24.254581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cb0f5-bbc1-4454-8932-7556a1c20d0b None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:24.267656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcc839-376f-48e0-afdb-00e7da800624 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:24.300899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce81080-c61f-41d9-bc08-223340863f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:24.301573 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce81080-c61f-41d9-bc08-223340863f35 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:24.301859 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce81080-c61f-41d9-bc08-223340863f35 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:24.302140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce81080-c61f-41d9-bc08-223340863f35 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:24.302847 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce81080-c61f-41d9-bc08-223340863f35 None admin] RBAC: Adding query filter params (type=image) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:24.303199 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce81080-c61f-41d9-bc08-223340863f35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:24.304586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce81080-c61f-41d9-bc08-223340863f35 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:24.310148 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 531/1035] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:24.316121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce81080-c61f-41d9-bc08-223340863f35 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:24.352527 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cb0f5-bbc1-4454-8932-7556a1c20d0b None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:24.385673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be34dd-a82b-4ffd-a043-d505433e7102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:24.386730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be34dd-a82b-4ffd-a043-d505433e7102 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:24.387207 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be34dd-a82b-4ffd-a043-d505433e7102 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:24.387615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be34dd-a82b-4ffd-a043-d505433e7102 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:24.395170 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be34dd-a82b-4ffd-a043-d505433e7102 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:24.396785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be34dd-a82b-4ffd-a043-d505433e7102 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:24.412786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-30be34dd-a82b-4ffd-a043-d505433e7102 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 21:34:24.412786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:24.412786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:24.412786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:24.412786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:24.412786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:24.412786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:24.412786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:24.412786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:24.412786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:24.412786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:24.412786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:24.412786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:34:24.412786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:34:24.412786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:34:24.412786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:34:24.413785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:24.413785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:24.413785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:34:24.413785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:34:24.413785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:34:24.413785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:34:24.413785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:24.413785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:24.413785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:24.413785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:24.413785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:24.413785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:24.413785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:24.413785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:24.413785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:24.413785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:24.413785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:24.413785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:24.414831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:24.414831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:24.414831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:34:24.414831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:34:24.414831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:34:24.414831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:34:24.414831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:34:24.414831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:34:24.414831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 21:34:24.414831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:24.414831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 505/1036] 10.222.0.11 () {56 vars in 1093 bytes} [Wed May 4 21:34:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:24.419663 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be34dd-a82b-4ffd-a043-d505433e7102 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:24.420419 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce81080-c61f-41d9-bc08-223340863f35 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:24.454658 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749762f-34c4-4846-89b8-3e6d2a866f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:24.455392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749762f-34c4-4846-89b8-3e6d2a866f47 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:24.455681 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749762f-34c4-4846-89b8-3e6d2a866f47 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:24.455967 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749762f-34c4-4846-89b8-3e6d2a866f47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:24.457290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749762f-34c4-4846-89b8-3e6d2a866f47 None admin] RBAC: Adding query filter params (interface=public, service_id=1bdf681eca674b30a7b38a4263db7af9, region_id=RegionOne) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:24.457290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749762f-34c4-4846-89b8-3e6d2a866f47 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:24.458426 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749762f-34c4-4846-89b8-3e6d2a866f47 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:24.463750 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 532/1037] 10.222.0.11 () {56 vars in 1251 bytes} [Wed May 4 21:34:24 2022] GET /identity/v3/endpoints?service_id=1bdf681eca674b30a7b38a4263db7af9&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:24.469112 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749762f-34c4-4846-89b8-3e6d2a866f47 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:24.519452 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be34dd-a82b-4ffd-a043-d505433e7102 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:24.554610 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d11caf-f886-4791-ad6b-ba2300f22b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:24.555383 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d11caf-f886-4791-ad6b-ba2300f22b16 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:24.555666 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d11caf-f886-4791-ad6b-ba2300f22b16 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:24.555949 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d11caf-f886-4791-ad6b-ba2300f22b16 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:24.556785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d11caf-f886-4791-ad6b-ba2300f22b16 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:24.557097 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d11caf-f886-4791-ad6b-ba2300f22b16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:24.558530 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d11caf-f886-4791-ad6b-ba2300f22b16 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:24.570215 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749762f-34c4-4846-89b8-3e6d2a866f47 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:24.578362 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 506/1038] 10.222.0.11 () {56 vars in 1133 bytes} [Wed May 4 21:34:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:24.583864 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d11caf-f886-4791-ad6b-ba2300f22b16 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:24.607324 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ae45b-a505-4f19-9ffa-fa5ba27292b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:24.607993 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ae45b-a505-4f19-9ffa-fa5ba27292b5 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:24.608273 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ae45b-a505-4f19-9ffa-fa5ba27292b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:24.608546 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ae45b-a505-4f19-9ffa-fa5ba27292b5 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:24.609218 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ae45b-a505-4f19-9ffa-fa5ba27292b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:24.610579 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ae45b-a505-4f19-9ffa-fa5ba27292b5 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:24.617065 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 533/1039] 10.222.0.11 () {56 vars in 1087 bytes} [Wed May 4 21:34:24 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:34:24.689633 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d11caf-f886-4791-ad6b-ba2300f22b16 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:24.726928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacd225-e820-4896-91ba-f9203349ab6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:24.727650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacd225-e820-4896-91ba-f9203349ab6f None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:24.727859 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacd225-e820-4896-91ba-f9203349ab6f None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:24.728117 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacd225-e820-4896-91ba-f9203349ab6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:24.799666 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaacd225-e820-4896-91ba-f9203349ab6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:24.801040 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaacd225-e820-4896-91ba-f9203349ab6f None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:24.895532 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 507/1040] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:34:24 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 21:34:24.901620 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ae45b-a505-4f19-9ffa-fa5ba27292b5 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:25.005677 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ae45b-a505-4f19-9ffa-fa5ba27292b5 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:25.039655 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929a045-6323-4357-a82f-f13961d98f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:25.040455 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929a045-6323-4357-a82f-f13961d98f5c None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:25.040736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929a045-6323-4357-a82f-f13961d98f5c None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:25.041012 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929a045-6323-4357-a82f-f13961d98f5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:25.051810 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929a045-6323-4357-a82f-f13961d98f5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:25.053186 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929a045-6323-4357-a82f-f13961d98f5c None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:25.069914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-a929a045-6323-4357-a82f-f13961d98f5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:25.069914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:25.069914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:25.069914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:25.069914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:25.069914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:25.069914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:25.069914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:25.069914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:25.069914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:25.069914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:25.069914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:25.069914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:34:25.069914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:34:25.069914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:34:25.070846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:34:25.070846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:25.070846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:25.070846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:25.070846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:25.070846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:25.070846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:25.070846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:25.070846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:25.070846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:25.070846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:25.070846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:25.070846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:25.070846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:25.070846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:25.070846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:25.070846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:25.071789 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:34:25.071789 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:34:25.071789 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:25.071789 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:25.075178 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 534/1041] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:25.077643 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacd225-e820-4896-91ba-f9203349ab6f None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:25.175187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacd225-e820-4896-91ba-f9203349ab6f None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:25.207725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f84b0a-c843-4bc4-b08e-0978ed1a146f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:25.208390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84b0a-c843-4bc4-b08e-0978ed1a146f None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:25.208674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84b0a-c843-4bc4-b08e-0978ed1a146f None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:25.208925 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84b0a-c843-4bc4-b08e-0978ed1a146f None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:25.209674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f84b0a-c843-4bc4-b08e-0978ed1a146f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:25.209982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f84b0a-c843-4bc4-b08e-0978ed1a146f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:25.211431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f84b0a-c843-4bc4-b08e-0978ed1a146f None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:25.223503 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 508/1042] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:25.229220 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929a045-6323-4357-a82f-f13961d98f5c None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:25.329228 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929a045-6323-4357-a82f-f13961d98f5c None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:25.363004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a147360-e4ce-4436-8735-c72df1024be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:25.363819 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a147360-e4ce-4436-8735-c72df1024be0 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:25.364090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a147360-e4ce-4436-8735-c72df1024be0 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:25.364363 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a147360-e4ce-4436-8735-c72df1024be0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:25.370919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a147360-e4ce-4436-8735-c72df1024be0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:25.372437 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a147360-e4ce-4436-8735-c72df1024be0 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:25.386204 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-5a147360-e4ce-4436-8735-c72df1024be0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:34:25.386204 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:25.386204 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:25.386204 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:25.386204 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:25.386204 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:25.386204 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:25.386204 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:25.386204 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:25.386204 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:25.386204 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:25.386204 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:25.386204 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:34:25.386204 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:34:25.386204 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:34:25.387442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:34:25.387442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:25.387442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:25.387442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:25.387442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:25.387442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:25.387442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:25.387442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:25.387442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:25.387442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:25.387442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:25.387442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:25.387442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:25.387442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:25.387442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:25.387442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:25.387442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:25.388368 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:34:25.388368 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:34:25.388368 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:34:25.388368 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:34:25.388368 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:34:25.388368 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:34:25.388368 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:34:25.388368 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:25.388368 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 535/1043] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:34:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:25.394862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f84b0a-c843-4bc4-b08e-0978ed1a146f None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:25.499220 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f84b0a-c843-4bc4-b08e-0978ed1a146f None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:25.531612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e9ba7-3ffc-47ef-add1-111f2802b80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:25.532272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e9ba7-3ffc-47ef-add1-111f2802b80a None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:25.532552 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e9ba7-3ffc-47ef-add1-111f2802b80a None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:25.532827 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e9ba7-3ffc-47ef-add1-111f2802b80a None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:25.533608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e9ba7-3ffc-47ef-add1-111f2802b80a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:25.533915 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e9ba7-3ffc-47ef-add1-111f2802b80a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:25.535366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e9ba7-3ffc-47ef-add1-111f2802b80a None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:25.547644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 509/1044] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:34:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:25.553582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a147360-e4ce-4436-8735-c72df1024be0 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:25.630905 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30962d52-ec69-4b04-b009-a60e087d70d9 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:25.631300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30962d52-ec69-4b04-b009-a60e087d70d9 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:25.631452 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30962d52-ec69-4b04-b009-a60e087d70d9 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:25.633059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 510/1045] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:34:25.637919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68790ed-e5ed-45bf-9afc-41a76a9c3fcd None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:25.638177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68790ed-e5ed-45bf-9afc-41a76a9c3fcd None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:25.638454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68790ed-e5ed-45bf-9afc-41a76a9c3fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:25.655120 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-b68790ed-e5ed-45bf-9afc-41a76a9c3fcd None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:25.656421 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b68790ed-e5ed-45bf-9afc-41a76a9c3fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:25.660589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a147360-e4ce-4436-8735-c72df1024be0 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:25.693589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e454e0c-f499-484a-aff9-2e7bd02ac019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:25.694243 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e454e0c-f499-484a-aff9-2e7bd02ac019 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:25.694525 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e454e0c-f499-484a-aff9-2e7bd02ac019 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:25.694800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e454e0c-f499-484a-aff9-2e7bd02ac019 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:25.695728 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e454e0c-f499-484a-aff9-2e7bd02ac019 None admin] RBAC: Adding query filter params (role.id=5a587c5dea3b4b7fbcaf94adf45c8b31, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=f4f207481ccb4cfcbbcffd9df73d2985) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:25.696040 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e454e0c-f499-484a-aff9-2e7bd02ac019 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:25.697460 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e454e0c-f499-484a-aff9-2e7bd02ac019 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:25.702994 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 536/1046] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:34:25 2022] GET /identity/v3/role_assignments?user.id=f4f207481ccb4cfcbbcffd9df73d2985&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=5a587c5dea3b4b7fbcaf94adf45c8b31 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:25.733078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 511/1047] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:34:25.755242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e454e0c-f499-484a-aff9-2e7bd02ac019 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:25.872600 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e454e0c-f499-484a-aff9-2e7bd02ac019 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:25.906191 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b9321-f67b-4ce4-b9d2-745fc754f3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:25.906994 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b9321-f67b-4ce4-b9d2-745fc754f3ee None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:25.907303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b9321-f67b-4ce4-b9d2-745fc754f3ee None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:25.907574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b9321-f67b-4ce4-b9d2-745fc754f3ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:25.917353 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b9321-f67b-4ce4-b9d2-745fc754f3ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:34:25.924891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-c74b9321-f67b-4ce4-b9d2-745fc754f3ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:34:25.924891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:25.924891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:25.924891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:25.924891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:25.924891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:25.924891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:25.924891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:25.924891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:25.924891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:25.924891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:25.924891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:25.924891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:34:25.924891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:34:25.924891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:34:25.924891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:34:25.925831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:34:25.925831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:34:25.925831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:34:25.925831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:34:25.925831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:25.925831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:25.925831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:25.925831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:25.925831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:25.925831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:25.925831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:25.925831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:25.925831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:25.925831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:25.925831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:25.925831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:25.926687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:25.926687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:25.926687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:25.926687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:25.926687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:34:25.926687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:34:25.926687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:34:25.926687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:34:25.926687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:34:25.926687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:34:25.926687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:34:25.926687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:25.926687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 537/1048] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:34:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:25.932453 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68790ed-e5ed-45bf-9afc-41a76a9c3fcd None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:26.027961 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68790ed-e5ed-45bf-9afc-41a76a9c3fcd None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:26.062030 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347d183-ff4d-4b69-8da0-24cb80e164da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:26.063060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347d183-ff4d-4b69-8da0-24cb80e164da None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:26.063563 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347d183-ff4d-4b69-8da0-24cb80e164da None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:26.064037 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347d183-ff4d-4b69-8da0-24cb80e164da None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:26.064969 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347d183-ff4d-4b69-8da0-24cb80e164da None admin] RBAC: Adding query filter params (name=admin) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:26.065466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347d183-ff4d-4b69-8da0-24cb80e164da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:26.067012 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347d183-ff4d-4b69-8da0-24cb80e164da None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:26.075822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 512/1049] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:34:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:26.081896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b9321-f67b-4ce4-b9d2-745fc754f3ee None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:26.180356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b9321-f67b-4ce4-b9d2-745fc754f3ee None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:26.214869 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717cb79-c31a-4a14-acd4-52ec08d1c131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:26.215854 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717cb79-c31a-4a14-acd4-52ec08d1c131 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:26.216101 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717cb79-c31a-4a14-acd4-52ec08d1c131 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:26.216402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717cb79-c31a-4a14-acd4-52ec08d1c131 None admin] PATH_INFO: `/v3/users/5694596415424d1cbfdbd6136c16d28b` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:26.230570 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717cb79-c31a-4a14-acd4-52ec08d1c131 None admin] RBAC: Authorizing `identity:get_user(user_id=5694596415424d1cbfdbd6136c16d28b)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:26.232068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717cb79-c31a-4a14-acd4-52ec08d1c131 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:26.233945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 538/1050] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:34:26 2022] GET /identity/v3/users/5694596415424d1cbfdbd6136c16d28b => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:26.240020 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347d183-ff4d-4b69-8da0-24cb80e164da None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:26.357806 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347d183-ff4d-4b69-8da0-24cb80e164da None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:26.395703 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168e1e6-b24f-4f4d-9ba6-b1c8e555a9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:26.396361 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168e1e6-b24f-4f4d-9ba6-b1c8e555a9b4 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:26.396643 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168e1e6-b24f-4f4d-9ba6-b1c8e555a9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:26.396923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168e1e6-b24f-4f4d-9ba6-b1c8e555a9b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:26.466578 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168e1e6-b24f-4f4d-9ba6-b1c8e555a9b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:26.467981 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168e1e6-b24f-4f4d-9ba6-b1c8e555a9b4 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:26.565964 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 513/1051] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:34:26 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:34:26.573076 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717cb79-c31a-4a14-acd4-52ec08d1c131 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:26.680233 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717cb79-c31a-4a14-acd4-52ec08d1c131 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:26.720426 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da1921-df58-45fc-aeeb-5bca321a1498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:26.721235 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da1921-df58-45fc-aeeb-5bca321a1498 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:26.721521 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da1921-df58-45fc-aeeb-5bca321a1498 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:26.721782 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da1921-df58-45fc-aeeb-5bca321a1498 None admin] PATH_INFO: `/v3/projects/bb8365ff218d4747adcfa5391109fa50` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:26.723393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da1921-df58-45fc-aeeb-5bca321a1498 None admin] RBAC: Authorizing `identity:get_project(project_id=bb8365ff218d4747adcfa5391109fa50)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:26.724818 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da1921-df58-45fc-aeeb-5bca321a1498 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:26.726880 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 539/1052] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:34:26 2022] GET /identity/v3/projects/bb8365ff218d4747adcfa5391109fa50 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:26.733385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168e1e6-b24f-4f4d-9ba6-b1c8e555a9b4 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:26.833533 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168e1e6-b24f-4f4d-9ba6-b1c8e555a9b4 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:26.868431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981f089-7a7d-48a2-8c17-147dd8941a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:26.869085 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981f089-7a7d-48a2-8c17-147dd8941a87 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:26.869364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981f089-7a7d-48a2-8c17-147dd8941a87 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:26.869642 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981f089-7a7d-48a2-8c17-147dd8941a87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:26.870466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981f089-7a7d-48a2-8c17-147dd8941a87 None admin] RBAC: Adding query filter params (role.id=59778f07f0504e90a60212f460e8c774, scope.project.id=bb8365ff218d4747adcfa5391109fa50, user.id=5694596415424d1cbfdbd6136c16d28b) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:26.870774 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981f089-7a7d-48a2-8c17-147dd8941a87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:26.872233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981f089-7a7d-48a2-8c17-147dd8941a87 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:26.877548 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0b2e5-5cf4-4bb1-8863-053819c56ded None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:26.877839 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0b2e5-5cf4-4bb1-8863-053819c56ded None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:26.883225 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0b2e5-5cf4-4bb1-8863-053819c56ded None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:26.883385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 514/1053] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:34:26 2022] GET /identity/v3/role_assignments?user.id=5694596415424d1cbfdbd6136c16d28b&scope.project.id=bb8365ff218d4747adcfa5391109fa50&role.id=59778f07f0504e90a60212f460e8c774 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:26.883466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 540/1054] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:26.885304 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f1376-baab-4618-8269-c5cc454c0143 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:26.885589 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f1376-baab-4618-8269-c5cc454c0143 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:26.885864 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f1376-baab-4618-8269-c5cc454c0143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:26.903708 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-ba1f1376-baab-4618-8269-c5cc454c0143 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:26.904922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ba1f1376-baab-4618-8269-c5cc454c0143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:26.978557 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 515/1055] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:34:27.001837 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0b2e5-5cf4-4bb1-8863-053819c56ded None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:27.105295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0b2e5-5cf4-4bb1-8863-053819c56ded None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:27.137771 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311256d-c637-40ff-b77b-c6f0b8dc1289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:27.138919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311256d-c637-40ff-b77b-c6f0b8dc1289 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:27.139369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311256d-c637-40ff-b77b-c6f0b8dc1289 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:27.139828 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311256d-c637-40ff-b77b-c6f0b8dc1289 None admin] PATH_INFO: `/v3/services/image` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:27.140675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311256d-c637-40ff-b77b-c6f0b8dc1289 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:27.142171 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311256d-c637-40ff-b77b-c6f0b8dc1289 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:27.154051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-4311256d-c637-40ff-b77b-c6f0b8dc1289 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 21:34:27.154051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:27.154051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:34:27.154051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:34:27.154051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:34:27.154051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:34:27.154051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:34:27.154051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:27.154051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 21:34:27.154051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:27.154051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:34:27.154051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:27.154051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:27.154051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:27.154051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:27.154051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:27.154051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:27.155117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:27.155117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:27.155117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:27.155117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:27.155117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:27.155117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:27.155117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:34:27.155117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:34:27.155117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:34:27.155117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:34:27.155117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:27.155117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:27.155117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:27.155117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:27.155117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:27.155117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:27.155972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:27.155972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:27.155972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:27.155972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:27.155972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:27.155972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:27.155972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:27.155972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:27.155972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:27.155972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:27.155972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:34:27.155972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:34:27.155972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 21:34:27.155972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:27.155972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 541/1056] 10.222.0.11 () {56 vars in 1105 bytes} [Wed May 4 21:34:27 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:27.161336 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f1376-baab-4618-8269-c5cc454c0143 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:27.258791 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f1376-baab-4618-8269-c5cc454c0143 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:27.293509 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce69e9-9000-4809-a245-19aba51335db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:27.294175 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce69e9-9000-4809-a245-19aba51335db None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:27.294455 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce69e9-9000-4809-a245-19aba51335db None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:27.294713 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce69e9-9000-4809-a245-19aba51335db None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:27.295451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce69e9-9000-4809-a245-19aba51335db None admin] RBAC: Adding query filter params (name=image) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:27.295762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce69e9-9000-4809-a245-19aba51335db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:27.297130 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce69e9-9000-4809-a245-19aba51335db None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:27.302141 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 516/1057] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:27.308036 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311256d-c637-40ff-b77b-c6f0b8dc1289 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:27.406721 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311256d-c637-40ff-b77b-c6f0b8dc1289 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:27.440688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf359f58-85f0-429f-a884-2e60f094ff53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:27.441349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf359f58-85f0-429f-a884-2e60f094ff53 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:27.441636 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf359f58-85f0-429f-a884-2e60f094ff53 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:27.441910 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf359f58-85f0-429f-a884-2e60f094ff53 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:27.442615 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf359f58-85f0-429f-a884-2e60f094ff53 None admin] RBAC: Adding query filter params (type=image) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:27.442920 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf359f58-85f0-429f-a884-2e60f094ff53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:27.444315 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf359f58-85f0-429f-a884-2e60f094ff53 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:27.449278 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 542/1058] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:27.455009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce69e9-9000-4809-a245-19aba51335db None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:27.550999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce69e9-9000-4809-a245-19aba51335db None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:27.592761 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93be32-1895-4954-b749-598616d6e328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:27.593436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93be32-1895-4954-b749-598616d6e328 None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:27.593717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93be32-1895-4954-b749-598616d6e328 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:27.593993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93be32-1895-4954-b749-598616d6e328 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:27.594730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93be32-1895-4954-b749-598616d6e328 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:27.596153 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93be32-1895-4954-b749-598616d6e328 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:27.623073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 517/1059] 10.222.0.11 () {60 vars in 1144 bytes} [Wed May 4 21:34:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:34:27.924397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22e906-06dd-4008-b051-4e5e8ba00d05 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:27.924723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22e906-06dd-4008-b051-4e5e8ba00d05 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:27.924963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22e906-06dd-4008-b051-4e5e8ba00d05 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:27.926529 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 543/1060] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:27.932009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362ddc6-be84-47b8-9e09-530666a40ded None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:27.932303 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362ddc6-be84-47b8-9e09-530666a40ded None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:27.932581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362ddc6-be84-47b8-9e09-530666a40ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:27.949893 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-1362ddc6-be84-47b8-9e09-530666a40ded None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:27.951078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-1362ddc6-be84-47b8-9e09-530666a40ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:28.027942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 518/1061] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:28.050815 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22e906-06dd-4008-b051-4e5e8ba00d05 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:28.149680 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22e906-06dd-4008-b051-4e5e8ba00d05 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:28.180881 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1cdad1-7405-4e24-b9c9-cdaceb2040e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:28.181680 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cdad1-7405-4e24-b9c9-cdaceb2040e7 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:28.181960 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cdad1-7405-4e24-b9c9-cdaceb2040e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:28.182260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cdad1-7405-4e24-b9c9-cdaceb2040e7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:28.192682 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1cdad1-7405-4e24-b9c9-cdaceb2040e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:34:28.201070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-9c1cdad1-7405-4e24-b9c9-cdaceb2040e7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:34:28.201070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:28.201070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:28.201070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:28.201070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:28.201070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:28.201070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:28.201070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:28.201070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:28.201070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:28.201070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:28.201070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:28.201070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:34:28.201070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:34:28.201070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:34:28.201070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:34:28.202013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:34:28.202013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:34:28.202013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:34:28.202013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:34:28.202013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:28.202013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:28.202013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:28.202013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:28.202013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:28.202013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:28.202013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:28.202013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:28.202013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:28.202013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:28.202013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:28.202013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:28.212780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:28.212780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:28.212780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:28.212780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:28.212780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:34:28.212780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:34:28.212780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:34:28.212780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:34:28.212780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:34:28.212780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:34:28.212780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:34:28.212780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:28.212780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 544/1062] 10.222.0.11 () {56 vars in 1120 bytes} [Wed May 4 21:34:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:28.214454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362ddc6-be84-47b8-9e09-530666a40ded None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:28.309391 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362ddc6-be84-47b8-9e09-530666a40ded None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:28.343809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6bc03-0fd4-4505-9fe9-191f2cd0db4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:28.344484 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6bc03-0fd4-4505-9fe9-191f2cd0db4e None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:28.344764 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6bc03-0fd4-4505-9fe9-191f2cd0db4e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:28.345038 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6bc03-0fd4-4505-9fe9-191f2cd0db4e None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:28.345784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6bc03-0fd4-4505-9fe9-191f2cd0db4e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:28.346090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6bc03-0fd4-4505-9fe9-191f2cd0db4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:28.347486 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6bc03-0fd4-4505-9fe9-191f2cd0db4e None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:28.360564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 519/1063] 10.222.0.11 () {56 vars in 1115 bytes} [Wed May 4 21:34:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:28.362261 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1cdad1-7405-4e24-b9c9-cdaceb2040e7 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:28.458115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1cdad1-7405-4e24-b9c9-cdaceb2040e7 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:28.492972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454c7cf-3d58-420a-8da2-344838249c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:28.494086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454c7cf-3d58-420a-8da2-344838249c8d None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:28.494633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454c7cf-3d58-420a-8da2-344838249c8d None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:28.495113 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454c7cf-3d58-420a-8da2-344838249c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:28.505693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454c7cf-3d58-420a-8da2-344838249c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:28.507388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454c7cf-3d58-420a-8da2-344838249c8d None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:28.525028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-9454c7cf-3d58-420a-8da2-344838249c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:28.525028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:28.525028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:28.525028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:28.525028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:28.525028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:28.525028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:28.525028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:28.525028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:28.525028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:28.525028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:28.525028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:28.525028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:34:28.525028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:34:28.525028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:34:28.526055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:34:28.526055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:28.526055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:28.526055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:28.526055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:28.526055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:28.526055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:28.526055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:28.526055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:28.526055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:28.526055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:28.526055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:28.526055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:28.526055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:28.526055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:28.526055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:28.526055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:28.526958 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:34:28.526958 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:34:28.526958 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:28.526958 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:28.531112 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 545/1064] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:34:28.533602 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6bc03-0fd4-4505-9fe9-191f2cd0db4e None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:28.641137 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6bc03-0fd4-4505-9fe9-191f2cd0db4e None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:28.674293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ca200-636b-48d8-9e9d-e1411aa00bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:28.674966 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ca200-636b-48d8-9e9d-e1411aa00bd2 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:28.675316 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ca200-636b-48d8-9e9d-e1411aa00bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:28.675603 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ca200-636b-48d8-9e9d-e1411aa00bd2 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:28.676349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ca200-636b-48d8-9e9d-e1411aa00bd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:28.676654 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ca200-636b-48d8-9e9d-e1411aa00bd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:28.678023 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ca200-636b-48d8-9e9d-e1411aa00bd2 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:28.690073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 520/1065] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:28.695816 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454c7cf-3d58-420a-8da2-344838249c8d None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:28.798041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454c7cf-3d58-420a-8da2-344838249c8d None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:28.831750 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def46aae-d506-477c-a2fd-a777af8b33f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:28.832548 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def46aae-d506-477c-a2fd-a777af8b33f5 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:28.832835 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def46aae-d506-477c-a2fd-a777af8b33f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:28.833111 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def46aae-d506-477c-a2fd-a777af8b33f5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:28.840781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def46aae-d506-477c-a2fd-a777af8b33f5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:28.842224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def46aae-d506-477c-a2fd-a777af8b33f5 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:28.856115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-def46aae-d506-477c-a2fd-a777af8b33f5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 21:34:28.856115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:28.856115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:28.856115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:28.856115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:28.856115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:28.856115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:28.856115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:28.856115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:28.856115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:28.856115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:28.856115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:28.856115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:34:28.856115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:34:28.856115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:34:28.856115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:34:28.857064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:28.857064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:28.857064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:34:28.857064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:34:28.857064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:34:28.857064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:34:28.857064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:28.857064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:28.857064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:28.857064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:28.857064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:28.857064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:28.857064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:28.857064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:28.857064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:28.857064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:28.857064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:28.857064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:28.858009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:28.858009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:28.858009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:34:28.858009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:34:28.858009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:34:28.858009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:34:28.858009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:34:28.858009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:34:28.858009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 21:34:28.858009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:28.862089 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 546/1066] 10.222.0.11 () {56 vars in 1093 bytes} [Wed May 4 21:34:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:28.863380 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ca200-636b-48d8-9e9d-e1411aa00bd2 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:28.964220 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ca200-636b-48d8-9e9d-e1411aa00bd2 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:28.998705 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be76d66-9984-451e-b6e7-e94a465dc4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:28.999428 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be76d66-9984-451e-b6e7-e94a465dc4f5 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:28.999712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be76d66-9984-451e-b6e7-e94a465dc4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:28.999987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be76d66-9984-451e-b6e7-e94a465dc4f5 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:29.000832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be76d66-9984-451e-b6e7-e94a465dc4f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:29.001143 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be76d66-9984-451e-b6e7-e94a465dc4f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:29.002585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be76d66-9984-451e-b6e7-e94a465dc4f5 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:29.020098 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 521/1067] 10.222.0.11 () {56 vars in 1133 bytes} [Wed May 4 21:34:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:29.025637 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def46aae-d506-477c-a2fd-a777af8b33f5 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:29.099329 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378ff3f-3b34-43ff-9a09-4d476744350d None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:29.099834 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378ff3f-3b34-43ff-9a09-4d476744350d None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:29.099834 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378ff3f-3b34-43ff-9a09-4d476744350d None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:29.101309 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 522/1068] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:34:29.107077 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997feea-0e52-499e-ac2b-c9807545036f None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:29.107357 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997feea-0e52-499e-ac2b-c9807545036f None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:29.107642 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997feea-0e52-499e-ac2b-c9807545036f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:29.123897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def46aae-d506-477c-a2fd-a777af8b33f5 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:29.125060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-1997feea-0e52-499e-ac2b-c9807545036f None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:29.126276 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-1997feea-0e52-499e-ac2b-c9807545036f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:29.157070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f53d0f-efec-4a6b-ad72-678ba066706b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:29.157868 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f53d0f-efec-4a6b-ad72-678ba066706b None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:29.158150 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f53d0f-efec-4a6b-ad72-678ba066706b None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:29.158428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f53d0f-efec-4a6b-ad72-678ba066706b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:29.169191 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f53d0f-efec-4a6b-ad72-678ba066706b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:29.170695 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f53d0f-efec-4a6b-ad72-678ba066706b None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:29.187393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-47f53d0f-efec-4a6b-ad72-678ba066706b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:29.187393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:29.187393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:29.187393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:29.187393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:29.187393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:29.187393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:29.187393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:29.187393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:29.187393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:29.187393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:29.187393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:29.187393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:34:29.187393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:34:29.187393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:34:29.188334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:34:29.188334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:29.188334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:29.188334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:29.188334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:29.188334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:29.188334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:29.188334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:29.188334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:29.188334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:29.188334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:29.188334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:29.188334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:29.188334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:29.188334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:29.188334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:29.188334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:29.189242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:34:29.189242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:34:29.189242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:29.189242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:29.189242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 547/1069] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:29.194242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f53d0f-efec-4a6b-ad72-678ba066706b None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:29.194403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 523/1070] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:29.216782 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997feea-0e52-499e-ac2b-c9807545036f None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:29.290246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f53d0f-efec-4a6b-ad72-678ba066706b None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:29.311328 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997feea-0e52-499e-ac2b-c9807545036f None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:29.322834 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c654860-9d2c-4e14-9fa3-228a55d81118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:29.323541 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c654860-9d2c-4e14-9fa3-228a55d81118 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:29.323827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c654860-9d2c-4e14-9fa3-228a55d81118 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:29.324151 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c654860-9d2c-4e14-9fa3-228a55d81118 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:29.325109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c654860-9d2c-4e14-9fa3-228a55d81118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:29.325109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c654860-9d2c-4e14-9fa3-228a55d81118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:29.326503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c654860-9d2c-4e14-9fa3-228a55d81118 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:29.342875 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 548/1071] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:29.343887 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c654860-9d2c-4e14-9fa3-228a55d81118 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:29.350149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881352b3-1f57-47d1-b86d-c17ce0d5a851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:29.350887 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881352b3-1f57-47d1-b86d-c17ce0d5a851 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:29.351215 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881352b3-1f57-47d1-b86d-c17ce0d5a851 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:29.351548 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881352b3-1f57-47d1-b86d-c17ce0d5a851 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:29.361716 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881352b3-1f57-47d1-b86d-c17ce0d5a851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:34:29.369264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-881352b3-1f57-47d1-b86d-c17ce0d5a851 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:34:29.369264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:29.369264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:29.369264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:29.369264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:29.369264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:29.369264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:29.369264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:29.369264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:29.369264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:29.369264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:29.369264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:29.369264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:34:29.369264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:34:29.369264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:34:29.369264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:34:29.370193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:34:29.370193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:34:29.370193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:34:29.370193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:34:29.370193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:29.370193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:29.370193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:29.370193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:29.370193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:29.370193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:29.370193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:29.370193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:29.370193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:29.370193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:29.370193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:29.370193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:29.371073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:29.371073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:29.371073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:29.371073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:29.371073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:34:29.371073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:34:29.371073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:34:29.371073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:34:29.371073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:34:29.371073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:34:29.371073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:34:29.371073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:29.375619 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 524/1072] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:34:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:34:29.376715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881352b3-1f57-47d1-b86d-c17ce0d5a851 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:29.437669 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c654860-9d2c-4e14-9fa3-228a55d81118 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:29.470954 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79cad0-8289-4f41-940f-ecac0373b016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:29.471777 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79cad0-8289-4f41-940f-ecac0373b016 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:29.472065 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79cad0-8289-4f41-940f-ecac0373b016 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:29.472335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79cad0-8289-4f41-940f-ecac0373b016 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:29.474703 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881352b3-1f57-47d1-b86d-c17ce0d5a851 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:29.479239 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79cad0-8289-4f41-940f-ecac0373b016 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:29.480699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79cad0-8289-4f41-940f-ecac0373b016 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:29.494331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-0d79cad0-8289-4f41-940f-ecac0373b016 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:34:29.494331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:29.494331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:29.494331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:29.494331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:29.494331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:29.494331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:29.494331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:29.494331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:29.494331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:29.494331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:29.494331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:29.494331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:34:29.494331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:34:29.494331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:34:29.495414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:34:29.495414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:29.495414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:29.495414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:29.495414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:29.495414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:29.495414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:29.495414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:29.495414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:29.495414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:29.495414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:29.495414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:29.495414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:29.495414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:29.495414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:29.495414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:29.495414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:29.496302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:34:29.496302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:34:29.496302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:34:29.496302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:34:29.496302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:34:29.496302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:34:29.496302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:34:29.496302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:29.496302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 549/1073] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:34:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:29.501263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79cad0-8289-4f41-940f-ecac0373b016 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:29.510736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccb5a0-fafc-4975-992c-c4cbe382f6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:29.511441 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccb5a0-fafc-4975-992c-c4cbe382f6ee None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:29.511740 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccb5a0-fafc-4975-992c-c4cbe382f6ee None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:29.512013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccb5a0-fafc-4975-992c-c4cbe382f6ee None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:29.512747 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ccb5a0-fafc-4975-992c-c4cbe382f6ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:29.513064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ccb5a0-fafc-4975-992c-c4cbe382f6ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:29.514440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ccb5a0-fafc-4975-992c-c4cbe382f6ee None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:29.527225 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 525/1074] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:34:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:29.528585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccb5a0-fafc-4975-992c-c4cbe382f6ee None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:29.597536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79cad0-8289-4f41-940f-ecac0373b016 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:29.630328 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655832e-3c83-4a87-a5d4-ea621d0d79b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:29.630927 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655832e-3c83-4a87-a5d4-ea621d0d79b9 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:29.631239 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655832e-3c83-4a87-a5d4-ea621d0d79b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:29.631514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655832e-3c83-4a87-a5d4-ea621d0d79b9 None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:29.632292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655832e-3c83-4a87-a5d4-ea621d0d79b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:29.632630 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655832e-3c83-4a87-a5d4-ea621d0d79b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:29.632817 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccb5a0-fafc-4975-992c-c4cbe382f6ee None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:29.634261 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655832e-3c83-4a87-a5d4-ea621d0d79b9 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:29.646057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 550/1075] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:34:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:29.652164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655832e-3c83-4a87-a5d4-ea621d0d79b9 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:29.665012 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21184504-097a-485a-b884-f2c8c9127eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:29.665891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21184504-097a-485a-b884-f2c8c9127eed None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:29.666174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21184504-097a-485a-b884-f2c8c9127eed None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:29.666445 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21184504-097a-485a-b884-f2c8c9127eed None admin] PATH_INFO: `/v3/users/5694596415424d1cbfdbd6136c16d28b` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:29.667671 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21184504-097a-485a-b884-f2c8c9127eed None admin] RBAC: Authorizing `identity:get_user(user_id=5694596415424d1cbfdbd6136c16d28b)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:29.669106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21184504-097a-485a-b884-f2c8c9127eed None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:29.670729 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 526/1076] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:34:29 2022] GET /identity/v3/users/5694596415424d1cbfdbd6136c16d28b => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:29.676744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21184504-097a-485a-b884-f2c8c9127eed None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:29.756884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655832e-3c83-4a87-a5d4-ea621d0d79b9 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:29.780961 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21184504-097a-485a-b884-f2c8c9127eed None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:29.791526 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115a51f-13dc-4da7-8bc6-bbe6fcb7db90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:29.792422 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a51f-13dc-4da7-8bc6-bbe6fcb7db90 None admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:29.792709 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a51f-13dc-4da7-8bc6-bbe6fcb7db90 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:29.792986 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a51f-13dc-4da7-8bc6-bbe6fcb7db90 None admin] PATH_INFO: `/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/f4f207481ccb4cfcbbcffd9df73d2985/roles/5a587c5dea3b4b7fbcaf94adf45c8b31` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:29.795397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115a51f-13dc-4da7-8bc6-bbe6fcb7db90 None admin] RBAC: Authorizing `identity:create_grant(project_id=3acb142d1aa34e18a018d3fdee8d7038, user_id=f4f207481ccb4cfcbbcffd9df73d2985, role_id=5a587c5dea3b4b7fbcaf94adf45c8b31)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:29.796824 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115a51f-13dc-4da7-8bc6-bbe6fcb7db90 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:29.811676 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 551/1077] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:34:29 2022] PUT /identity/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/f4f207481ccb4cfcbbcffd9df73d2985/roles/5a587c5dea3b4b7fbcaf94adf45c8b31 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:34:29.826887 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a82dd2-98fc-4aa1-98bc-47b04a2e8c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:29.828036 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a82dd2-98fc-4aa1-98bc-47b04a2e8c87 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:29.828331 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a82dd2-98fc-4aa1-98bc-47b04a2e8c87 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:29.828596 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a82dd2-98fc-4aa1-98bc-47b04a2e8c87 None admin] PATH_INFO: `/v3/projects/bb8365ff218d4747adcfa5391109fa50` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:29.829959 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a82dd2-98fc-4aa1-98bc-47b04a2e8c87 None admin] RBAC: Authorizing `identity:get_project(project_id=bb8365ff218d4747adcfa5391109fa50)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:29.831519 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a82dd2-98fc-4aa1-98bc-47b04a2e8c87 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:29.833522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 527/1078] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:34:29 2022] GET /identity/v3/projects/bb8365ff218d4747adcfa5391109fa50 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:29.840131 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115a51f-13dc-4da7-8bc6-bbe6fcb7db90 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:29.884673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e16e9-5ad8-40a6-9059-3d69821ad91a None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:29.884852 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e16e9-5ad8-40a6-9059-3d69821ad91a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:29.885125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e16e9-5ad8-40a6-9059-3d69821ad91a None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:29.886631 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 528/1079] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:34:29.891918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2d0ae-7dfa-4793-bdf0-c647242af3e7 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:29.892208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2d0ae-7dfa-4793-bdf0-c647242af3e7 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:29.892474 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2d0ae-7dfa-4793-bdf0-c647242af3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:29.910942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-38f2d0ae-7dfa-4793-bdf0-c647242af3e7 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:29.912196 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-38f2d0ae-7dfa-4793-bdf0-c647242af3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:29.945672 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115a51f-13dc-4da7-8bc6-bbe6fcb7db90 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:29.981078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd358f8c-bf25-4465-a002-779af96fada9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:29.981996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd358f8c-bf25-4465-a002-779af96fada9 None admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:29.982284 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd358f8c-bf25-4465-a002-779af96fada9 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:29.982567 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd358f8c-bf25-4465-a002-779af96fada9 None admin] PATH_INFO: `/v3/projects/bb8365ff218d4747adcfa5391109fa50/users/5694596415424d1cbfdbd6136c16d28b/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:29.987088 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 529/1080] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:34:29.987259 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd358f8c-bf25-4465-a002-779af96fada9 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb8365ff218d4747adcfa5391109fa50, user_id=5694596415424d1cbfdbd6136c16d28b, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:29.987259 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd358f8c-bf25-4465-a002-779af96fada9 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:30.001013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 552/1081] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:34:29 2022] PUT /identity/v3/projects/bb8365ff218d4747adcfa5391109fa50/users/5694596415424d1cbfdbd6136c16d28b/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:34:30.005029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2d0ae-7dfa-4793-bdf0-c647242af3e7 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:30.111709 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2d0ae-7dfa-4793-bdf0-c647242af3e7 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:30.148700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55eda5e-7ee0-4dc7-8274-a0ec70f0f1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:30.149290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eda5e-7ee0-4dc7-8274-a0ec70f0f1b1 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:30.149575 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eda5e-7ee0-4dc7-8274-a0ec70f0f1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:30.149852 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eda5e-7ee0-4dc7-8274-a0ec70f0f1b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:30.219625 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55eda5e-7ee0-4dc7-8274-a0ec70f0f1b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:30.221087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55eda5e-7ee0-4dc7-8274-a0ec70f0f1b1 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:30.317151 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 530/1082] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:34:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:34:30.323026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd358f8c-bf25-4465-a002-779af96fada9 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:30.426640 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd358f8c-bf25-4465-a002-779af96fada9 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:30.466723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca75e7f-a762-499e-a04e-ec6cf4985c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:30.467564 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca75e7f-a762-499e-a04e-ec6cf4985c85 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:30.467849 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca75e7f-a762-499e-a04e-ec6cf4985c85 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:30.468117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca75e7f-a762-499e-a04e-ec6cf4985c85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:30.478485 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca75e7f-a762-499e-a04e-ec6cf4985c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:30.479979 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca75e7f-a762-499e-a04e-ec6cf4985c85 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:30.497558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-3ca75e7f-a762-499e-a04e-ec6cf4985c85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:30.497558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:30.497558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:30.497558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:30.497558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:30.497558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:30.497558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:30.497558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:30.497558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:30.497558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:30.497558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:30.497558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:30.497558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:34:30.497558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:34:30.497558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:34:30.498571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:34:30.498571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:30.498571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:30.498571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:30.498571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:30.498571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:30.498571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:30.498571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:30.498571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:30.498571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:30.498571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:30.498571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:30.498571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:30.498571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:30.498571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:30.498571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:30.498571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:30.499524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:34:30.499524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:34:30.499524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:30.499524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:30.503154 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 553/1083] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:30.504825 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55eda5e-7ee0-4dc7-8274-a0ec70f0f1b1 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:30.607970 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55eda5e-7ee0-4dc7-8274-a0ec70f0f1b1 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:30.642043 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5aa1d0-472c-4f61-9499-88481906c84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:30.642715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5aa1d0-472c-4f61-9499-88481906c84a None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:30.644807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5aa1d0-472c-4f61-9499-88481906c84a None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:30.644807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5aa1d0-472c-4f61-9499-88481906c84a None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:30.644807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5aa1d0-472c-4f61-9499-88481906c84a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:30.644807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5aa1d0-472c-4f61-9499-88481906c84a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:30.645686 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5aa1d0-472c-4f61-9499-88481906c84a None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:30.657466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 531/1084] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:32.130597 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1d31d-ac87-4c08-9a37-27194c264f9a None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:32.131156 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1d31d-ac87-4c08-9a37-27194c264f9a None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:32.131156 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1d31d-ac87-4c08-9a37-27194c264f9a None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:32.132557 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 554/1085] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:32.138253 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfc55a-c670-48b8-aab9-d47c447c919b None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:32.138644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfc55a-c670-48b8-aab9-d47c447c919b None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:32.138838 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfc55a-c670-48b8-aab9-d47c447c919b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:32.156107 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-9abfc55a-c670-48b8-aab9-d47c447c919b None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:32.157310 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-9abfc55a-c670-48b8-aab9-d47c447c919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:32.232381 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 532/1086] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:32.255627 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1d31d-ac87-4c08-9a37-27194c264f9a None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:32.261738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b76af3-f894-4412-87ed-66eeb49f3e8b None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:32.262032 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b76af3-f894-4412-87ed-66eeb49f3e8b None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:32.262315 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b76af3-f894-4412-87ed-66eeb49f3e8b None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:32.263725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 533/1087] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:32.268796 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c07f1-fa49-4b43-84aa-e946e9275c1b None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:32.269085 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c07f1-fa49-4b43-84aa-e946e9275c1b None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:32.269367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c07f1-fa49-4b43-84aa-e946e9275c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:32.290396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-1c5c07f1-fa49-4b43-84aa-e946e9275c1b None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:32.291677 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-1c5c07f1-fa49-4b43-84aa-e946e9275c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:32.358185 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1d31d-ac87-4c08-9a37-27194c264f9a None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:32.361119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 534/1088] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:32.385540 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c07f1-fa49-4b43-84aa-e946e9275c1b None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:32.392301 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876a93a-83f5-44fb-855d-35aaf78e9b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:32.393109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876a93a-83f5-44fb-855d-35aaf78e9b8d None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:32.393391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876a93a-83f5-44fb-855d-35aaf78e9b8d None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:32.393662 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876a93a-83f5-44fb-855d-35aaf78e9b8d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:32.403981 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876a93a-83f5-44fb-855d-35aaf78e9b8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:34:32.411985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-f876a93a-83f5-44fb-855d-35aaf78e9b8d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:34:32.411985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:32.411985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:32.411985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:32.411985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:32.411985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:32.411985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:32.411985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:32.411985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:32.411985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:32.411985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:32.411985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:32.411985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:34:32.411985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:34:32.411985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:34:32.411985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:34:32.413019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:34:32.413019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:34:32.413019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:34:32.413019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:34:32.413019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:32.413019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:32.413019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:32.413019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:32.413019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:32.413019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:32.413019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:32.413019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:32.413019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:32.413019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:32.413019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:32.413019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:32.413968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:32.413968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:32.413968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:32.413968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:32.413968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:34:32.413968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:34:32.413968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:34:32.413968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:34:32.413968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:34:32.413968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:34:32.413968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:34:32.413968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:32.413968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 555/1089] 10.222.0.11 () {56 vars in 1120 bytes} [Wed May 4 21:34:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:32.419181 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876a93a-83f5-44fb-855d-35aaf78e9b8d None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:32.486596 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c07f1-fa49-4b43-84aa-e946e9275c1b None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:32.516774 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876a93a-83f5-44fb-855d-35aaf78e9b8d None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:32.520267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a949d86-dd67-4317-82cb-2ca58c1a69d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:32.521066 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a949d86-dd67-4317-82cb-2ca58c1a69d9 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:32.521350 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a949d86-dd67-4317-82cb-2ca58c1a69d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:32.521624 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a949d86-dd67-4317-82cb-2ca58c1a69d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:32.531837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a949d86-dd67-4317-82cb-2ca58c1a69d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:34:32.539450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-2a949d86-dd67-4317-82cb-2ca58c1a69d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:34:32.539450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:32.539450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:32.539450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:32.539450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:32.539450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:32.539450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:32.539450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:32.539450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:32.539450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:32.539450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:32.539450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:32.539450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:34:32.539450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:34:32.539450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:34:32.539450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:34:32.540407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:34:32.540407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:34:32.540407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:34:32.540407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:34:32.540407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:32.540407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:32.540407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:32.540407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:32.540407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:32.540407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:32.540407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:32.540407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:32.540407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:32.540407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:32.540407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:32.540407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:32.541269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:32.541269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:32.541269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:32.541269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:32.541269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:34:32.541269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:34:32.541269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:34:32.541269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:34:32.541269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:34:32.541269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:34:32.541269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:34:32.541269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:32.541269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 535/1090] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:34:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:32.546648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a949d86-dd67-4317-82cb-2ca58c1a69d9 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:32.551300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644f358-ae7f-45be-8c06-c13db85fdd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:32.551974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644f358-ae7f-45be-8c06-c13db85fdd3e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:32.552258 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644f358-ae7f-45be-8c06-c13db85fdd3e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:32.552533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644f358-ae7f-45be-8c06-c13db85fdd3e None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:32.553281 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644f358-ae7f-45be-8c06-c13db85fdd3e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:32.553589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644f358-ae7f-45be-8c06-c13db85fdd3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:32.554951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644f358-ae7f-45be-8c06-c13db85fdd3e None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:32.563511 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 556/1091] 10.222.0.11 () {56 vars in 1115 bytes} [Wed May 4 21:34:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:32.569345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644f358-ae7f-45be-8c06-c13db85fdd3e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:32.644881 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a949d86-dd67-4317-82cb-2ca58c1a69d9 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:32.663477 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644f358-ae7f-45be-8c06-c13db85fdd3e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:32.677194 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad53b2-3af7-4f69-aa97-38e4a627e3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:32.677859 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad53b2-3af7-4f69-aa97-38e4a627e3b0 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:32.678147 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad53b2-3af7-4f69-aa97-38e4a627e3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:32.678413 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad53b2-3af7-4f69-aa97-38e4a627e3b0 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:32.679184 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad53b2-3af7-4f69-aa97-38e4a627e3b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:32.679548 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad53b2-3af7-4f69-aa97-38e4a627e3b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:32.680909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad53b2-3af7-4f69-aa97-38e4a627e3b0 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:32.688692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 536/1092] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:34:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:32.694458 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad53b2-3af7-4f69-aa97-38e4a627e3b0 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:32.695309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514378ca-e92a-44b7-bb4a-71603f28ee94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:32.696106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514378ca-e92a-44b7-bb4a-71603f28ee94 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:32.696390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514378ca-e92a-44b7-bb4a-71603f28ee94 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:32.696664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514378ca-e92a-44b7-bb4a-71603f28ee94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:32.707448 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514378ca-e92a-44b7-bb4a-71603f28ee94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:32.708901 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514378ca-e92a-44b7-bb4a-71603f28ee94 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:32.726053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-514378ca-e92a-44b7-bb4a-71603f28ee94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:32.726053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:32.726053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:32.726053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:32.726053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:32.726053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:32.726053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:32.726053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:32.726053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:32.726053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:32.726053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:32.726053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:32.726053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:34:32.726053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:34:32.726053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:34:32.727030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:34:32.727030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:32.727030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:32.727030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:32.727030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:32.727030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:32.727030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:32.727030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:32.727030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:32.727030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:32.727030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:32.727030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:32.727030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:32.727030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:32.727030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:32.727030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:32.727030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:32.727967 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:34:32.727967 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:34:32.727967 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:32.727967 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:32.727967 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 557/1093] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:32.733031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514378ca-e92a-44b7-bb4a-71603f28ee94 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:32.787266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad53b2-3af7-4f69-aa97-38e4a627e3b0 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:32.818799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed737a2-8dc4-4e72-a231-4788a29f8526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:32.819740 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed737a2-8dc4-4e72-a231-4788a29f8526 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:32.820036 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed737a2-8dc4-4e72-a231-4788a29f8526 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:32.820308 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed737a2-8dc4-4e72-a231-4788a29f8526 None admin] PATH_INFO: `/v3/users/5694596415424d1cbfdbd6136c16d28b` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:32.821561 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed737a2-8dc4-4e72-a231-4788a29f8526 None admin] RBAC: Authorizing `identity:get_user(user_id=5694596415424d1cbfdbd6136c16d28b)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:32.822978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed737a2-8dc4-4e72-a231-4788a29f8526 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:32.824772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 537/1094] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:34:32 2022] GET /identity/v3/users/5694596415424d1cbfdbd6136c16d28b => generated 285 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:32.830019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514378ca-e92a-44b7-bb4a-71603f28ee94 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:32.830279 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed737a2-8dc4-4e72-a231-4788a29f8526 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:32.862482 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f0a65-3a0d-4276-a8e7-2e0b85ccca92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:32.863192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f0a65-3a0d-4276-a8e7-2e0b85ccca92 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:32.863471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f0a65-3a0d-4276-a8e7-2e0b85ccca92 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:32.863745 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f0a65-3a0d-4276-a8e7-2e0b85ccca92 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:32.864458 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f0a65-3a0d-4276-a8e7-2e0b85ccca92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:32.864758 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f0a65-3a0d-4276-a8e7-2e0b85ccca92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:32.866148 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f0a65-3a0d-4276-a8e7-2e0b85ccca92 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:32.877407 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 558/1095] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:32.883061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f0a65-3a0d-4276-a8e7-2e0b85ccca92 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:32.922140 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed737a2-8dc4-4e72-a231-4788a29f8526 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:32.953465 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4de82-d914-48c7-a42f-87972dc1f07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:32.954106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4de82-d914-48c7-a42f-87972dc1f07f None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:32.954386 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4de82-d914-48c7-a42f-87972dc1f07f None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:32.954663 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4de82-d914-48c7-a42f-87972dc1f07f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:32.975761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f0a65-3a0d-4276-a8e7-2e0b85ccca92 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:33.007297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84318ac-0b7c-4408-acdb-89b5637eae05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:33.008198 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84318ac-0b7c-4408-acdb-89b5637eae05 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:33.008475 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84318ac-0b7c-4408-acdb-89b5637eae05 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:33.008743 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84318ac-0b7c-4408-acdb-89b5637eae05 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:33.015397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84318ac-0b7c-4408-acdb-89b5637eae05 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:33.016837 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84318ac-0b7c-4408-acdb-89b5637eae05 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:33.018606 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4de82-d914-48c7-a42f-87972dc1f07f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:33.020072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4de82-d914-48c7-a42f-87972dc1f07f None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:33.030514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-f84318ac-0b7c-4408-acdb-89b5637eae05 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 21:34:33.030514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:33.030514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:33.030514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:33.030514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:33.030514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:33.030514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:33.030514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:33.030514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:33.030514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:33.030514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:33.030514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:33.030514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:34:33.030514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:34:33.030514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:34:33.030514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:34:33.031715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:33.031715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:33.031715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:34:33.031715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:34:33.031715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:34:33.031715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:34:33.031715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:33.031715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:33.031715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:33.031715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:33.031715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:33.031715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:33.031715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:33.031715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:33.031715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:33.031715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:33.031715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:33.031715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:33.032871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:33.032871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:33.032871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:34:33.032871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:34:33.032871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:34:33.032871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:34:33.032871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:34:33.032871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:34:33.032871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 21:34:33.032871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:33.032871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 559/1096] 10.222.0.11 () {56 vars in 1093 bytes} [Wed May 4 21:34:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:34:33.037527 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84318ac-0b7c-4408-acdb-89b5637eae05 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:33.119509 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 538/1097] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:34:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 21:34:33.125499 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4de82-d914-48c7-a42f-87972dc1f07f None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:33.130797 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84318ac-0b7c-4408-acdb-89b5637eae05 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:33.162574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2522c-ac6d-4c17-af62-1cdcdf6f129e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:33.163275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2522c-ac6d-4c17-af62-1cdcdf6f129e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:33.163560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2522c-ac6d-4c17-af62-1cdcdf6f129e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:33.163892 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2522c-ac6d-4c17-af62-1cdcdf6f129e None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:33.164728 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2522c-ac6d-4c17-af62-1cdcdf6f129e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:33.165036 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2522c-ac6d-4c17-af62-1cdcdf6f129e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:33.166464 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2522c-ac6d-4c17-af62-1cdcdf6f129e None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:33.182654 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 560/1098] 10.222.0.11 () {56 vars in 1133 bytes} [Wed May 4 21:34:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:33.188414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2522c-ac6d-4c17-af62-1cdcdf6f129e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:33.222645 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4de82-d914-48c7-a42f-87972dc1f07f None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:33.257296 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bb9a2-8ee5-42f8-bff9-decd1ce7b4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:33.258263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bb9a2-8ee5-42f8-bff9-decd1ce7b4fa None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:33.258532 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bb9a2-8ee5-42f8-bff9-decd1ce7b4fa None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:33.258800 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bb9a2-8ee5-42f8-bff9-decd1ce7b4fa None admin] PATH_INFO: `/v3/projects/bb8365ff218d4747adcfa5391109fa50` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:33.260076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bb9a2-8ee5-42f8-bff9-decd1ce7b4fa None admin] RBAC: Authorizing `identity:get_project(project_id=bb8365ff218d4747adcfa5391109fa50)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:33.261503 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bb9a2-8ee5-42f8-bff9-decd1ce7b4fa None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:33.263206 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 539/1099] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:34:33 2022] GET /identity/v3/projects/bb8365ff218d4747adcfa5391109fa50 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:33.269206 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bb9a2-8ee5-42f8-bff9-decd1ce7b4fa None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:33.282006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2522c-ac6d-4c17-af62-1cdcdf6f129e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:33.315785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1ba11-b66a-40bf-b21a-fd8c78305e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:33.316482 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1ba11-b66a-40bf-b21a-fd8c78305e24 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:33.316733 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1ba11-b66a-40bf-b21a-fd8c78305e24 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:33.317009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1ba11-b66a-40bf-b21a-fd8c78305e24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:33.363934 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bb9a2-8ee5-42f8-bff9-decd1ce7b4fa None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:33.381385 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1ba11-b66a-40bf-b21a-fd8c78305e24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:33.382930 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1ba11-b66a-40bf-b21a-fd8c78305e24 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:33.396913 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e50746-43da-41f1-a89b-39508c72d1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:33.397569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e50746-43da-41f1-a89b-39508c72d1db None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:33.397844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e50746-43da-41f1-a89b-39508c72d1db None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:33.398136 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e50746-43da-41f1-a89b-39508c72d1db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:33.398978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e50746-43da-41f1-a89b-39508c72d1db None admin] RBAC: Adding query filter params (role.id=59778f07f0504e90a60212f460e8c774, scope.project.id=bb8365ff218d4747adcfa5391109fa50, user.id=5694596415424d1cbfdbd6136c16d28b) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:33.399380 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e50746-43da-41f1-a89b-39508c72d1db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:33.400832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e50746-43da-41f1-a89b-39508c72d1db None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:33.406471 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 540/1100] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:34:33 2022] GET /identity/v3/role_assignments?user.id=5694596415424d1cbfdbd6136c16d28b&scope.project.id=bb8365ff218d4747adcfa5391109fa50&role.id=59778f07f0504e90a60212f460e8c774 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:33.484096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 561/1101] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:34:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:34:33.489803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e50746-43da-41f1-a89b-39508c72d1db None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:33.593062 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e50746-43da-41f1-a89b-39508c72d1db None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:33.627579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec3cc4-b9e6-4496-adea-34390295c442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:33.628363 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec3cc4-b9e6-4496-adea-34390295c442 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:33.628647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec3cc4-b9e6-4496-adea-34390295c442 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:33.628921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec3cc4-b9e6-4496-adea-34390295c442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:33.639072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec3cc4-b9e6-4496-adea-34390295c442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:33.640542 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec3cc4-b9e6-4496-adea-34390295c442 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:33.657715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-abec3cc4-b9e6-4496-adea-34390295c442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:33.657715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:33.657715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:33.657715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:33.657715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:33.657715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:33.657715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:33.657715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:33.657715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:33.657715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:33.657715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:33.657715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:33.657715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:34:33.657715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:34:33.657715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:34:33.658644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:34:33.658644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:33.658644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:33.658644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:33.658644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:33.658644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:33.658644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:33.658644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:33.658644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:33.658644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:33.658644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:33.658644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:33.658644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:33.658644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:33.658644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:33.658644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:33.658644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:33.659841 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:34:33.659841 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:34:33.659841 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:34:33.659841 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:33.659841 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 541/1102] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:33.665064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1ba11-b66a-40bf-b21a-fd8c78305e24 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:33.758248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1ba11-b66a-40bf-b21a-fd8c78305e24 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:33.792697 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7c617-0101-4816-82b1-1e2389c6e0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:33.793364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7c617-0101-4816-82b1-1e2389c6e0ab None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:33.793647 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7c617-0101-4816-82b1-1e2389c6e0ab None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:33.793919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7c617-0101-4816-82b1-1e2389c6e0ab None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:33.794619 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7c617-0101-4816-82b1-1e2389c6e0ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:33.794923 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7c617-0101-4816-82b1-1e2389c6e0ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:33.796471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7c617-0101-4816-82b1-1e2389c6e0ab None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:33.807739 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 562/1103] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:33.813429 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec3cc4-b9e6-4496-adea-34390295c442 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:33.911032 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec3cc4-b9e6-4496-adea-34390295c442 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:33.944265 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764612d3-622b-4b72-a544-806e32860b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:33.945108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764612d3-622b-4b72-a544-806e32860b50 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:33.945379 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764612d3-622b-4b72-a544-806e32860b50 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:33.945657 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764612d3-622b-4b72-a544-806e32860b50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:33.952125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764612d3-622b-4b72-a544-806e32860b50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:33.953558 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764612d3-622b-4b72-a544-806e32860b50 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:33.966931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-764612d3-622b-4b72-a544-806e32860b50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:34:33.966931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:33.966931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:33.966931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:33.966931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:33.966931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:33.966931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:33.966931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:33.966931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:33.966931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:33.966931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:33.966931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:33.966931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:34:33.966931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:34:33.966931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:34:33.967895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:34:33.967895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:33.967895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:33.967895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:33.967895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:33.967895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:33.967895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:33.967895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:33.967895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:34:33.967895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:33.967895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:33.967895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:33.967895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:33.967895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:33.967895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:33.967895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:33.967895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:33.968799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:34:33.968799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:34:33.968799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:34:33.968799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:34:33.968799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:34:33.968799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:34:33.968799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:34:33.968799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:34:33.968799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 542/1104] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:34:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:33.974501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7c617-0101-4816-82b1-1e2389c6e0ab None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:34.070075 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7c617-0101-4816-82b1-1e2389c6e0ab None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:34.103785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e785f-0d76-4960-91c2-c6deba910c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:34.104440 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e785f-0d76-4960-91c2-c6deba910c15 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:34.104718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e785f-0d76-4960-91c2-c6deba910c15 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:34.104993 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e785f-0d76-4960-91c2-c6deba910c15 None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:34.105774 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e785f-0d76-4960-91c2-c6deba910c15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:34.106075 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e785f-0d76-4960-91c2-c6deba910c15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:34.107554 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e785f-0d76-4960-91c2-c6deba910c15 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:34.119634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 563/1105] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:34:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:34.125768 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764612d3-622b-4b72-a544-806e32860b50 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:34.224649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764612d3-622b-4b72-a544-806e32860b50 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:34.259808 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c6e05-7994-476e-a8fd-851b5b4429db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:34.260465 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c6e05-7994-476e-a8fd-851b5b4429db None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:34.260749 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c6e05-7994-476e-a8fd-851b5b4429db None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:34.260993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c6e05-7994-476e-a8fd-851b5b4429db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:34.261839 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c6e05-7994-476e-a8fd-851b5b4429db None admin] RBAC: Adding query filter params (role.id=5a587c5dea3b4b7fbcaf94adf45c8b31, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=f4f207481ccb4cfcbbcffd9df73d2985) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:34.262148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c6e05-7994-476e-a8fd-851b5b4429db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:34.263601 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c6e05-7994-476e-a8fd-851b5b4429db None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:34.269528 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 543/1106] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:34:34 2022] GET /identity/v3/role_assignments?user.id=f4f207481ccb4cfcbbcffd9df73d2985&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=5a587c5dea3b4b7fbcaf94adf45c8b31 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:35.643538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154303a0-1aaa-4983-8307-bfbebc6e1418 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:35.644328 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154303a0-1aaa-4983-8307-bfbebc6e1418 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:35.644491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154303a0-1aaa-4983-8307-bfbebc6e1418 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:35.646608 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 564/1107] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:35.654508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f73e3-b423-437d-b26b-75006ea0a43a None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:35.654947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f73e3-b423-437d-b26b-75006ea0a43a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:35.655083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f73e3-b423-437d-b26b-75006ea0a43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:35.672925 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-a39f73e3-b423-437d-b26b-75006ea0a43a None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:35.674084 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a39f73e3-b423-437d-b26b-75006ea0a43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:35.749843 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 544/1108] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:34:35.785089 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154303a0-1aaa-4983-8307-bfbebc6e1418 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:35.906115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154303a0-1aaa-4983-8307-bfbebc6e1418 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:35.939345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd7367-c9ef-4aa9-8cb9-80f0e5bcb11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:35.940117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd7367-c9ef-4aa9-8cb9-80f0e5bcb11f None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:35.940394 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd7367-c9ef-4aa9-8cb9-80f0e5bcb11f None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:35.940660 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd7367-c9ef-4aa9-8cb9-80f0e5bcb11f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:35.941936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd7367-c9ef-4aa9-8cb9-80f0e5bcb11f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:35.943393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd7367-c9ef-4aa9-8cb9-80f0e5bcb11f None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:35.945017 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 565/1109] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:35.951081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f73e3-b423-437d-b26b-75006ea0a43a None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:36.054091 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f73e3-b423-437d-b26b-75006ea0a43a None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:36.087913 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6b7a0-b2bc-4d31-85db-e485832281df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:36.088565 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6b7a0-b2bc-4d31-85db-e485832281df None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:36.088847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6b7a0-b2bc-4d31-85db-e485832281df None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:36.089118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6b7a0-b2bc-4d31-85db-e485832281df None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:36.089814 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6b7a0-b2bc-4d31-85db-e485832281df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:36.091273 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6b7a0-b2bc-4d31-85db-e485832281df None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:36.112652 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 545/1110] 10.222.0.11 () {60 vars in 1132 bytes} [Wed May 4 21:34:35 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:34:38.377462 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4d449-f780-4a5b-9623-7e724bce6ceb None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:38.378354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4d449-f780-4a5b-9623-7e724bce6ceb None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:38.378354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4d449-f780-4a5b-9623-7e724bce6ceb None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:38.380622 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 566/1111] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:38.386101 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457ab1e-363f-4e79-9a63-dcfcbfd3dbcb None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:38.386519 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457ab1e-363f-4e79-9a63-dcfcbfd3dbcb None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:38.386609 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457ab1e-363f-4e79-9a63-dcfcbfd3dbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:38.405529 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-a457ab1e-363f-4e79-9a63-dcfcbfd3dbcb None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:38.406688 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a457ab1e-363f-4e79-9a63-dcfcbfd3dbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:38.472356 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 546/1112] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:38.496735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4d449-f780-4a5b-9623-7e724bce6ceb None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:38.613600 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4d449-f780-4a5b-9623-7e724bce6ceb None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:38.647571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ca3af-4f2c-4c37-9e7d-26b9aa87d77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:38.648387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ca3af-4f2c-4c37-9e7d-26b9aa87d77a None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:38.648693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ca3af-4f2c-4c37-9e7d-26b9aa87d77a None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:38.648972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ca3af-4f2c-4c37-9e7d-26b9aa87d77a None admin] PATH_INFO: `/v3/roles/c3d122a6c9c6478aa2dd7e5b8afe6471` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:38.650492 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ca3af-4f2c-4c37-9e7d-26b9aa87d77a None admin] RBAC: Authorizing `identity:get_role(role_id=c3d122a6c9c6478aa2dd7e5b8afe6471)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:38.651913 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ca3af-4f2c-4c37-9e7d-26b9aa87d77a None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:38.653277 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 567/1113] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:34:38 2022] GET /identity/v3/roles/c3d122a6c9c6478aa2dd7e5b8afe6471 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:38.659504 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457ab1e-363f-4e79-9a63-dcfcbfd3dbcb None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:38.759033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457ab1e-363f-4e79-9a63-dcfcbfd3dbcb None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:38.792884 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b47f0-8fc8-4356-8506-1701da9e4ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:38.793747 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b47f0-8fc8-4356-8506-1701da9e4ac6 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:38.794028 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b47f0-8fc8-4356-8506-1701da9e4ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:38.794296 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b47f0-8fc8-4356-8506-1701da9e4ac6 None admin] PATH_INFO: `/v3/users/55809821a83b4749a2183e495cdc4631` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:38.807520 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b47f0-8fc8-4356-8506-1701da9e4ac6 None admin] RBAC: Authorizing `identity:get_user(user_id=55809821a83b4749a2183e495cdc4631)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:38.808949 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b47f0-8fc8-4356-8506-1701da9e4ac6 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:38.810567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 547/1114] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:34:38 2022] GET /identity/v3/users/55809821a83b4749a2183e495cdc4631 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:38.817240 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ca3af-4f2c-4c37-9e7d-26b9aa87d77a None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:38.934622 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ca3af-4f2c-4c37-9e7d-26b9aa87d77a None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:38.972056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce00c1-2645-439d-8148-024af27bf0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:38.972699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce00c1-2645-439d-8148-024af27bf0f0 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:38.973297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce00c1-2645-439d-8148-024af27bf0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:38.973579 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce00c1-2645-439d-8148-024af27bf0f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:39.039394 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce00c1-2645-439d-8148-024af27bf0f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:39.040846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce00c1-2645-439d-8148-024af27bf0f0 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:39.141250 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 568/1115] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:34:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:34:39.150728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b47f0-8fc8-4356-8506-1701da9e4ac6 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:39.252880 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b47f0-8fc8-4356-8506-1701da9e4ac6 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:39.287375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcd480-cdfc-4146-9c3a-9031921aa590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:39.288228 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcd480-cdfc-4146-9c3a-9031921aa590 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:39.288538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcd480-cdfc-4146-9c3a-9031921aa590 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:39.288885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcd480-cdfc-4146-9c3a-9031921aa590 None admin] PATH_INFO: `/v3/projects/bb8365ff218d4747adcfa5391109fa50` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:39.290086 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebcd480-cdfc-4146-9c3a-9031921aa590 None admin] RBAC: Authorizing `identity:get_project(project_id=bb8365ff218d4747adcfa5391109fa50)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:39.291569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebcd480-cdfc-4146-9c3a-9031921aa590 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:39.293236 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 548/1116] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:34:39 2022] GET /identity/v3/projects/bb8365ff218d4747adcfa5391109fa50 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:39.299660 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce00c1-2645-439d-8148-024af27bf0f0 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:39.406165 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce00c1-2645-439d-8148-024af27bf0f0 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:39.440697 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc311a-3786-4f1c-a739-22377c86c620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:39.441339 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc311a-3786-4f1c-a739-22377c86c620 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:39.441616 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc311a-3786-4f1c-a739-22377c86c620 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:39.441886 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc311a-3786-4f1c-a739-22377c86c620 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:39.442700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc311a-3786-4f1c-a739-22377c86c620 None admin] RBAC: Adding query filter params (role.id=c3d122a6c9c6478aa2dd7e5b8afe6471, scope.project.id=bb8365ff218d4747adcfa5391109fa50, user.id=55809821a83b4749a2183e495cdc4631) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:39.443011 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc311a-3786-4f1c-a739-22377c86c620 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:39.444491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc311a-3786-4f1c-a739-22377c86c620 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:39.450032 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 569/1117] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:34:39 2022] GET /identity/v3/role_assignments?user.id=55809821a83b4749a2183e495cdc4631&scope.project.id=bb8365ff218d4747adcfa5391109fa50&role.id=c3d122a6c9c6478aa2dd7e5b8afe6471 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:41.664333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d455a00-9242-405e-9718-7fe7692ad462 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:41.665148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d455a00-9242-405e-9718-7fe7692ad462 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:41.665284 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d455a00-9242-405e-9718-7fe7692ad462 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:41.667400 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 549/1118] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:41.673812 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b50e8-63ef-4a82-9e05-bd3bc4fe083e None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:41.674494 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b50e8-63ef-4a82-9e05-bd3bc4fe083e None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:41.674692 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b50e8-63ef-4a82-9e05-bd3bc4fe083e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:41.694052 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-2e6b50e8-63ef-4a82-9e05-bd3bc4fe083e None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:41.695250 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-2e6b50e8-63ef-4a82-9e05-bd3bc4fe083e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:41.764462 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 570/1119] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:41.787968 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d455a00-9242-405e-9718-7fe7692ad462 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:41.902062 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d455a00-9242-405e-9718-7fe7692ad462 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:41.943555 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80140ff8-7a17-4e3c-a9f1-06b7149b239f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:41.944413 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80140ff8-7a17-4e3c-a9f1-06b7149b239f None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:41.944703 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80140ff8-7a17-4e3c-a9f1-06b7149b239f None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:41.944987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80140ff8-7a17-4e3c-a9f1-06b7149b239f None admin] PATH_INFO: `/v3/roles/c3d122a6c9c6478aa2dd7e5b8afe6471` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:41.946562 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80140ff8-7a17-4e3c-a9f1-06b7149b239f None admin] RBAC: Authorizing `identity:get_role(role_id=c3d122a6c9c6478aa2dd7e5b8afe6471)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:41.947964 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80140ff8-7a17-4e3c-a9f1-06b7149b239f None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:41.949331 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 550/1120] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:34:41 2022] GET /identity/v3/roles/c3d122a6c9c6478aa2dd7e5b8afe6471 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:41.955639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b50e8-63ef-4a82-9e05-bd3bc4fe083e None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:42.063952 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b50e8-63ef-4a82-9e05-bd3bc4fe083e None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:42.098084 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef98015-b570-46c4-8a8d-2f58e230bc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:42.098960 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef98015-b570-46c4-8a8d-2f58e230bc1a None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:42.099270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef98015-b570-46c4-8a8d-2f58e230bc1a None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:42.099547 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef98015-b570-46c4-8a8d-2f58e230bc1a None admin] PATH_INFO: `/v3/users/55809821a83b4749a2183e495cdc4631` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:42.100774 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef98015-b570-46c4-8a8d-2f58e230bc1a None admin] RBAC: Authorizing `identity:get_user(user_id=55809821a83b4749a2183e495cdc4631)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:42.102270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef98015-b570-46c4-8a8d-2f58e230bc1a None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:42.103917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 571/1121] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:34:41 2022] GET /identity/v3/users/55809821a83b4749a2183e495cdc4631 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:42.110601 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80140ff8-7a17-4e3c-a9f1-06b7149b239f None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:42.219438 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80140ff8-7a17-4e3c-a9f1-06b7149b239f None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:42.253768 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e444d-9371-4c9a-b2a0-409124c39e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:42.254646 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e444d-9371-4c9a-b2a0-409124c39e70 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:42.254923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e444d-9371-4c9a-b2a0-409124c39e70 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:42.255229 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e444d-9371-4c9a-b2a0-409124c39e70 None admin] PATH_INFO: `/v3/projects/bb8365ff218d4747adcfa5391109fa50` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:42.256527 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e444d-9371-4c9a-b2a0-409124c39e70 None admin] RBAC: Authorizing `identity:get_project(project_id=bb8365ff218d4747adcfa5391109fa50)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:42.258009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e444d-9371-4c9a-b2a0-409124c39e70 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:42.259821 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 551/1122] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:34:42 2022] GET /identity/v3/projects/bb8365ff218d4747adcfa5391109fa50 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:42.267100 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef98015-b570-46c4-8a8d-2f58e230bc1a None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:42.375304 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef98015-b570-46c4-8a8d-2f58e230bc1a None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:42.414896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95468f-e0f3-4273-8538-3674b0241174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:42.415824 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95468f-e0f3-4273-8538-3674b0241174 None admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:42.416106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95468f-e0f3-4273-8538-3674b0241174 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:42.416382 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95468f-e0f3-4273-8538-3674b0241174 None admin] PATH_INFO: `/v3/projects/bb8365ff218d4747adcfa5391109fa50/users/55809821a83b4749a2183e495cdc4631/roles/c3d122a6c9c6478aa2dd7e5b8afe6471` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:42.419268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95468f-e0f3-4273-8538-3674b0241174 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb8365ff218d4747adcfa5391109fa50, user_id=55809821a83b4749a2183e495cdc4631, role_id=c3d122a6c9c6478aa2dd7e5b8afe6471)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:42.420721 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95468f-e0f3-4273-8538-3674b0241174 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:42.441666 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 572/1123] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:34:42 2022] PUT /identity/v3/projects/bb8365ff218d4747adcfa5391109fa50/users/55809821a83b4749a2183e495cdc4631/roles/c3d122a6c9c6478aa2dd7e5b8afe6471 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:34:44.653141 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5b613-ff2d-4174-b6df-87f8a799b6ae None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:44.653982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5b613-ff2d-4174-b6df-87f8a799b6ae None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:44.653982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5b613-ff2d-4174-b6df-87f8a799b6ae None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:44.656261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 552/1124] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:44.662479 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fa102-1f34-481b-a1fc-29c3ac8c679f None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:44.662927 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fa102-1f34-481b-a1fc-29c3ac8c679f None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:44.663072 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fa102-1f34-481b-a1fc-29c3ac8c679f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:44.681868 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-d13fa102-1f34-481b-a1fc-29c3ac8c679f None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:44.683061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-d13fa102-1f34-481b-a1fc-29c3ac8c679f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:44.752443 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 573/1125] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:44.784138 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5b613-ff2d-4174-b6df-87f8a799b6ae None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:44.900335 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5b613-ff2d-4174-b6df-87f8a799b6ae None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:44.942327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957da9ef-42cd-4583-924c-b0b82044696c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:44.943202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957da9ef-42cd-4583-924c-b0b82044696c None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:44.943489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957da9ef-42cd-4583-924c-b0b82044696c None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:44.943761 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957da9ef-42cd-4583-924c-b0b82044696c None admin] PATH_INFO: `/v3/roles/c3d122a6c9c6478aa2dd7e5b8afe6471` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:44.945355 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957da9ef-42cd-4583-924c-b0b82044696c None admin] RBAC: Authorizing `identity:get_role(role_id=c3d122a6c9c6478aa2dd7e5b8afe6471)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:44.946725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957da9ef-42cd-4583-924c-b0b82044696c None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:44.948124 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 553/1126] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:34:44 2022] GET /identity/v3/roles/c3d122a6c9c6478aa2dd7e5b8afe6471 => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:44.954098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fa102-1f34-481b-a1fc-29c3ac8c679f None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:45.065495 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fa102-1f34-481b-a1fc-29c3ac8c679f None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:45.100442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfde307-37c8-44f1-93ac-e254425db42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:45.101440 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfde307-37c8-44f1-93ac-e254425db42e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:45.101726 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfde307-37c8-44f1-93ac-e254425db42e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:45.102001 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfde307-37c8-44f1-93ac-e254425db42e None admin] PATH_INFO: `/v3/users/55809821a83b4749a2183e495cdc4631` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:45.103268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfde307-37c8-44f1-93ac-e254425db42e None admin] RBAC: Authorizing `identity:get_user(user_id=55809821a83b4749a2183e495cdc4631)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:45.104720 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfde307-37c8-44f1-93ac-e254425db42e None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:45.106336 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 574/1127] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:34:44 2022] GET /identity/v3/users/55809821a83b4749a2183e495cdc4631 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:45.112437 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957da9ef-42cd-4583-924c-b0b82044696c None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:45.210341 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957da9ef-42cd-4583-924c-b0b82044696c None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:45.251978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa713d0d-60db-4df7-a9d7-1321f89fcfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:45.252619 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa713d0d-60db-4df7-a9d7-1321f89fcfa3 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:45.252898 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa713d0d-60db-4df7-a9d7-1321f89fcfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:45.253178 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa713d0d-60db-4df7-a9d7-1321f89fcfa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:45.322563 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa713d0d-60db-4df7-a9d7-1321f89fcfa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:45.324020 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa713d0d-60db-4df7-a9d7-1321f89fcfa3 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:45.418076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 554/1128] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:34:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:34:45.427874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfde307-37c8-44f1-93ac-e254425db42e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:45.527382 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfde307-37c8-44f1-93ac-e254425db42e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:45.562371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a4a46-5cb5-4809-88df-be0175251c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:45.563253 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a4a46-5cb5-4809-88df-be0175251c04 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:45.563536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a4a46-5cb5-4809-88df-be0175251c04 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:45.563805 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a4a46-5cb5-4809-88df-be0175251c04 None admin] PATH_INFO: `/v3/projects/bb8365ff218d4747adcfa5391109fa50` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:45.565022 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a4a46-5cb5-4809-88df-be0175251c04 None admin] RBAC: Authorizing `identity:get_project(project_id=bb8365ff218d4747adcfa5391109fa50)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:45.566482 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a4a46-5cb5-4809-88df-be0175251c04 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:45.568431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 575/1129] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:34:45 2022] GET /identity/v3/projects/bb8365ff218d4747adcfa5391109fa50 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:45.574900 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa713d0d-60db-4df7-a9d7-1321f89fcfa3 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:45.688167 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa713d0d-60db-4df7-a9d7-1321f89fcfa3 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:45.733459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929ef74-361a-4c80-92ef-109e19dc132c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:45.734364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929ef74-361a-4c80-92ef-109e19dc132c None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:45.734651 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929ef74-361a-4c80-92ef-109e19dc132c None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:45.734949 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929ef74-361a-4c80-92ef-109e19dc132c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:45.736268 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929ef74-361a-4c80-92ef-109e19dc132c None admin] RBAC: Adding query filter params (role.id=c3d122a6c9c6478aa2dd7e5b8afe6471, scope.project.id=bb8365ff218d4747adcfa5391109fa50, user.id=55809821a83b4749a2183e495cdc4631) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:45.736648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929ef74-361a-4c80-92ef-109e19dc132c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:45.738815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929ef74-361a-4c80-92ef-109e19dc132c None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:45.745971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 555/1130] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:34:45 2022] GET /identity/v3/role_assignments?user.id=55809821a83b4749a2183e495cdc4631&scope.project.id=bb8365ff218d4747adcfa5391109fa50&role.id=c3d122a6c9c6478aa2dd7e5b8afe6471 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:48.036770 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0027a4-7ee1-4cb3-9247-9c44808be45f None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:48.037608 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0027a4-7ee1-4cb3-9247-9c44808be45f None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:48.037608 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0027a4-7ee1-4cb3-9247-9c44808be45f None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:48.039949 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 576/1131] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:48.045323 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bdf3f-8f22-4cae-890a-91d215bff407 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:48.045738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bdf3f-8f22-4cae-890a-91d215bff407 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:48.045852 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bdf3f-8f22-4cae-890a-91d215bff407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:48.063585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-901bdf3f-8f22-4cae-890a-91d215bff407 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:48.064747 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-901bdf3f-8f22-4cae-890a-91d215bff407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:48.132909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 556/1132] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:48.156973 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0027a4-7ee1-4cb3-9247-9c44808be45f None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:48.260528 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0027a4-7ee1-4cb3-9247-9c44808be45f None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:48.296813 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b0db7-8cce-4e08-8fc5-11a94388b317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:48.297524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0db7-8cce-4e08-8fc5-11a94388b317 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:48.297803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0db7-8cce-4e08-8fc5-11a94388b317 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:48.298077 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0db7-8cce-4e08-8fc5-11a94388b317 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:48.299325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b0db7-8cce-4e08-8fc5-11a94388b317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:48.300772 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b0db7-8cce-4e08-8fc5-11a94388b317 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:48.302389 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 577/1133] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:48.312089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bdf3f-8f22-4cae-890a-91d215bff407 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:48.418729 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bdf3f-8f22-4cae-890a-91d215bff407 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:48.453519 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce463ba-a905-470e-93a0-9d86b209d3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:48.454171 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce463ba-a905-470e-93a0-9d86b209d3bd None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:48.454449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce463ba-a905-470e-93a0-9d86b209d3bd None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:48.454719 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce463ba-a905-470e-93a0-9d86b209d3bd None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:48.455448 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce463ba-a905-470e-93a0-9d86b209d3bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:48.456871 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce463ba-a905-470e-93a0-9d86b209d3bd None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:48.489900 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 557/1134] 10.222.0.11 () {60 vars in 1141 bytes} [Wed May 4 21:34:48 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:34:50.739184 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa791eb8-d077-4ec8-ab53-428091c3f049 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:50.739704 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa791eb8-d077-4ec8-ab53-428091c3f049 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:50.739704 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa791eb8-d077-4ec8-ab53-428091c3f049 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:50.741097 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 578/1135] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:50.746485 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71215f-858c-4d6f-96a2-a1fc2cdd6078 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:50.746913 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71215f-858c-4d6f-96a2-a1fc2cdd6078 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:50.747077 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71215f-858c-4d6f-96a2-a1fc2cdd6078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:50.765135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-bb71215f-858c-4d6f-96a2-a1fc2cdd6078 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:50.766305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-bb71215f-858c-4d6f-96a2-a1fc2cdd6078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:50.833348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 558/1136] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:50.859136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa791eb8-d077-4ec8-ab53-428091c3f049 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:50.966101 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa791eb8-d077-4ec8-ab53-428091c3f049 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:51.007652 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c190d-c17b-465a-98ca-1bdde373947b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:51.008444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c190d-c17b-465a-98ca-1bdde373947b None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:51.008729 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c190d-c17b-465a-98ca-1bdde373947b None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:51.009001 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c190d-c17b-465a-98ca-1bdde373947b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:51.010250 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c190d-c17b-465a-98ca-1bdde373947b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:51.011745 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c190d-c17b-465a-98ca-1bdde373947b None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:51.013341 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 579/1137] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:34:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:51.019466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71215f-858c-4d6f-96a2-a1fc2cdd6078 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:51.116489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71215f-858c-4d6f-96a2-a1fc2cdd6078 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:51.150310 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e3e78-436a-473d-8b13-ef604429a489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:51.150971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e3e78-436a-473d-8b13-ef604429a489 None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:51.151290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e3e78-436a-473d-8b13-ef604429a489 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:51.151567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e3e78-436a-473d-8b13-ef604429a489 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:51.152266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e3e78-436a-473d-8b13-ef604429a489 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:51.153697 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e3e78-436a-473d-8b13-ef604429a489 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:51.176460 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 559/1138] 10.222.0.11 () {60 vars in 1132 bytes} [Wed May 4 21:34:51 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:34:53.455270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fea24c-ccc9-4714-af75-f0c61885ec11 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:53.456164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fea24c-ccc9-4714-af75-f0c61885ec11 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:53.456164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fea24c-ccc9-4714-af75-f0c61885ec11 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:53.458381 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 580/1139] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:53.463908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e3bf6-1cb3-41c0-97e7-d840cafe9b29 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:53.464325 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e3bf6-1cb3-41c0-97e7-d840cafe9b29 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:53.464432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e3bf6-1cb3-41c0-97e7-d840cafe9b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:53.483099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-081e3bf6-1cb3-41c0-97e7-d840cafe9b29 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:53.484294 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-081e3bf6-1cb3-41c0-97e7-d840cafe9b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:53.552553 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 560/1140] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:53.576704 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fea24c-ccc9-4714-af75-f0c61885ec11 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:53.685059 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fea24c-ccc9-4714-af75-f0c61885ec11 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:53.718443 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ce934-a430-49bd-b233-6b772468f73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:53.719192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ce934-a430-49bd-b233-6b772468f73c None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:53.719450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ce934-a430-49bd-b233-6b772468f73c None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:53.719723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ce934-a430-49bd-b233-6b772468f73c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:53.729732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ce934-a430-49bd-b233-6b772468f73c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:34:53.737207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-277ce934-a430-49bd-b233-6b772468f73c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:34:53.737207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:53.737207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:53.737207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:53.737207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:53.737207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:53.737207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:53.737207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:53.737207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:53.737207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:53.737207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:53.737207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:53.737207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:34:53.737207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:34:53.737207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:34:53.737207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:34:53.738257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:34:53.738257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:34:53.738257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:34:53.738257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:34:53.738257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:53.738257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:53.738257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:53.738257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:53.738257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:53.738257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:53.738257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:53.738257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:53.738257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:53.738257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:53.738257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:53.738257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:53.739213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:53.739213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:53.739213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:53.739213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:53.739213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:34:53.739213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:34:53.739213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:34:53.739213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:34:53.739213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:34:53.739213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:34:53.739213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:34:53.739213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:53.739213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 581/1141] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:34:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:53.745540 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e3bf6-1cb3-41c0-97e7-d840cafe9b29 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:53.857153 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e3bf6-1cb3-41c0-97e7-d840cafe9b29 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:53.892665 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb604a-8b71-4a0f-9e60-55dd297ce4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:53.893339 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb604a-8b71-4a0f-9e60-55dd297ce4c0 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:53.893625 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb604a-8b71-4a0f-9e60-55dd297ce4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:53.893897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb604a-8b71-4a0f-9e60-55dd297ce4c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:53.894637 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb604a-8b71-4a0f-9e60-55dd297ce4c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:53.894942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb604a-8b71-4a0f-9e60-55dd297ce4c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:53.896351 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb604a-8b71-4a0f-9e60-55dd297ce4c0 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:53.904227 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 561/1142] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:34:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:53.913419 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ce934-a430-49bd-b233-6b772468f73c None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:54.018951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ce934-a430-49bd-b233-6b772468f73c None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:54.052038 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420ea50-7f1b-481a-907d-c072a087f0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:54.052893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420ea50-7f1b-481a-907d-c072a087f0d4 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:54.053167 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420ea50-7f1b-481a-907d-c072a087f0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:54.053434 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420ea50-7f1b-481a-907d-c072a087f0d4 None admin] PATH_INFO: `/v3/users/18c10bb70233456cb8c8f140d893f15e` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:54.067315 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420ea50-7f1b-481a-907d-c072a087f0d4 None admin] RBAC: Authorizing `identity:get_user(user_id=18c10bb70233456cb8c8f140d893f15e)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:54.068839 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420ea50-7f1b-481a-907d-c072a087f0d4 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:54.070556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 582/1143] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:34:53 2022] GET /identity/v3/users/18c10bb70233456cb8c8f140d893f15e => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:54.077187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb604a-8b71-4a0f-9e60-55dd297ce4c0 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:54.184693 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb604a-8b71-4a0f-9e60-55dd297ce4c0 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:54.218228 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0e9b1-a010-464d-b7f5-23074849f1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:54.218876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0e9b1-a010-464d-b7f5-23074849f1dd None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:54.219195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0e9b1-a010-464d-b7f5-23074849f1dd None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:54.219473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0e9b1-a010-464d-b7f5-23074849f1dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:54.285187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0e9b1-a010-464d-b7f5-23074849f1dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:54.286566 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0e9b1-a010-464d-b7f5-23074849f1dd None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:54.393292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 562/1144] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:34:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:34:54.399661 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420ea50-7f1b-481a-907d-c072a087f0d4 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:54.502867 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420ea50-7f1b-481a-907d-c072a087f0d4 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:54.542164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d837c-2409-428d-bbc0-126543b78a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:54.542961 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d837c-2409-428d-bbc0-126543b78a03 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:54.543270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d837c-2409-428d-bbc0-126543b78a03 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:54.543538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d837c-2409-428d-bbc0-126543b78a03 None admin] PATH_INFO: `/v3/projects/17af6379688f407a93436919e466a3cf` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:54.544776 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d837c-2409-428d-bbc0-126543b78a03 None admin] RBAC: Authorizing `identity:get_project(project_id=17af6379688f407a93436919e466a3cf)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:54.546232 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d837c-2409-428d-bbc0-126543b78a03 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:54.548017 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 583/1145] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:34:54 2022] GET /identity/v3/projects/17af6379688f407a93436919e466a3cf => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:54.554406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0e9b1-a010-464d-b7f5-23074849f1dd None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:54.658242 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0e9b1-a010-464d-b7f5-23074849f1dd None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:54.692210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d52f80-43fb-4c57-a483-23744817a8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:54.692862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d52f80-43fb-4c57-a483-23744817a8e6 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:54.693141 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d52f80-43fb-4c57-a483-23744817a8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:54.693414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d52f80-43fb-4c57-a483-23744817a8e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:54.694289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d52f80-43fb-4c57-a483-23744817a8e6 None admin] RBAC: Adding query filter params (role.id=59778f07f0504e90a60212f460e8c774, scope.project.id=17af6379688f407a93436919e466a3cf, user.id=18c10bb70233456cb8c8f140d893f15e) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:54.694676 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d52f80-43fb-4c57-a483-23744817a8e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:54.696140 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d52f80-43fb-4c57-a483-23744817a8e6 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:54.701590 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 563/1146] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:34:54 2022] GET /identity/v3/role_assignments?user.id=18c10bb70233456cb8c8f140d893f15e&scope.project.id=17af6379688f407a93436919e466a3cf&role.id=59778f07f0504e90a60212f460e8c774 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:56.891526 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473fc00-7d1c-42ae-934f-56c736e2261a None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:56.892049 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473fc00-7d1c-42ae-934f-56c736e2261a None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:56.892049 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473fc00-7d1c-42ae-934f-56c736e2261a None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:56.893371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 584/1147] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:56.900104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fe961-87ca-4aec-a57e-2502d7545d0c None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:56.900878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fe961-87ca-4aec-a57e-2502d7545d0c None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:56.900976 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fe961-87ca-4aec-a57e-2502d7545d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:56.929138 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-076fe961-87ca-4aec-a57e-2502d7545d0c None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:56.930317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-076fe961-87ca-4aec-a57e-2502d7545d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:56.996235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 564/1148] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:34:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:34:57.029309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473fc00-7d1c-42ae-934f-56c736e2261a None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:57.139519 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473fc00-7d1c-42ae-934f-56c736e2261a None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:57.172733 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f14675-bcfb-4e5d-9318-729daed29c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:57.173531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f14675-bcfb-4e5d-9318-729daed29c18 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:57.173813 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f14675-bcfb-4e5d-9318-729daed29c18 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:57.174078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f14675-bcfb-4e5d-9318-729daed29c18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:57.184559 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f14675-bcfb-4e5d-9318-729daed29c18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:34:57.192020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-e2f14675-bcfb-4e5d-9318-729daed29c18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:34:57.192020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:34:57.192020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:34:57.192020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:34:57.192020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:34:57.192020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:34:57.192020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:34:57.192020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:34:57.192020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:34:57.192020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:34:57.192020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:34:57.192020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:34:57.192020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:34:57.192020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:34:57.192020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:34:57.192020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:34:57.193090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:34:57.193090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:34:57.193090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:34:57.193090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:34:57.193090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:34:57.193090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:34:57.193090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:34:57.193090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:34:57.193090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:34:57.193090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:34:57.193090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:34:57.193090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:34:57.193090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:34:57.193090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:34:57.193090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:34:57.193090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:34:57.193963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:34:57.193963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:34:57.193963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:34:57.193963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:34:57.193963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:34:57.193963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:34:57.193963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:34:57.193963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:34:57.193963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:34:57.193963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:34:57.193963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:34:57.193963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:34:57.193963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 585/1149] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:34:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:34:57.201786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fe961-87ca-4aec-a57e-2502d7545d0c None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:57.303152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fe961-87ca-4aec-a57e-2502d7545d0c None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:57.342966 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628a48b-584c-4530-b900-637a89590713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:57.343972 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628a48b-584c-4530-b900-637a89590713 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:57.344356 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628a48b-584c-4530-b900-637a89590713 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:57.344719 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628a48b-584c-4530-b900-637a89590713 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:57.345782 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628a48b-584c-4530-b900-637a89590713 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:34:57.346202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628a48b-584c-4530-b900-637a89590713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:57.348741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628a48b-584c-4530-b900-637a89590713 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:57.357798 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 565/1150] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:34:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:34:57.364091 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f14675-bcfb-4e5d-9318-729daed29c18 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:57.465868 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f14675-bcfb-4e5d-9318-729daed29c18 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:57.499384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf832f0-e247-4918-b0b3-2efd121b0ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:57.500230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf832f0-e247-4918-b0b3-2efd121b0ed5 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:57.500505 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf832f0-e247-4918-b0b3-2efd121b0ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:57.500769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf832f0-e247-4918-b0b3-2efd121b0ed5 None admin] PATH_INFO: `/v3/users/18c10bb70233456cb8c8f140d893f15e` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:57.501998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf832f0-e247-4918-b0b3-2efd121b0ed5 None admin] RBAC: Authorizing `identity:get_user(user_id=18c10bb70233456cb8c8f140d893f15e)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:57.503456 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf832f0-e247-4918-b0b3-2efd121b0ed5 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:57.505047 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 586/1151] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:34:57 2022] GET /identity/v3/users/18c10bb70233456cb8c8f140d893f15e => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:57.514978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628a48b-584c-4530-b900-637a89590713 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:57.624181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628a48b-584c-4530-b900-637a89590713 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:57.661171 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095640c8-03d3-40dd-a417-505d44fece52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:57.662033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095640c8-03d3-40dd-a417-505d44fece52 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:57.662315 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095640c8-03d3-40dd-a417-505d44fece52 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:57.662591 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095640c8-03d3-40dd-a417-505d44fece52 None admin] PATH_INFO: `/v3/projects/17af6379688f407a93436919e466a3cf` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:57.664046 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095640c8-03d3-40dd-a417-505d44fece52 None admin] RBAC: Authorizing `identity:get_project(project_id=17af6379688f407a93436919e466a3cf)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:57.665494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095640c8-03d3-40dd-a417-505d44fece52 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:57.667199 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 566/1152] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:34:57 2022] GET /identity/v3/projects/17af6379688f407a93436919e466a3cf => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:34:57.676972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf832f0-e247-4918-b0b3-2efd121b0ed5 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:57.778099 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf832f0-e247-4918-b0b3-2efd121b0ed5 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:57.811337 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffbf6b-8b65-44d5-b0d8-7cc7eb899bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:57.812221 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffbf6b-8b65-44d5-b0d8-7cc7eb899bfd None admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:57.812496 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffbf6b-8b65-44d5-b0d8-7cc7eb899bfd None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:57.812763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffbf6b-8b65-44d5-b0d8-7cc7eb899bfd None admin] PATH_INFO: `/v3/projects/17af6379688f407a93436919e466a3cf/users/18c10bb70233456cb8c8f140d893f15e/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:57.814812 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffbf6b-8b65-44d5-b0d8-7cc7eb899bfd None admin] RBAC: Authorizing `identity:create_grant(project_id=17af6379688f407a93436919e466a3cf, user_id=18c10bb70233456cb8c8f140d893f15e, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:57.816273 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffbf6b-8b65-44d5-b0d8-7cc7eb899bfd None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:57.832563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 587/1153] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:34:57 2022] PUT /identity/v3/projects/17af6379688f407a93436919e466a3cf/users/18c10bb70233456cb8c8f140d893f15e/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:35:00.042715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f675f-f39f-4ea6-9034-016b79b11ee4 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:00.043290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f675f-f39f-4ea6-9034-016b79b11ee4 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:00.043290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f675f-f39f-4ea6-9034-016b79b11ee4 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:00.045369 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 567/1154] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:35:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:35:00.054193 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08603127-aaa0-4d4b-b439-28877b0e8101 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:00.054597 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08603127-aaa0-4d4b-b439-28877b0e8101 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:00.054788 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08603127-aaa0-4d4b-b439-28877b0e8101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:00.077026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-08603127-aaa0-4d4b-b439-28877b0e8101 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:35:00.078261 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-08603127-aaa0-4d4b-b439-28877b0e8101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:35:00.146557 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 588/1155] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:35:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:35:00.176114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f675f-f39f-4ea6-9034-016b79b11ee4 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:00.278494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f675f-f39f-4ea6-9034-016b79b11ee4 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:00.311733 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5b7b8-738b-4a7e-af23-61c5041d7caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:00.312429 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5b7b8-738b-4a7e-af23-61c5041d7caa None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:00.312708 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5b7b8-738b-4a7e-af23-61c5041d7caa None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:00.312979 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5b7b8-738b-4a7e-af23-61c5041d7caa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:00.323373 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5b7b8-738b-4a7e-af23-61c5041d7caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:35:00.330725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-bcb5b7b8-738b-4a7e-af23-61c5041d7caa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:35:00.330725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:35:00.330725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:35:00.330725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:35:00.330725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:35:00.330725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:35:00.330725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:35:00.330725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:35:00.330725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:35:00.330725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:35:00.330725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:35:00.330725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:35:00.330725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:35:00.330725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:35:00.330725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:35:00.330725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:35:00.331844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:35:00.331844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:35:00.331844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:35:00.331844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:35:00.331844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:35:00.331844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:35:00.331844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:35:00.331844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:35:00.331844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:35:00.331844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:35:00.331844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:35:00.331844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:35:00.331844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:35:00.331844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:35:00.331844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:35:00.331844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:35:00.332918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:35:00.332918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:35:00.332918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:35:00.332918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:35:00.332918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:35:00.332918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:35:00.332918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:35:00.332918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:35:00.332918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:35:00.332918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:35:00.332918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:35:00.332918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:35:00.335231 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 568/1156] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:35:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:35:00.338375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08603127-aaa0-4d4b-b439-28877b0e8101 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:00.444398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08603127-aaa0-4d4b-b439-28877b0e8101 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:00.480221 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5d0dc-0c89-41dc-ac73-89987f85f7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:00.480903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5d0dc-0c89-41dc-ac73-89987f85f7f7 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:00.481186 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5d0dc-0c89-41dc-ac73-89987f85f7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:00.481462 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5d0dc-0c89-41dc-ac73-89987f85f7f7 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:00.482220 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5d0dc-0c89-41dc-ac73-89987f85f7f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:35:00.482529 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5d0dc-0c89-41dc-ac73-89987f85f7f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:00.483953 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5d0dc-0c89-41dc-ac73-89987f85f7f7 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:00.492163 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 589/1157] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:35:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:35:00.501409 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5b7b8-738b-4a7e-af23-61c5041d7caa None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:00.616982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5b7b8-738b-4a7e-af23-61c5041d7caa None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:00.652199 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be02991-c4cf-4068-a0a1-169341896926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:00.653056 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be02991-c4cf-4068-a0a1-169341896926 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:00.653333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be02991-c4cf-4068-a0a1-169341896926 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:00.653625 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be02991-c4cf-4068-a0a1-169341896926 None admin] PATH_INFO: `/v3/users/18c10bb70233456cb8c8f140d893f15e` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:00.654824 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be02991-c4cf-4068-a0a1-169341896926 None admin] RBAC: Authorizing `identity:get_user(user_id=18c10bb70233456cb8c8f140d893f15e)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:00.656305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be02991-c4cf-4068-a0a1-169341896926 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:00.657936 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 569/1158] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:35:00 2022] GET /identity/v3/users/18c10bb70233456cb8c8f140d893f15e => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:35:00.664776 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5d0dc-0c89-41dc-ac73-89987f85f7f7 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:00.769926 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5d0dc-0c89-41dc-ac73-89987f85f7f7 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:00.802885 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f600875-d1ca-4fe2-a0eb-149431ad9039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:00.803605 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f600875-d1ca-4fe2-a0eb-149431ad9039 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:00.803887 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f600875-d1ca-4fe2-a0eb-149431ad9039 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:00.804155 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f600875-d1ca-4fe2-a0eb-149431ad9039 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:00.869096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f600875-d1ca-4fe2-a0eb-149431ad9039 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:00.870475 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f600875-d1ca-4fe2-a0eb-149431ad9039 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:00.970583 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 590/1159] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:35:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:35:00.977841 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be02991-c4cf-4068-a0a1-169341896926 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:01.085606 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be02991-c4cf-4068-a0a1-169341896926 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:01.121346 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bb7a7-782d-4b43-9167-faf135305747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:01.122131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bb7a7-782d-4b43-9167-faf135305747 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:01.122414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bb7a7-782d-4b43-9167-faf135305747 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:01.122690 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bb7a7-782d-4b43-9167-faf135305747 None admin] PATH_INFO: `/v3/projects/17af6379688f407a93436919e466a3cf` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:01.124023 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bb7a7-782d-4b43-9167-faf135305747 None admin] RBAC: Authorizing `identity:get_project(project_id=17af6379688f407a93436919e466a3cf)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:01.125453 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bb7a7-782d-4b43-9167-faf135305747 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:01.127124 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 570/1160] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:35:00 2022] GET /identity/v3/projects/17af6379688f407a93436919e466a3cf => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:35:01.134233 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f600875-d1ca-4fe2-a0eb-149431ad9039 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:01.244089 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f600875-d1ca-4fe2-a0eb-149431ad9039 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:01.277727 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a2da7-97df-41ec-b2c6-90d01491eaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:01.278366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2da7-97df-41ec-b2c6-90d01491eaf5 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:01.278643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2da7-97df-41ec-b2c6-90d01491eaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:01.278914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2da7-97df-41ec-b2c6-90d01491eaf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:01.279767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a2da7-97df-41ec-b2c6-90d01491eaf5 None admin] RBAC: Adding query filter params (role.id=59778f07f0504e90a60212f460e8c774, scope.project.id=17af6379688f407a93436919e466a3cf, user.id=18c10bb70233456cb8c8f140d893f15e) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:35:01.280079 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a2da7-97df-41ec-b2c6-90d01491eaf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:01.281508 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a2da7-97df-41ec-b2c6-90d01491eaf5 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:01.287370 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 591/1161] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:35:01 2022] GET /identity/v3/role_assignments?user.id=18c10bb70233456cb8c8f140d893f15e&scope.project.id=17af6379688f407a93436919e466a3cf&role.id=59778f07f0504e90a60212f460e8c774 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:35:03.520286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e845aa5-2e2d-4734-9767-1f7eb848dc07 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:03.520948 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e845aa5-2e2d-4734-9767-1f7eb848dc07 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:03.520948 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e845aa5-2e2d-4734-9767-1f7eb848dc07 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:03.522245 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 571/1162] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:35:03.528624 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daec731-2ff6-4fc9-bdba-e49c94a94dfc None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:03.529381 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daec731-2ff6-4fc9-bdba-e49c94a94dfc None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:03.529532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daec731-2ff6-4fc9-bdba-e49c94a94dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:03.556604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-8daec731-2ff6-4fc9-bdba-e49c94a94dfc None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:35:03.557800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-8daec731-2ff6-4fc9-bdba-e49c94a94dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:35:03.627493 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 592/1163] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:35:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:35:03.657599 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e845aa5-2e2d-4734-9767-1f7eb848dc07 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:03.768818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e845aa5-2e2d-4734-9767-1f7eb848dc07 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:03.806611 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d6b02-75a3-4ad7-bf1a-a6db42c0a1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:03.807235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d6b02-75a3-4ad7-bf1a-a6db42c0a1af None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:03.807514 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d6b02-75a3-4ad7-bf1a-a6db42c0a1af None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:03.807790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d6b02-75a3-4ad7-bf1a-a6db42c0a1af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:03.876707 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d6b02-75a3-4ad7-bf1a-a6db42c0a1af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:03.878140 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d6b02-75a3-4ad7-bf1a-a6db42c0a1af None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:03.981233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 572/1164] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:35:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:35:03.987410 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daec731-2ff6-4fc9-bdba-e49c94a94dfc None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:04.083523 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daec731-2ff6-4fc9-bdba-e49c94a94dfc None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:04.117830 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60453fbf-405a-4f4a-87ca-50c99c283cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:04.118617 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60453fbf-405a-4f4a-87ca-50c99c283cce None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:04.118899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60453fbf-405a-4f4a-87ca-50c99c283cce None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:04.119204 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60453fbf-405a-4f4a-87ca-50c99c283cce None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:04.126089 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60453fbf-405a-4f4a-87ca-50c99c283cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:04.127573 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60453fbf-405a-4f4a-87ca-50c99c283cce None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:04.141766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-60453fbf-405a-4f4a-87ca-50c99c283cce None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 21:35:04.141766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:35:04.141766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 04 21:35:04.141766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 04 21:35:04.141766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:35:04.141766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:35:04.141766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:35:04.141766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:35:04.141766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 04 21:35:04.141766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:35:04.141766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:35:04.141766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:35:04.141766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:35:04.141766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:35:04.141766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:35:04.141766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:35:04.141766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:35:04.142945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:35:04.142945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:35:04.142945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:35:04.142945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:35:04.142945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:35:04.142945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:35:04.142945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:35:04.142945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:35:04.142945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:35:04.142945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:35:04.142945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:35:04.142945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:35:04.142945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:35:04.142945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:35:04.142945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:35:04.142945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:35:04.144209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:35:04.144209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:35:04.144209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:35:04.144209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:35:04.144209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:35:04.144209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:35:04.144209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:35:04.144209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:35:04.144209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:35:04.144209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:35:04.144209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 04 21:35:04.144209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:35:04.144209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 21:35:04.144209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:35:04.144209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 593/1165] 10.222.0.11 () {56 vars in 1117 bytes} [Wed May 4 21:35:03 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:35:04.149690 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d6b02-75a3-4ad7-bf1a-a6db42c0a1af None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:04.258280 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d6b02-75a3-4ad7-bf1a-a6db42c0a1af None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:04.293138 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bc60d-86d8-44f5-9341-131150dd3680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:04.293785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bc60d-86d8-44f5-9341-131150dd3680 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:04.294070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bc60d-86d8-44f5-9341-131150dd3680 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:04.294340 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bc60d-86d8-44f5-9341-131150dd3680 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:04.295093 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bc60d-86d8-44f5-9341-131150dd3680 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:35:04.295391 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bc60d-86d8-44f5-9341-131150dd3680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:04.296750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bc60d-86d8-44f5-9341-131150dd3680 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:04.304150 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 573/1166] 10.222.0.11 () {56 vars in 1115 bytes} [Wed May 4 21:35:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:35:06.512562 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70169e9b-9999-4b53-829d-115b03e10f48 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:06.513155 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70169e9b-9999-4b53-829d-115b03e10f48 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:06.513155 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70169e9b-9999-4b53-829d-115b03e10f48 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:06.514540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 594/1167] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:35:06.520989 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf940035-82e9-4f57-bf8d-078bd502b9c1 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:06.521757 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf940035-82e9-4f57-bf8d-078bd502b9c1 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:06.522005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf940035-82e9-4f57-bf8d-078bd502b9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:06.539930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-cf940035-82e9-4f57-bf8d-078bd502b9c1 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:35:06.541120 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-cf940035-82e9-4f57-bf8d-078bd502b9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:35:06.615996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 574/1168] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:35:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:35:06.639955 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70169e9b-9999-4b53-829d-115b03e10f48 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:06.745790 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70169e9b-9999-4b53-829d-115b03e10f48 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:06.778676 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0691143-4370-480a-a519-10b7f306545b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:06.779291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0691143-4370-480a-a519-10b7f306545b None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:06.779570 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0691143-4370-480a-a519-10b7f306545b None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:06.779841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0691143-4370-480a-a519-10b7f306545b None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:06.780579 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0691143-4370-480a-a519-10b7f306545b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:06.781950 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0691143-4370-480a-a519-10b7f306545b None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:06.798840 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 595/1169] 10.222.0.11 () {60 vars in 1138 bytes} [Wed May 4 21:35:06 2022] POST /identity/v3/domains => generated 267 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:35:09.038549 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166179f2-4525-4139-ae9d-2aa3e9abff91 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:09.039115 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166179f2-4525-4139-ae9d-2aa3e9abff91 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:09.039115 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166179f2-4525-4139-ae9d-2aa3e9abff91 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:09.041206 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 575/1170] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:35:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:35:09.050012 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0c4a7-cbf3-4ee2-92f4-5998ce23f488 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:09.050431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0c4a7-cbf3-4ee2-92f4-5998ce23f488 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:09.050584 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0c4a7-cbf3-4ee2-92f4-5998ce23f488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:09.069558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-3ee0c4a7-cbf3-4ee2-92f4-5998ce23f488 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:35:09.070731 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-3ee0c4a7-cbf3-4ee2-92f4-5998ce23f488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:35:09.137058 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 596/1171] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:35:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:35:09.160402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166179f2-4525-4139-ae9d-2aa3e9abff91 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:09.267466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166179f2-4525-4139-ae9d-2aa3e9abff91 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:09.300314 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68915011-4cd8-4bbb-aaf2-c867b1e3aa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:09.301099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68915011-4cd8-4bbb-aaf2-c867b1e3aa60 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:09.301374 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68915011-4cd8-4bbb-aaf2-c867b1e3aa60 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:09.301642 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68915011-4cd8-4bbb-aaf2-c867b1e3aa60 None admin] PATH_INFO: `/v3/domains/f570d7682cfe4a69a3e0e2255e2a8780` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:09.311621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68915011-4cd8-4bbb-aaf2-c867b1e3aa60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f570d7682cfe4a69a3e0e2255e2a8780)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:09.313092 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68915011-4cd8-4bbb-aaf2-c867b1e3aa60 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:09.314710 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 576/1172] 10.222.0.11 () {56 vars in 1183 bytes} [Wed May 4 21:35:09 2022] GET /identity/v3/domains/f570d7682cfe4a69a3e0e2255e2a8780 => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:35:09.320896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0c4a7-cbf3-4ee2-92f4-5998ce23f488 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:09.425464 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0c4a7-cbf3-4ee2-92f4-5998ce23f488 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:09.462368 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea5fb1-4945-4aa8-8fc9-70c6677b6b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:09.463012 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea5fb1-4945-4aa8-8fc9-70c6677b6b55 None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:09.463378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea5fb1-4945-4aa8-8fc9-70c6677b6b55 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:09.463568 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea5fb1-4945-4aa8-8fc9-70c6677b6b55 None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:09.464291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea5fb1-4945-4aa8-8fc9-70c6677b6b55 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:09.465724 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea5fb1-4945-4aa8-8fc9-70c6677b6b55 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:09.496038 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 597/1173] 10.222.0.11 () {60 vars in 1141 bytes} [Wed May 4 21:35:09 2022] POST /identity/v3/projects => generated 361 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:35:11.738079 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb302b34-6300-48e8-8a63-d5e8efd77bab None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:11.738624 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb302b34-6300-48e8-8a63-d5e8efd77bab None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:11.738624 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb302b34-6300-48e8-8a63-d5e8efd77bab None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:11.741058 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 577/1174] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:35:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:35:11.747631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cfdea-0aeb-4bc4-8e9b-ada1b9b01d1f None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:11.748026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cfdea-0aeb-4bc4-8e9b-ada1b9b01d1f None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:11.748253 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cfdea-0aeb-4bc4-8e9b-ada1b9b01d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:11.774658 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-291cfdea-0aeb-4bc4-8e9b-ada1b9b01d1f None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:35:11.775881 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-291cfdea-0aeb-4bc4-8e9b-ada1b9b01d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:35:11.854653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 598/1175] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:35:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:35:11.879595 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb302b34-6300-48e8-8a63-d5e8efd77bab None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:11.981516 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb302b34-6300-48e8-8a63-d5e8efd77bab None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:12.021142 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56931aa-1d63-4ac7-b073-7fd8d35cad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:12.022431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56931aa-1d63-4ac7-b073-7fd8d35cad92 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:12.022715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56931aa-1d63-4ac7-b073-7fd8d35cad92 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:12.022991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56931aa-1d63-4ac7-b073-7fd8d35cad92 None admin] PATH_INFO: `/v3/domains/f570d7682cfe4a69a3e0e2255e2a8780` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:12.024349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56931aa-1d63-4ac7-b073-7fd8d35cad92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f570d7682cfe4a69a3e0e2255e2a8780)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:12.025797 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56931aa-1d63-4ac7-b073-7fd8d35cad92 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:12.027618 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 578/1176] 10.222.0.11 () {56 vars in 1183 bytes} [Wed May 4 21:35:11 2022] GET /identity/v3/domains/f570d7682cfe4a69a3e0e2255e2a8780 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:35:12.033454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cfdea-0aeb-4bc4-8e9b-ada1b9b01d1f None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:12.137018 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cfdea-0aeb-4bc4-8e9b-ada1b9b01d1f None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:12.173314 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432bd1f-c4cf-4898-8ab9-998bdbad5382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:12.174281 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432bd1f-c4cf-4898-8ab9-998bdbad5382 None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:12.174662 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432bd1f-c4cf-4898-8ab9-998bdbad5382 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:12.175005 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432bd1f-c4cf-4898-8ab9-998bdbad5382 None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:12.176121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432bd1f-c4cf-4898-8ab9-998bdbad5382 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:12.178368 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432bd1f-c4cf-4898-8ab9-998bdbad5382 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:12.212344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 599/1177] 10.222.0.11 () {60 vars in 1132 bytes} [Wed May 4 21:35:12 2022] POST /identity/v3/users => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:35:14.501182 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294dc99-2bff-4a87-81f6-bf31a08ccfc7 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:14.502034 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294dc99-2bff-4a87-81f6-bf31a08ccfc7 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:14.502034 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294dc99-2bff-4a87-81f6-bf31a08ccfc7 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:14.504237 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 579/1178] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:35:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:35:14.513029 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ff68-c9fd-454d-9ee9-625c2f0f9e58 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:14.513754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ff68-c9fd-454d-9ee9-625c2f0f9e58 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:14.513912 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ff68-c9fd-454d-9ee9-625c2f0f9e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:14.539895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-aec0ff68-c9fd-454d-9ee9-625c2f0f9e58 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:35:14.541093 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-aec0ff68-c9fd-454d-9ee9-625c2f0f9e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:35:14.622906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 600/1179] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:35:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:35:14.647282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294dc99-2bff-4a87-81f6-bf31a08ccfc7 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:14.752914 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294dc99-2bff-4a87-81f6-bf31a08ccfc7 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:14.786003 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2785947-fdc6-4578-936d-3fa130db84e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:14.786777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2785947-fdc6-4578-936d-3fa130db84e2 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:14.787076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2785947-fdc6-4578-936d-3fa130db84e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:14.787381 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2785947-fdc6-4578-936d-3fa130db84e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:14.798250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2785947-fdc6-4578-936d-3fa130db84e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:35:14.805667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-a2785947-fdc6-4578-936d-3fa130db84e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:35:14.805667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:35:14.805667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:35:14.805667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:35:14.805667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:35:14.805667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:35:14.805667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:35:14.805667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:35:14.805667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:35:14.805667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:35:14.805667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:35:14.805667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:35:14.805667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:35:14.805667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:35:14.805667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:35:14.805667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:35:14.806746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:35:14.806746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:35:14.806746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:35:14.806746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:35:14.806746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:35:14.806746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:35:14.806746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:35:14.806746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:35:14.806746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:35:14.806746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:35:14.806746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:35:14.806746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:35:14.806746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:35:14.806746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:35:14.806746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:35:14.806746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:35:14.807681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:35:14.807681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:35:14.807681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:35:14.807681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:35:14.807681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:35:14.807681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:35:14.807681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:35:14.807681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:35:14.807681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:35:14.807681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:35:14.807681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:35:14.807681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:35:14.807681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 580/1180] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:35:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:35:14.814809 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0ff68-c9fd-454d-9ee9-625c2f0f9e58 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:14.918456 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0ff68-c9fd-454d-9ee9-625c2f0f9e58 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:14.952613 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcd8f4-2244-4dde-ae52-58460528e095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:14.953263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcd8f4-2244-4dde-ae52-58460528e095 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:14.953543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcd8f4-2244-4dde-ae52-58460528e095 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:14.953812 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcd8f4-2244-4dde-ae52-58460528e095 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:14.954530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcd8f4-2244-4dde-ae52-58460528e095 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:35:14.954833 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcd8f4-2244-4dde-ae52-58460528e095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:14.956233 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcd8f4-2244-4dde-ae52-58460528e095 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:14.964366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 601/1181] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:35:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:35:14.970867 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2785947-fdc6-4578-936d-3fa130db84e2 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:15.076920 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2785947-fdc6-4578-936d-3fa130db84e2 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:15.111564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd0667-8020-4267-b6c8-6b1ad917bf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:15.112419 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd0667-8020-4267-b6c8-6b1ad917bf61 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:15.112691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd0667-8020-4267-b6c8-6b1ad917bf61 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:15.112964 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd0667-8020-4267-b6c8-6b1ad917bf61 None admin] PATH_INFO: `/v3/users/befe34e070f146dfa0769a2ec46da628` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:15.126313 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd0667-8020-4267-b6c8-6b1ad917bf61 None admin] RBAC: Authorizing `identity:get_user(user_id=befe34e070f146dfa0769a2ec46da628)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:15.127833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd0667-8020-4267-b6c8-6b1ad917bf61 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:15.129453 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 581/1182] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:35:14 2022] GET /identity/v3/users/befe34e070f146dfa0769a2ec46da628 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:35:15.138768 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcd8f4-2244-4dde-ae52-58460528e095 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:15.256976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcd8f4-2244-4dde-ae52-58460528e095 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:15.293681 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bea05b-3810-4724-8435-cc062359927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:15.294655 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bea05b-3810-4724-8435-cc062359927a None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:15.295132 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bea05b-3810-4724-8435-cc062359927a None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:15.295526 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bea05b-3810-4724-8435-cc062359927a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:15.392539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bea05b-3810-4724-8435-cc062359927a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:15.393936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bea05b-3810-4724-8435-cc062359927a None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:15.495133 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 602/1183] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:35:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:35:15.504490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd0667-8020-4267-b6c8-6b1ad917bf61 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:15.610765 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd0667-8020-4267-b6c8-6b1ad917bf61 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:15.645417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c6ad8-c42e-43cb-afc6-d5b346bcb124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:15.646211 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c6ad8-c42e-43cb-afc6-d5b346bcb124 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:15.646495 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c6ad8-c42e-43cb-afc6-d5b346bcb124 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:15.646931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c6ad8-c42e-43cb-afc6-d5b346bcb124 None admin] PATH_INFO: `/v3/projects/84dd6f1c10fa487abebc9ad8943ca11b` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:15.648170 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c6ad8-c42e-43cb-afc6-d5b346bcb124 None admin] RBAC: Authorizing `identity:get_project(project_id=84dd6f1c10fa487abebc9ad8943ca11b)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:15.649586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c6ad8-c42e-43cb-afc6-d5b346bcb124 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:15.651304 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 582/1184] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:35:15 2022] GET /identity/v3/projects/84dd6f1c10fa487abebc9ad8943ca11b => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:35:15.658132 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bea05b-3810-4724-8435-cc062359927a None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:15.766722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bea05b-3810-4724-8435-cc062359927a None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:15.800198 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fff869-4823-47bd-9fd5-341368218471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:15.800831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fff869-4823-47bd-9fd5-341368218471 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:15.801107 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fff869-4823-47bd-9fd5-341368218471 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:15.801377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fff869-4823-47bd-9fd5-341368218471 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:15.802194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fff869-4823-47bd-9fd5-341368218471 None admin] RBAC: Adding query filter params (role.id=59778f07f0504e90a60212f460e8c774, scope.project.id=84dd6f1c10fa487abebc9ad8943ca11b, user.id=befe34e070f146dfa0769a2ec46da628) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:35:15.802534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fff869-4823-47bd-9fd5-341368218471 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:15.804113 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fff869-4823-47bd-9fd5-341368218471 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:15.809534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 603/1185] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:35:15 2022] GET /identity/v3/role_assignments?user.id=befe34e070f146dfa0769a2ec46da628&scope.project.id=84dd6f1c10fa487abebc9ad8943ca11b&role.id=59778f07f0504e90a60212f460e8c774 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:35:17.995718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40866a19-4cb5-4e56-b397-dd1dd3667cec None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:17.996273 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40866a19-4cb5-4e56-b397-dd1dd3667cec None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:17.996273 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40866a19-4cb5-4e56-b397-dd1dd3667cec None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:17.997610 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 583/1186] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:35:18.003994 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de4058-a9eb-43d8-9e63-9ff6dae14b07 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:18.004675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de4058-a9eb-43d8-9e63-9ff6dae14b07 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:18.004853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de4058-a9eb-43d8-9e63-9ff6dae14b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:18.028780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-e1de4058-a9eb-43d8-9e63-9ff6dae14b07 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:35:18.029970 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-e1de4058-a9eb-43d8-9e63-9ff6dae14b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:35:18.104131 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 604/1187] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:35:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:35:18.127079 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40866a19-4cb5-4e56-b397-dd1dd3667cec None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:18.232983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40866a19-4cb5-4e56-b397-dd1dd3667cec None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:18.266815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba294c09-d8ec-4340-bc49-59ed8f6ab0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:18.267583 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba294c09-d8ec-4340-bc49-59ed8f6ab0b7 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:18.267864 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba294c09-d8ec-4340-bc49-59ed8f6ab0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:18.268136 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba294c09-d8ec-4340-bc49-59ed8f6ab0b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:18.278135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba294c09-d8ec-4340-bc49-59ed8f6ab0b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:35:18.285579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-ba294c09-d8ec-4340-bc49-59ed8f6ab0b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:35:18.285579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:35:18.285579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:35:18.285579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:35:18.285579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:35:18.285579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:35:18.285579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:35:18.285579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:35:18.285579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:35:18.285579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:35:18.285579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:35:18.285579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:35:18.285579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:35:18.285579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:35:18.285579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:35:18.285579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:35:18.286732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:35:18.286732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:35:18.286732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:35:18.286732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:35:18.286732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:35:18.286732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:35:18.286732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:35:18.286732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:35:18.286732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:35:18.286732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:35:18.286732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:35:18.286732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:35:18.286732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:35:18.286732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:35:18.286732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:35:18.286732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:35:18.287982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:35:18.287982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:35:18.287982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:35:18.287982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:35:18.287982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:35:18.287982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:35:18.287982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:35:18.287982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:35:18.287982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:35:18.287982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:35:18.287982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:35:18.287982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:35:18.287982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 584/1188] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:35:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:35:18.294603 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de4058-a9eb-43d8-9e63-9ff6dae14b07 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:18.403959 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de4058-a9eb-43d8-9e63-9ff6dae14b07 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:18.442285 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830519f-3197-44b6-89d1-316b7b471f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:18.442943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830519f-3197-44b6-89d1-316b7b471f89 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:18.443441 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830519f-3197-44b6-89d1-316b7b471f89 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:18.443572 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830519f-3197-44b6-89d1-316b7b471f89 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:18.444279 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830519f-3197-44b6-89d1-316b7b471f89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:35:18.444588 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830519f-3197-44b6-89d1-316b7b471f89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:18.445982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830519f-3197-44b6-89d1-316b7b471f89 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:18.453941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 605/1189] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:35:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:35:18.462292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba294c09-d8ec-4340-bc49-59ed8f6ab0b7 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:18.582683 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba294c09-d8ec-4340-bc49-59ed8f6ab0b7 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:18.619460 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c2692-478f-4a87-aef2-4748d6d23b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:18.620319 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c2692-478f-4a87-aef2-4748d6d23b6c None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:18.620596 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c2692-478f-4a87-aef2-4748d6d23b6c None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:18.620866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c2692-478f-4a87-aef2-4748d6d23b6c None admin] PATH_INFO: `/v3/users/befe34e070f146dfa0769a2ec46da628` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:18.622163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c2692-478f-4a87-aef2-4748d6d23b6c None admin] RBAC: Authorizing `identity:get_user(user_id=befe34e070f146dfa0769a2ec46da628)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:18.623636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c2692-478f-4a87-aef2-4748d6d23b6c None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:18.625221 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 585/1190] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:35:18 2022] GET /identity/v3/users/befe34e070f146dfa0769a2ec46da628 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:35:18.632476 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830519f-3197-44b6-89d1-316b7b471f89 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:18.749214 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830519f-3197-44b6-89d1-316b7b471f89 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:18.782663 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b49b2-fc0d-48d6-baa9-0a5bd035d1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:18.783555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b49b2-fc0d-48d6-baa9-0a5bd035d1ad None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:18.783829 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b49b2-fc0d-48d6-baa9-0a5bd035d1ad None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:18.784101 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b49b2-fc0d-48d6-baa9-0a5bd035d1ad None admin] PATH_INFO: `/v3/projects/84dd6f1c10fa487abebc9ad8943ca11b` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:18.785323 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b49b2-fc0d-48d6-baa9-0a5bd035d1ad None admin] RBAC: Authorizing `identity:get_project(project_id=84dd6f1c10fa487abebc9ad8943ca11b)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:18.786767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b49b2-fc0d-48d6-baa9-0a5bd035d1ad None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:18.788615 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 606/1191] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:35:18 2022] GET /identity/v3/projects/84dd6f1c10fa487abebc9ad8943ca11b => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:35:18.795026 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c2692-478f-4a87-aef2-4748d6d23b6c None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:18.902868 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c2692-478f-4a87-aef2-4748d6d23b6c None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:18.936445 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22512daa-3a9c-41eb-9981-973b1f349c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:18.937329 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22512daa-3a9c-41eb-9981-973b1f349c71 None admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:18.937611 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22512daa-3a9c-41eb-9981-973b1f349c71 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:18.937894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22512daa-3a9c-41eb-9981-973b1f349c71 None admin] PATH_INFO: `/v3/projects/84dd6f1c10fa487abebc9ad8943ca11b/users/befe34e070f146dfa0769a2ec46da628/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:18.939995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22512daa-3a9c-41eb-9981-973b1f349c71 None admin] RBAC: Authorizing `identity:create_grant(project_id=84dd6f1c10fa487abebc9ad8943ca11b, user_id=befe34e070f146dfa0769a2ec46da628, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:18.941429 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22512daa-3a9c-41eb-9981-973b1f349c71 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:18.958691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 586/1192] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:35:18 2022] PUT /identity/v3/projects/84dd6f1c10fa487abebc9ad8943ca11b/users/befe34e070f146dfa0769a2ec46da628/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:35:21.171310 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddd0c5-4f1c-4038-a414-752d48309695 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:21.172183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddd0c5-4f1c-4038-a414-752d48309695 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:21.172317 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddd0c5-4f1c-4038-a414-752d48309695 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:21.174532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 607/1193] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:35:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:35:21.183538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140a99a-6808-42ab-8fed-2425bafdf1ac None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:21.183953 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140a99a-6808-42ab-8fed-2425bafdf1ac None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:21.184123 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140a99a-6808-42ab-8fed-2425bafdf1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:21.205252 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-3140a99a-6808-42ab-8fed-2425bafdf1ac None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:35:21.206430 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-3140a99a-6808-42ab-8fed-2425bafdf1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:35:21.273686 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 587/1194] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:35:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:35:21.302520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddd0c5-4f1c-4038-a414-752d48309695 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:21.407337 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddd0c5-4f1c-4038-a414-752d48309695 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:21.444875 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f2727-6818-4dc6-9488-fb654fc35160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:21.445600 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f2727-6818-4dc6-9488-fb654fc35160 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:21.445880 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f2727-6818-4dc6-9488-fb654fc35160 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:21.446153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f2727-6818-4dc6-9488-fb654fc35160 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:21.457273 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f2727-6818-4dc6-9488-fb654fc35160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:35:21.464895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-0b4f2727-6818-4dc6-9488-fb654fc35160 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:35:21.464895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:35:21.464895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:35:21.464895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:35:21.464895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:35:21.464895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:35:21.464895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:35:21.464895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:35:21.464895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:35:21.464895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:35:21.464895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:35:21.464895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:35:21.464895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:35:21.464895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:35:21.464895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:35:21.464895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:35:21.465989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:35:21.465989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:35:21.465989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:35:21.465989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:35:21.465989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:35:21.465989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:35:21.465989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:35:21.465989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:35:21.465989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:35:21.465989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:35:21.465989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:35:21.465989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:35:21.465989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:35:21.465989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:35:21.465989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:35:21.465989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:35:21.467392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:35:21.467392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:35:21.467392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:35:21.467392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:35:21.467392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:35:21.467392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:35:21.467392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:35:21.467392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:35:21.467392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:35:21.467392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:35:21.467392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:35:21.467392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:35:21.467392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 608/1195] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:35:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:35:21.476063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140a99a-6808-42ab-8fed-2425bafdf1ac None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:21.574008 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140a99a-6808-42ab-8fed-2425bafdf1ac None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:21.608058 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32174fbd-9c8e-4099-bb8b-476ec7b6e269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:21.608719 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32174fbd-9c8e-4099-bb8b-476ec7b6e269 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:21.608987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32174fbd-9c8e-4099-bb8b-476ec7b6e269 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:21.609267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32174fbd-9c8e-4099-bb8b-476ec7b6e269 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:21.610006 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32174fbd-9c8e-4099-bb8b-476ec7b6e269 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:35:21.610306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32174fbd-9c8e-4099-bb8b-476ec7b6e269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:21.611713 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32174fbd-9c8e-4099-bb8b-476ec7b6e269 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:21.620173 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 588/1196] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:35:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:35:21.629250 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f2727-6818-4dc6-9488-fb654fc35160 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:21.728288 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f2727-6818-4dc6-9488-fb654fc35160 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:21.764471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fba5b6-fcba-463c-9892-8292d86b68c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:21.765314 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fba5b6-fcba-463c-9892-8292d86b68c2 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:21.765593 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fba5b6-fcba-463c-9892-8292d86b68c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:21.765862 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fba5b6-fcba-463c-9892-8292d86b68c2 None admin] PATH_INFO: `/v3/users/befe34e070f146dfa0769a2ec46da628` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:21.767176 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fba5b6-fcba-463c-9892-8292d86b68c2 None admin] RBAC: Authorizing `identity:get_user(user_id=befe34e070f146dfa0769a2ec46da628)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:21.768609 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fba5b6-fcba-463c-9892-8292d86b68c2 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:21.770222 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 609/1197] 10.222.0.11 () {56 vars in 1177 bytes} [Wed May 4 21:35:21 2022] GET /identity/v3/users/befe34e070f146dfa0769a2ec46da628 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:35:21.776836 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32174fbd-9c8e-4099-bb8b-476ec7b6e269 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:21.885994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32174fbd-9c8e-4099-bb8b-476ec7b6e269 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:21.919542 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb359f73-6e3b-412f-b2f5-c07d2f61cf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:21.920189 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb359f73-6e3b-412f-b2f5-c07d2f61cf8d None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:21.920474 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb359f73-6e3b-412f-b2f5-c07d2f61cf8d None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:21.920741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb359f73-6e3b-412f-b2f5-c07d2f61cf8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:21.987005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb359f73-6e3b-412f-b2f5-c07d2f61cf8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:21.988408 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb359f73-6e3b-412f-b2f5-c07d2f61cf8d None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:22.087656 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 589/1198] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:35:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:35:22.094178 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fba5b6-fcba-463c-9892-8292d86b68c2 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:22.212449 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fba5b6-fcba-463c-9892-8292d86b68c2 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:22.246960 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ad6a1-78cd-4f03-86e1-b8a3b114ca72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:22.247785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ad6a1-78cd-4f03-86e1-b8a3b114ca72 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:22.248061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ad6a1-78cd-4f03-86e1-b8a3b114ca72 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:22.248331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ad6a1-78cd-4f03-86e1-b8a3b114ca72 None admin] PATH_INFO: `/v3/projects/84dd6f1c10fa487abebc9ad8943ca11b` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:22.249627 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ad6a1-78cd-4f03-86e1-b8a3b114ca72 None admin] RBAC: Authorizing `identity:get_project(project_id=84dd6f1c10fa487abebc9ad8943ca11b)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:22.251082 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ad6a1-78cd-4f03-86e1-b8a3b114ca72 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:22.252761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 610/1199] 10.222.0.11 () {56 vars in 1186 bytes} [Wed May 4 21:35:22 2022] GET /identity/v3/projects/84dd6f1c10fa487abebc9ad8943ca11b => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:35:22.259495 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb359f73-6e3b-412f-b2f5-c07d2f61cf8d None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:35:22.356487 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb359f73-6e3b-412f-b2f5-c07d2f61cf8d None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:35:22.395108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee083147-b78b-4de3-afc6-4d1976c3fb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:35:22.395791 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee083147-b78b-4de3-afc6-4d1976c3fb3d None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:35:22.396077 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee083147-b78b-4de3-afc6-4d1976c3fb3d None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:35:22.396566 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee083147-b78b-4de3-afc6-4d1976c3fb3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:35:22.397412 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee083147-b78b-4de3-afc6-4d1976c3fb3d None admin] RBAC: Adding query filter params (role.id=59778f07f0504e90a60212f460e8c774, scope.project.id=84dd6f1c10fa487abebc9ad8943ca11b, user.id=befe34e070f146dfa0769a2ec46da628) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:35:22.397728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee083147-b78b-4de3-afc6-4d1976c3fb3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:35:22.399188 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee083147-b78b-4de3-afc6-4d1976c3fb3d None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:35:22.405292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 590/1200] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:35:22 2022] GET /identity/v3/role_assignments?user.id=befe34e070f146dfa0769a2ec46da628&scope.project.id=84dd6f1c10fa487abebc9ad8943ca11b&role.id=59778f07f0504e90a60212f460e8c774 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:23.385641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1add2c1-5824-43c3-bfa4-b584e05789be None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:23.386256 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1add2c1-5824-43c3-bfa4-b584e05789be None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:23.386256 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1add2c1-5824-43c3-bfa4-b584e05789be None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:23.387880 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 611/1201] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:36:23.394108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b3e23-efe7-4b82-bda0-64e400eec039 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:23.394902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b3e23-efe7-4b82-bda0-64e400eec039 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:23.394902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b3e23-efe7-4b82-bda0-64e400eec039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:23.413848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-c63b3e23-efe7-4b82-bda0-64e400eec039 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:36:23.415251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c63b3e23-efe7-4b82-bda0-64e400eec039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:36:23.500492 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 591/1202] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:36:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:36:23.527575 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1add2c1-5824-43c3-bfa4-b584e05789be None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:23.667841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1add2c1-5824-43c3-bfa4-b584e05789be None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:23.706285 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f4ad2-d966-4ef1-8e71-26a74fc0621b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:23.707319 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f4ad2-d966-4ef1-8e71-26a74fc0621b None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:23.707601 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f4ad2-d966-4ef1-8e71-26a74fc0621b None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:23.707872 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f4ad2-d966-4ef1-8e71-26a74fc0621b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:23.719080 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f4ad2-d966-4ef1-8e71-26a74fc0621b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:23.720582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f4ad2-d966-4ef1-8e71-26a74fc0621b None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:23.743536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-f20f4ad2-d966-4ef1-8e71-26a74fc0621b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:23.743536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:23.743536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:23.743536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:23.743536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:23.743536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:23.743536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:23.743536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:23.743536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:23.743536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:23.743536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:23.743536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:23.743536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:36:23.743536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:36:23.743536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:36:23.744625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:36:23.744625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:23.744625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:23.744625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:23.744625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:23.744625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:23.744625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:23.744625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:23.744625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:36:23.744625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:23.744625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:23.744625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:23.744625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:23.744625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:23.744625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:23.744625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:23.744625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:23.745613 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:36:23.745613 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:36:23.745613 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:23.745613 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:36:23.745871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 612/1203] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:23.751296 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b3e23-efe7-4b82-bda0-64e400eec039 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:23.870483 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b3e23-efe7-4b82-bda0-64e400eec039 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:23.915239 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f3557-4485-4cfc-8b4c-86e5f5b12d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:23.916288 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f3557-4485-4cfc-8b4c-86e5f5b12d94 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:23.916757 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f3557-4485-4cfc-8b4c-86e5f5b12d94 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:23.917215 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f3557-4485-4cfc-8b4c-86e5f5b12d94 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:23.918168 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f3557-4485-4cfc-8b4c-86e5f5b12d94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:23.918659 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f3557-4485-4cfc-8b4c-86e5f5b12d94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:23.920366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f3557-4485-4cfc-8b4c-86e5f5b12d94 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:23.934650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 592/1204] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:36:23.941089 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f4ad2-d966-4ef1-8e71-26a74fc0621b None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:24.054574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f4ad2-d966-4ef1-8e71-26a74fc0621b None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:24.091739 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400b7bc-82b2-4598-a370-66d99edab999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:24.092620 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400b7bc-82b2-4598-a370-66d99edab999 None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:24.092865 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400b7bc-82b2-4598-a370-66d99edab999 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:24.093086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400b7bc-82b2-4598-a370-66d99edab999 None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:24.093799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400b7bc-82b2-4598-a370-66d99edab999 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:24.095262 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400b7bc-82b2-4598-a370-66d99edab999 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:24.119336 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 613/1205] 10.222.0.11 () {60 vars in 1132 bytes} [Wed May 4 21:36:23 2022] POST /identity/v3/users => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:36:26.785779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dad2e-0205-40a4-810b-7dd2463f0816 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:26.786329 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dad2e-0205-40a4-810b-7dd2463f0816 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:26.786329 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dad2e-0205-40a4-810b-7dd2463f0816 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:26.787741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 593/1206] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:36:26.793869 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75e0e0-fd71-4b09-96e0-400a7d0e5cd9 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:26.794369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75e0e0-fd71-4b09-96e0-400a7d0e5cd9 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:26.794523 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75e0e0-fd71-4b09-96e0-400a7d0e5cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:26.813122 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-fc75e0e0-fd71-4b09-96e0-400a7d0e5cd9 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:36:26.814310 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-fc75e0e0-fd71-4b09-96e0-400a7d0e5cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:36:26.886955 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 614/1207] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:36:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:36:26.912274 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28dad2e-0205-40a4-810b-7dd2463f0816 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:27.020679 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28dad2e-0205-40a4-810b-7dd2463f0816 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:27.056229 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937a83a-8afc-4566-81ac-52c8efdcc2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:27.057031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937a83a-8afc-4566-81ac-52c8efdcc2c2 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:27.057309 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937a83a-8afc-4566-81ac-52c8efdcc2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:27.057582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937a83a-8afc-4566-81ac-52c8efdcc2c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:27.069489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937a83a-8afc-4566-81ac-52c8efdcc2c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:36:27.077113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-e937a83a-8afc-4566-81ac-52c8efdcc2c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:36:27.077113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:27.077113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:27.077113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:27.077113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:27.077113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:27.077113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:27.077113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:27.077113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:27.077113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:27.077113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:27.077113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:27.077113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:36:27.077113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:36:27.077113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:36:27.077113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:36:27.078104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:36:27.078104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:36:27.078104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:36:27.078104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:36:27.078104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:27.078104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:27.078104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:27.078104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:27.078104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:27.078104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:27.078104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:27.078104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:36:27.078104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:27.078104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:27.078104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:27.078104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:27.079650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:27.079650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:27.079650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:27.079650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:27.079650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:36:27.079650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:36:27.079650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:36:27.079650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:36:27.079650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:36:27.079650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:36:27.079650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:36:27.079650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:27.079650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 594/1208] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:36:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:27.084426 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75e0e0-fd71-4b09-96e0-400a7d0e5cd9 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:27.189845 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75e0e0-fd71-4b09-96e0-400a7d0e5cd9 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:27.225018 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56cdc2-80c0-4c8c-80f5-29ba202d92aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:27.225693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56cdc2-80c0-4c8c-80f5-29ba202d92aa None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:27.225995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56cdc2-80c0-4c8c-80f5-29ba202d92aa None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:27.226289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56cdc2-80c0-4c8c-80f5-29ba202d92aa None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:27.226992 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56cdc2-80c0-4c8c-80f5-29ba202d92aa None admin] RBAC: Adding query filter params (name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:27.227335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56cdc2-80c0-4c8c-80f5-29ba202d92aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:27.228692 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56cdc2-80c0-4c8c-80f5-29ba202d92aa None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:27.237149 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 615/1209] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:36:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:27.243177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937a83a-8afc-4566-81ac-52c8efdcc2c2 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:27.349754 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937a83a-8afc-4566-81ac-52c8efdcc2c2 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:27.387385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d70ef9-f27a-4014-a1fd-e6bb8d6ae6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:27.388326 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d70ef9-f27a-4014-a1fd-e6bb8d6ae6e3 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:27.388697 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d70ef9-f27a-4014-a1fd-e6bb8d6ae6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:27.388974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d70ef9-f27a-4014-a1fd-e6bb8d6ae6e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:27.400228 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d70ef9-f27a-4014-a1fd-e6bb8d6ae6e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:27.401700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d70ef9-f27a-4014-a1fd-e6bb8d6ae6e3 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:27.418807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-a2d70ef9-f27a-4014-a1fd-e6bb8d6ae6e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:27.418807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:27.418807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:27.418807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:27.418807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:27.418807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:27.418807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:27.418807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:27.418807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:27.418807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:27.418807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:27.418807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:27.418807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:36:27.418807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:36:27.418807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:36:27.420013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:36:27.420013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:27.420013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:27.420013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:27.420013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:27.420013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:27.420013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:27.420013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:27.420013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:36:27.420013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:27.420013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:27.420013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:27.420013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:27.420013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:27.420013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:27.420013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:27.420013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:27.425917 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:36:27.425917 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:36:27.425917 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:27.425917 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:27.425917 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 595/1210] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:36:27.426273 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56cdc2-80c0-4c8c-80f5-29ba202d92aa None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:27.547844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56cdc2-80c0-4c8c-80f5-29ba202d92aa None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:27.590005 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c6ecb-66ea-44d9-ae99-fcb0e94eae4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:27.590686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c6ecb-66ea-44d9-ae99-fcb0e94eae4c None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:27.590973 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c6ecb-66ea-44d9-ae99-fcb0e94eae4c None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:27.592505 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c6ecb-66ea-44d9-ae99-fcb0e94eae4c None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:27.592505 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c6ecb-66ea-44d9-ae99-fcb0e94eae4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:27.592505 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c6ecb-66ea-44d9-ae99-fcb0e94eae4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:27.593758 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c6ecb-66ea-44d9-ae99-fcb0e94eae4c None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:27.611078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 616/1211] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:36:27.614644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d70ef9-f27a-4014-a1fd-e6bb8d6ae6e3 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:27.727033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d70ef9-f27a-4014-a1fd-e6bb8d6ae6e3 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:27.766286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9e588-a189-44cd-8d79-43f334f3b1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:27.767404 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9e588-a189-44cd-8d79-43f334f3b1bd None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:27.767714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9e588-a189-44cd-8d79-43f334f3b1bd None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:27.768012 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9e588-a189-44cd-8d79-43f334f3b1bd None admin] PATH_INFO: `/v3/users/placement` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:27.777010 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9e588-a189-44cd-8d79-43f334f3b1bd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:27.779079 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9e588-a189-44cd-8d79-43f334f3b1bd None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:27.794402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-7ae9e588-a189-44cd-8d79-43f334f3b1bd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 21:36:27.794402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:27.794402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:27.794402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:27.794402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:27.794402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:27.794402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:27.794402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:27.794402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:27.794402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:27.794402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:27.794402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:27.794402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:36:27.794402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:36:27.794402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:36:27.794402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:36:27.801454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:27.801454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:27.801454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:36:27.801454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:36:27.801454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:36:27.801454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:36:27.801454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:27.801454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:27.801454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:27.801454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:27.801454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:27.801454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:36:27.801454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:27.801454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:27.801454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:27.801454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:27.801454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:27.801454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:27.802435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:27.802435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:27.802435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:36:27.802435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:36:27.802435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:36:27.802435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:36:27.802435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:36:27.802435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:36:27.802435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 21:36:27.802435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:27.802435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 596/1212] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:36:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:36:27.803072 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c6ecb-66ea-44d9-ae99-fcb0e94eae4c None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:27.912649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c6ecb-66ea-44d9-ae99-fcb0e94eae4c None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:27.948511 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3127ff-f480-4514-ac97-2b7682cc466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:27.949196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3127ff-f480-4514-ac97-2b7682cc466b None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:27.949483 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3127ff-f480-4514-ac97-2b7682cc466b None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:27.949759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3127ff-f480-4514-ac97-2b7682cc466b None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:27.950620 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3127ff-f480-4514-ac97-2b7682cc466b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:27.950935 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3127ff-f480-4514-ac97-2b7682cc466b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:27.952460 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3127ff-f480-4514-ac97-2b7682cc466b None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:27.970590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 617/1213] 10.222.0.11 () {56 vars in 1143 bytes} [Wed May 4 21:36:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:36:27.977704 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9e588-a189-44cd-8d79-43f334f3b1bd None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:28.091311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9e588-a189-44cd-8d79-43f334f3b1bd None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:28.139990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8c5e4-0ad8-42bd-b15c-4b66b499cc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:28.140658 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8c5e4-0ad8-42bd-b15c-4b66b499cc62 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:28.140942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8c5e4-0ad8-42bd-b15c-4b66b499cc62 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:28.141219 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8c5e4-0ad8-42bd-b15c-4b66b499cc62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:28.213149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8c5e4-0ad8-42bd-b15c-4b66b499cc62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:28.214755 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8c5e4-0ad8-42bd-b15c-4b66b499cc62 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:28.315875 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 597/1214] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:36:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:36:28.322140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3127ff-f480-4514-ac97-2b7682cc466b None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:28.432267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3127ff-f480-4514-ac97-2b7682cc466b None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:28.466715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e91c40-1a79-48d0-aa0e-7cf67fb528b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:28.467568 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e91c40-1a79-48d0-aa0e-7cf67fb528b7 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:28.467849 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e91c40-1a79-48d0-aa0e-7cf67fb528b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:28.468128 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e91c40-1a79-48d0-aa0e-7cf67fb528b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:28.479592 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e91c40-1a79-48d0-aa0e-7cf67fb528b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:28.481092 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e91c40-1a79-48d0-aa0e-7cf67fb528b7 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:28.498990 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-11e91c40-1a79-48d0-aa0e-7cf67fb528b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:28.498990 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:28.498990 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:28.498990 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:28.498990 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:28.498990 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:28.498990 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:28.498990 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:28.498990 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:28.498990 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:28.498990 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:28.498990 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:28.498990 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:36:28.498990 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:36:28.498990 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:36:28.500334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:36:28.500334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:28.500334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:28.500334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:28.500334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:28.500334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:28.500334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:28.500334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:28.500334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:36:28.500334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:28.500334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:28.500334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:28.500334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:28.500334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:28.500334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:28.500334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:28.500334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:28.501253 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:36:28.501253 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:36:28.501253 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:28.501253 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:36:28.501253 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 618/1215] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:28.506573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8c5e4-0ad8-42bd-b15c-4b66b499cc62 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:28.618633 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8c5e4-0ad8-42bd-b15c-4b66b499cc62 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:28.662271 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6761c-cf23-4a0d-a5bc-04af07ae390e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:28.662939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6761c-cf23-4a0d-a5bc-04af07ae390e None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:28.663254 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6761c-cf23-4a0d-a5bc-04af07ae390e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:28.663532 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6761c-cf23-4a0d-a5bc-04af07ae390e None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:28.664255 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6761c-cf23-4a0d-a5bc-04af07ae390e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:28.664573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6761c-cf23-4a0d-a5bc-04af07ae390e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:28.665924 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6761c-cf23-4a0d-a5bc-04af07ae390e None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:28.679163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 598/1216] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:28.684871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e91c40-1a79-48d0-aa0e-7cf67fb528b7 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:28.799220 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e91c40-1a79-48d0-aa0e-7cf67fb528b7 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:28.839617 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86176fdd-8c41-485e-8b51-9470a241a349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:28.840578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86176fdd-8c41-485e-8b51-9470a241a349 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:28.840880 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86176fdd-8c41-485e-8b51-9470a241a349 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:28.841137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86176fdd-8c41-485e-8b51-9470a241a349 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:28.850068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86176fdd-8c41-485e-8b51-9470a241a349 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:28.852077 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86176fdd-8c41-485e-8b51-9470a241a349 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:28.869135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-86176fdd-8c41-485e-8b51-9470a241a349 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:36:28.869135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:28.869135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:28.869135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:28.869135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:28.869135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:28.869135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:28.869135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:28.869135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:28.869135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:28.869135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:28.869135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:28.869135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:36:28.869135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:36:28.869135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:36:28.870358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:36:28.870358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:28.870358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:28.870358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:28.870358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:28.870358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:28.870358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:28.870358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:28.870358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:36:28.870358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:28.870358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:28.870358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:28.870358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:28.870358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:28.870358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:28.870358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:28.870358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:28.871512 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:36:28.871512 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:36:28.871512 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:36:28.871512 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:36:28.871512 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:36:28.871512 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:36:28.871512 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:36:28.871512 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:36:28.873501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 619/1217] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:36:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:36:28.880282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6761c-cf23-4a0d-a5bc-04af07ae390e None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:28.997086 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6761c-cf23-4a0d-a5bc-04af07ae390e None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:29.038179 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357b45f-4243-424f-b626-24ddccfda09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:29.039082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357b45f-4243-424f-b626-24ddccfda09a None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:29.039497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357b45f-4243-424f-b626-24ddccfda09a None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:29.039867 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357b45f-4243-424f-b626-24ddccfda09a None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:29.041015 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357b45f-4243-424f-b626-24ddccfda09a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:29.041482 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357b45f-4243-424f-b626-24ddccfda09a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:29.043473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357b45f-4243-424f-b626-24ddccfda09a None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:29.062711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 599/1218] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:36:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:29.064812 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86176fdd-8c41-485e-8b51-9470a241a349 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:29.194036 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86176fdd-8c41-485e-8b51-9470a241a349 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:29.234317 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d95ff-05e2-4154-bc07-123c6dc95425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:29.234985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d95ff-05e2-4154-bc07-123c6dc95425 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:29.235304 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d95ff-05e2-4154-bc07-123c6dc95425 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:29.235598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d95ff-05e2-4154-bc07-123c6dc95425 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:29.236468 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d95ff-05e2-4154-bc07-123c6dc95425 None admin] RBAC: Adding query filter params (role.id=c1ee07ef1a1f4986afc3af5a357e2c4c, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=e203d7077af54930a640b2334a1d8fa6) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:29.236781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d95ff-05e2-4154-bc07-123c6dc95425 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:29.238347 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d95ff-05e2-4154-bc07-123c6dc95425 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:29.244424 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 620/1219] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:36:29 2022] GET /identity/v3/role_assignments?user.id=e203d7077af54930a640b2334a1d8fa6&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=c1ee07ef1a1f4986afc3af5a357e2c4c => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:31.483789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54fe7b-d0c4-4102-8448-fae032fe9278 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:31.484347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54fe7b-d0c4-4102-8448-fae032fe9278 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:31.484347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54fe7b-d0c4-4102-8448-fae032fe9278 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:31.486176 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 600/1220] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:36:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:36:31.492557 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15f98a-5709-4021-8399-1a5a77a5db21 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:31.493045 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15f98a-5709-4021-8399-1a5a77a5db21 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:31.493324 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15f98a-5709-4021-8399-1a5a77a5db21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:31.512277 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-3e15f98a-5709-4021-8399-1a5a77a5db21 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:36:31.513849 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-3e15f98a-5709-4021-8399-1a5a77a5db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:36:31.593543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 621/1221] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:36:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:36:31.623082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54fe7b-d0c4-4102-8448-fae032fe9278 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:31.739742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54fe7b-d0c4-4102-8448-fae032fe9278 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:31.772602 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b986b6-8cf6-41d5-be9d-a79f69c9e60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:31.773431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b986b6-8cf6-41d5-be9d-a79f69c9e60f None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:31.773693 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b986b6-8cf6-41d5-be9d-a79f69c9e60f None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:31.773969 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b986b6-8cf6-41d5-be9d-a79f69c9e60f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:31.784075 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b986b6-8cf6-41d5-be9d-a79f69c9e60f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:36:31.791983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-86b986b6-8cf6-41d5-be9d-a79f69c9e60f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:36:31.791983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:31.791983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:31.791983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:31.791983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:31.791983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:31.791983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:31.791983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:31.791983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:31.791983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:31.791983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:31.791983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:31.791983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:36:31.791983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:36:31.791983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:36:31.791983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:36:31.793210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:36:31.793210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:36:31.793210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:36:31.793210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:36:31.793210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:31.793210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:31.793210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:31.793210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:31.793210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:31.793210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:31.793210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:31.793210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:36:31.793210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:31.793210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:31.793210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:31.793210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:31.794067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:31.794067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:31.794067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:31.794067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:31.794067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:36:31.794067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:36:31.794067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:36:31.794067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:36:31.794067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:36:31.794067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:36:31.794067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:36:31.794067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:31.794067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 601/1222] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:36:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:31.799442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15f98a-5709-4021-8399-1a5a77a5db21 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:31.904826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15f98a-5709-4021-8399-1a5a77a5db21 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:31.938025 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998682cf-d7b7-4fdd-8678-5533aad9daad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:31.938806 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998682cf-d7b7-4fdd-8678-5533aad9daad None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:31.939170 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998682cf-d7b7-4fdd-8678-5533aad9daad None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:31.939473 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998682cf-d7b7-4fdd-8678-5533aad9daad None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:31.940279 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998682cf-d7b7-4fdd-8678-5533aad9daad None admin] RBAC: Adding query filter params (name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:31.940616 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998682cf-d7b7-4fdd-8678-5533aad9daad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:31.942008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998682cf-d7b7-4fdd-8678-5533aad9daad None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:31.950245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 622/1223] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:36:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:31.956549 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b986b6-8cf6-41d5-be9d-a79f69c9e60f None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:32.056761 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b986b6-8cf6-41d5-be9d-a79f69c9e60f None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:32.090771 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93493ae1-667a-4357-a07c-ed7a5cc1aaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:32.091593 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93493ae1-667a-4357-a07c-ed7a5cc1aaed None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:32.091872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93493ae1-667a-4357-a07c-ed7a5cc1aaed None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:32.092143 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93493ae1-667a-4357-a07c-ed7a5cc1aaed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:32.106986 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93493ae1-667a-4357-a07c-ed7a5cc1aaed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:32.109254 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93493ae1-667a-4357-a07c-ed7a5cc1aaed None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:32.132148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-93493ae1-667a-4357-a07c-ed7a5cc1aaed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:32.132148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:32.132148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:32.132148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:32.132148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:32.132148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:32.132148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:32.132148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:32.132148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:32.132148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:32.132148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:32.132148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:32.132148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:36:32.132148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:36:32.132148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:36:32.133293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:36:32.133293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:32.133293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:32.133293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:32.133293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:32.133293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:32.133293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:32.133293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:32.133293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:36:32.133293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:32.133293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:32.133293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:32.133293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:32.133293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:32.133293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:32.133293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:32.133293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:32.134400 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:36:32.134400 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:36:32.134400 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:32.134400 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:32.134400 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 602/1224] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:32.141282 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998682cf-d7b7-4fdd-8678-5533aad9daad None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:32.251892 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998682cf-d7b7-4fdd-8678-5533aad9daad None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:32.284745 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f754aa-44ff-4207-abff-e36b8f3ef292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:32.285425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f754aa-44ff-4207-abff-e36b8f3ef292 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:32.285740 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f754aa-44ff-4207-abff-e36b8f3ef292 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:32.286013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f754aa-44ff-4207-abff-e36b8f3ef292 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:32.286711 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f754aa-44ff-4207-abff-e36b8f3ef292 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:32.287016 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f754aa-44ff-4207-abff-e36b8f3ef292 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:32.288447 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f754aa-44ff-4207-abff-e36b8f3ef292 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:32.300243 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 623/1225] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:32.306141 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93493ae1-667a-4357-a07c-ed7a5cc1aaed None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:32.406490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93493ae1-667a-4357-a07c-ed7a5cc1aaed None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:32.442408 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0508a-bd81-4fb7-9966-afeba8b90799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:32.443270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0508a-bd81-4fb7-9966-afeba8b90799 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:32.443562 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0508a-bd81-4fb7-9966-afeba8b90799 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:32.443837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0508a-bd81-4fb7-9966-afeba8b90799 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:32.452785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0508a-bd81-4fb7-9966-afeba8b90799 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:32.454255 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0508a-bd81-4fb7-9966-afeba8b90799 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:32.469375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-38a0508a-bd81-4fb7-9966-afeba8b90799 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 21:36:32.469375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:32.469375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:32.469375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:32.469375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:32.469375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:32.469375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:32.469375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:32.469375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:32.469375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:32.469375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:32.469375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:32.469375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:36:32.469375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:36:32.469375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:36:32.469375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:36:32.470564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:32.470564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:32.470564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:36:32.470564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:36:32.470564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:36:32.470564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:36:32.470564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:32.470564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:32.470564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:32.470564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:32.470564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:32.470564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:36:32.470564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:32.470564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:32.470564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:32.470564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:32.470564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:32.470564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:32.472522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:32.472522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:32.472522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:36:32.472522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:36:32.472522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:36:32.472522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:36:32.472522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:36:32.472522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:36:32.472522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 21:36:32.472522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:32.475783 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 603/1226] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:36:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:32.476988 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f754aa-44ff-4207-abff-e36b8f3ef292 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:32.577455 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f754aa-44ff-4207-abff-e36b8f3ef292 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:32.613444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e79a8-e62a-48b7-a34e-2a720cd9503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:32.614120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e79a8-e62a-48b7-a34e-2a720cd9503d None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:32.614396 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e79a8-e62a-48b7-a34e-2a720cd9503d None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:32.614684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e79a8-e62a-48b7-a34e-2a720cd9503d None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:32.615548 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e79a8-e62a-48b7-a34e-2a720cd9503d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:32.615853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e79a8-e62a-48b7-a34e-2a720cd9503d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:32.617291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e79a8-e62a-48b7-a34e-2a720cd9503d None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:32.636314 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 624/1227] 10.222.0.11 () {56 vars in 1143 bytes} [Wed May 4 21:36:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:32.641941 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0508a-bd81-4fb7-9966-afeba8b90799 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:32.746787 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0508a-bd81-4fb7-9966-afeba8b90799 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:32.783435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc666e-7b02-4da0-b5de-600747b1544b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:32.784337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc666e-7b02-4da0-b5de-600747b1544b None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:32.784798 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc666e-7b02-4da0-b5de-600747b1544b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:32.785120 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc666e-7b02-4da0-b5de-600747b1544b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:32.796929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc666e-7b02-4da0-b5de-600747b1544b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:32.798617 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc666e-7b02-4da0-b5de-600747b1544b None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:32.816545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-d1cc666e-7b02-4da0-b5de-600747b1544b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:32.816545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:32.816545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:32.816545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:32.816545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:32.816545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:32.816545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:32.816545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:32.816545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:32.816545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:32.816545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:32.816545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:32.816545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:36:32.816545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:36:32.816545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:36:32.817647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:36:32.817647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:32.817647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:32.817647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:32.817647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:32.817647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:32.817647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:32.817647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:32.817647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:36:32.817647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:32.817647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:32.817647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:32.817647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:32.817647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:32.817647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:32.817647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:32.817647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:32.818738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:36:32.818738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:36:32.818738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:32.818738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:32.818738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 604/1228] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:32.823588 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e79a8-e62a-48b7-a34e-2a720cd9503d None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:32.932705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e79a8-e62a-48b7-a34e-2a720cd9503d None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:32.972525 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6f7b5-2a9b-47f2-adf9-30816b2f0e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:32.973235 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6f7b5-2a9b-47f2-adf9-30816b2f0e02 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:32.973551 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6f7b5-2a9b-47f2-adf9-30816b2f0e02 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:32.973900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6f7b5-2a9b-47f2-adf9-30816b2f0e02 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:32.974685 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6f7b5-2a9b-47f2-adf9-30816b2f0e02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:32.975026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6f7b5-2a9b-47f2-adf9-30816b2f0e02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:32.976623 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6f7b5-2a9b-47f2-adf9-30816b2f0e02 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:32.989306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 625/1229] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:32.994952 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc666e-7b02-4da0-b5de-600747b1544b None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:33.100150 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc666e-7b02-4da0-b5de-600747b1544b None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:33.139642 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54728ee5-5b31-4797-af11-9f5a83fb27ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:33.140572 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54728ee5-5b31-4797-af11-9f5a83fb27ca None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:33.140965 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54728ee5-5b31-4797-af11-9f5a83fb27ca None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:33.141363 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54728ee5-5b31-4797-af11-9f5a83fb27ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:33.150811 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54728ee5-5b31-4797-af11-9f5a83fb27ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:33.152286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54728ee5-5b31-4797-af11-9f5a83fb27ca None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:33.166673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-54728ee5-5b31-4797-af11-9f5a83fb27ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:36:33.166673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:33.166673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:33.166673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:33.166673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:33.166673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:33.166673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:33.166673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:33.166673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:33.166673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:33.166673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:33.166673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:33.166673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:36:33.166673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:36:33.166673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:36:33.167856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:36:33.167856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:33.167856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:33.167856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:33.167856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:33.167856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:33.167856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:33.167856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:33.167856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:36:33.167856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:33.167856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:33.167856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:33.167856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:33.167856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:33.167856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:33.167856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:33.167856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:33.168928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:36:33.168928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:36:33.168928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:36:33.168928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:36:33.168928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:36:33.168928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:36:33.168928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:36:33.168928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:33.168928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 605/1230] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:33.174267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6f7b5-2a9b-47f2-adf9-30816b2f0e02 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:33.281975 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6f7b5-2a9b-47f2-adf9-30816b2f0e02 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:33.320054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f7c0e-9135-4bb4-b1bd-ab0d95ccde48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:33.320722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f7c0e-9135-4bb4-b1bd-ab0d95ccde48 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:33.321011 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f7c0e-9135-4bb4-b1bd-ab0d95ccde48 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:33.321288 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f7c0e-9135-4bb4-b1bd-ab0d95ccde48 None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:33.322081 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f7c0e-9135-4bb4-b1bd-ab0d95ccde48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:33.322390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f7c0e-9135-4bb4-b1bd-ab0d95ccde48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:33.323860 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f7c0e-9135-4bb4-b1bd-ab0d95ccde48 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:33.335851 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 626/1231] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:36:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:33.341933 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54728ee5-5b31-4797-af11-9f5a83fb27ca None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:33.441522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54728ee5-5b31-4797-af11-9f5a83fb27ca None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:33.479712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad76834-ca62-47c7-9335-b6bfca6cb483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:33.480876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad76834-ca62-47c7-9335-b6bfca6cb483 None admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:33.481171 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad76834-ca62-47c7-9335-b6bfca6cb483 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:33.481512 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad76834-ca62-47c7-9335-b6bfca6cb483 None admin] PATH_INFO: `/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/e203d7077af54930a640b2334a1d8fa6/roles/c1ee07ef1a1f4986afc3af5a357e2c4c` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:33.496827 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad76834-ca62-47c7-9335-b6bfca6cb483 None admin] RBAC: Authorizing `identity:create_grant(project_id=3acb142d1aa34e18a018d3fdee8d7038, user_id=e203d7077af54930a640b2334a1d8fa6, role_id=c1ee07ef1a1f4986afc3af5a357e2c4c)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:33.498344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad76834-ca62-47c7-9335-b6bfca6cb483 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:33.513986 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 606/1232] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:36:33 2022] PUT /identity/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/e203d7077af54930a640b2334a1d8fa6/roles/c1ee07ef1a1f4986afc3af5a357e2c4c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:36:35.761547 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b4f90-450d-4a2e-8950-fd2f8ff0bc86 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:35.762185 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b4f90-450d-4a2e-8950-fd2f8ff0bc86 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:35.762185 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b4f90-450d-4a2e-8950-fd2f8ff0bc86 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:35.763546 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 627/1233] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:36:35.769841 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2e3e5-6367-4d0d-841c-d363a5ceb4b8 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:35.770291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2e3e5-6367-4d0d-841c-d363a5ceb4b8 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:35.770635 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2e3e5-6367-4d0d-841c-d363a5ceb4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:35.788361 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-d1f2e3e5-6367-4d0d-841c-d363a5ceb4b8 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:36:35.789563 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-d1f2e3e5-6367-4d0d-841c-d363a5ceb4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:36:35.860084 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 607/1234] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:36:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:36:35.885162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b4f90-450d-4a2e-8950-fd2f8ff0bc86 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:35.996997 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b4f90-450d-4a2e-8950-fd2f8ff0bc86 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:36.034561 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73729de-d347-4fa1-8cb5-ec4b7abc38a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:36.035434 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73729de-d347-4fa1-8cb5-ec4b7abc38a6 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:36.035718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73729de-d347-4fa1-8cb5-ec4b7abc38a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:36.035994 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73729de-d347-4fa1-8cb5-ec4b7abc38a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:36.047486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73729de-d347-4fa1-8cb5-ec4b7abc38a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:36:36.055799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-d73729de-d347-4fa1-8cb5-ec4b7abc38a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:36:36.055799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:36.055799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:36.055799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:36.055799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:36.055799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:36.055799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:36.055799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:36.055799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:36.055799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:36.055799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:36.055799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:36.055799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:36:36.055799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:36:36.055799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:36:36.055799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:36:36.057068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:36:36.057068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:36:36.057068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:36:36.057068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:36:36.057068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:36.057068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:36.057068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:36.057068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:36.057068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:36.057068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:36.057068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:36.057068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:36:36.057068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:36.057068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:36.057068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:36.057068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:36.058136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:36.058136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:36.058136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:36.058136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:36.058136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:36:36.058136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:36:36.058136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:36:36.058136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:36:36.058136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:36:36.058136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:36:36.058136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:36:36.058136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:36:36.058136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 628/1235] 10.222.0.11 () {56 vars in 1102 bytes} [Wed May 4 21:36:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:36.063657 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2e3e5-6367-4d0d-841c-d363a5ceb4b8 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:36.167932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2e3e5-6367-4d0d-841c-d363a5ceb4b8 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:36.200971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f679339-77ee-41f4-9cbb-b666a4dde3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:36.201653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f679339-77ee-41f4-9cbb-b666a4dde3b3 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:36.201938 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f679339-77ee-41f4-9cbb-b666a4dde3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:36.202216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f679339-77ee-41f4-9cbb-b666a4dde3b3 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:36.202968 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f679339-77ee-41f4-9cbb-b666a4dde3b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:36.203344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f679339-77ee-41f4-9cbb-b666a4dde3b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:36.204706 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f679339-77ee-41f4-9cbb-b666a4dde3b3 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:36.214359 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 608/1236] 10.222.0.11 () {56 vars in 1103 bytes} [Wed May 4 21:36:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:36:36.220348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73729de-d347-4fa1-8cb5-ec4b7abc38a6 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:36.322576 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73729de-d347-4fa1-8cb5-ec4b7abc38a6 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:36.357274 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426a2f3-ba46-433c-bc9e-f8a320528420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:36.358099 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426a2f3-ba46-433c-bc9e-f8a320528420 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:36.358377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426a2f3-ba46-433c-bc9e-f8a320528420 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:36.358651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426a2f3-ba46-433c-bc9e-f8a320528420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:36.369473 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426a2f3-ba46-433c-bc9e-f8a320528420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:36.371133 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426a2f3-ba46-433c-bc9e-f8a320528420 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:36.388691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-4426a2f3-ba46-433c-bc9e-f8a320528420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:36.388691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:36.388691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:36.388691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:36.388691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:36.388691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:36.388691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:36.388691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:36.388691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:36.388691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:36.388691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:36.388691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:36.388691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:36:36.388691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:36:36.388691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:36:36.389821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:36:36.389821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:36.389821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:36.389821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:36.389821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:36.389821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:36.389821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:36.389821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:36.389821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:36:36.389821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:36.389821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:36.389821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:36.389821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:36.389821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:36.389821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:36.389821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:36.389821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:36.390944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:36:36.390944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:36:36.390944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:36.390944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:36:36.390944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 629/1237] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:36.396142 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f679339-77ee-41f4-9cbb-b666a4dde3b3 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:36.512029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f679339-77ee-41f4-9cbb-b666a4dde3b3 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:36.549659 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51c430-61cd-47d1-829e-2c1299b2efb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:36.550426 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51c430-61cd-47d1-829e-2c1299b2efb3 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:36.550714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51c430-61cd-47d1-829e-2c1299b2efb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:36.551117 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51c430-61cd-47d1-829e-2c1299b2efb3 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:36.551954 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51c430-61cd-47d1-829e-2c1299b2efb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:36.552370 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51c430-61cd-47d1-829e-2c1299b2efb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:36.553789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51c430-61cd-47d1-829e-2c1299b2efb3 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:36.566787 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 609/1238] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:36.572350 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426a2f3-ba46-433c-bc9e-f8a320528420 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:36.680468 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426a2f3-ba46-433c-bc9e-f8a320528420 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:36.714888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60156b48-4292-40d8-919e-9e0ea30b2584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:36.715750 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156b48-4292-40d8-919e-9e0ea30b2584 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:36.716062 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156b48-4292-40d8-919e-9e0ea30b2584 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:36.716295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156b48-4292-40d8-919e-9e0ea30b2584 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:36.724962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60156b48-4292-40d8-919e-9e0ea30b2584 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:36.726563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60156b48-4292-40d8-919e-9e0ea30b2584 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:36.742147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-60156b48-4292-40d8-919e-9e0ea30b2584 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 21:36:36.742147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:36.742147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:36.742147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:36.742147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:36.742147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:36.742147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:36.742147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:36.742147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:36.742147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:36.742147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:36.742147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:36.742147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:36:36.742147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:36:36.742147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:36:36.742147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:36:36.743345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:36.743345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:36.743345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:36:36.743345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:36:36.743345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:36:36.743345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:36:36.743345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:36.743345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:36.743345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:36.743345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:36.743345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:36.743345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:36:36.743345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:36.743345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:36.743345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:36.743345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:36.743345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:36.743345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:36.744737 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:36.744737 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:36.744737 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:36:36.744737 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:36:36.744737 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:36:36.744737 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:36:36.744737 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:36:36.744737 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:36:36.744737 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 21:36:36.744737 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:36:36.744737 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 630/1239] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:36:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:36.749787 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51c430-61cd-47d1-829e-2c1299b2efb3 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:36.859337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51c430-61cd-47d1-829e-2c1299b2efb3 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:36.897322 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980b618-cdf0-48fe-8074-b26acd168c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:36.898052 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980b618-cdf0-48fe-8074-b26acd168c84 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:36.898357 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980b618-cdf0-48fe-8074-b26acd168c84 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:36.898741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980b618-cdf0-48fe-8074-b26acd168c84 None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:36.899659 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980b618-cdf0-48fe-8074-b26acd168c84 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:36.899969 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980b618-cdf0-48fe-8074-b26acd168c84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:36.901540 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980b618-cdf0-48fe-8074-b26acd168c84 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:36.921379 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 610/1240] 10.222.0.11 () {56 vars in 1143 bytes} [Wed May 4 21:36:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:36.928074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60156b48-4292-40d8-919e-9e0ea30b2584 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:37.038971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60156b48-4292-40d8-919e-9e0ea30b2584 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:37.076670 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ade16-d19f-4435-ab00-a2b67d3de1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:37.077345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ade16-d19f-4435-ab00-a2b67d3de1e1 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:37.077629 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ade16-d19f-4435-ab00-a2b67d3de1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:37.077902 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ade16-d19f-4435-ab00-a2b67d3de1e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:37.158590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ade16-d19f-4435-ab00-a2b67d3de1e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:37.160707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ade16-d19f-4435-ab00-a2b67d3de1e1 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:37.261765 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 631/1241] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:36:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:36:37.267691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980b618-cdf0-48fe-8074-b26acd168c84 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:37.380931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980b618-cdf0-48fe-8074-b26acd168c84 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:37.416179 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc6018-416f-47e8-bf04-a17b7bddab41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:37.416939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc6018-416f-47e8-bf04-a17b7bddab41 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:37.417224 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc6018-416f-47e8-bf04-a17b7bddab41 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:37.417529 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc6018-416f-47e8-bf04-a17b7bddab41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:37.428230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc6018-416f-47e8-bf04-a17b7bddab41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:37.429707 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc6018-416f-47e8-bf04-a17b7bddab41 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:37.451586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-87fc6018-416f-47e8-bf04-a17b7bddab41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:37.451586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:37.451586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:37.451586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:37.451586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:37.451586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:37.451586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:37.451586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:37.451586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:37.451586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:37.451586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:37.451586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:37.451586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:36:37.451586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:36:37.451586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:36:37.452818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:36:37.452818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:37.452818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:37.452818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:37.452818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:37.452818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:37.452818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:37.452818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:37.452818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:36:37.452818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:37.452818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:37.452818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:37.452818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:37.452818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:37.452818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:37.452818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:37.452818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:37.454036 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:36:37.454036 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:36:37.454036 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:37.454036 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:37.454036 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 611/1242] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:37.460072 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ade16-d19f-4435-ab00-a2b67d3de1e1 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:37.567004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ade16-d19f-4435-ab00-a2b67d3de1e1 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:37.612757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8fcee-245e-4d9f-bbda-fa1e686b5341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:37.613498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8fcee-245e-4d9f-bbda-fa1e686b5341 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:37.613784 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8fcee-245e-4d9f-bbda-fa1e686b5341 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:37.614077 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8fcee-245e-4d9f-bbda-fa1e686b5341 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:37.614834 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8fcee-245e-4d9f-bbda-fa1e686b5341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:37.615175 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8fcee-245e-4d9f-bbda-fa1e686b5341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:37.616579 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8fcee-245e-4d9f-bbda-fa1e686b5341 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:37.628575 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 632/1243] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:37.634876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc6018-416f-47e8-bf04-a17b7bddab41 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:37.745527 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc6018-416f-47e8-bf04-a17b7bddab41 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:37.787755 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0b401-12d9-44c1-b6a1-7140012c21d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:37.788634 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0b401-12d9-44c1-b6a1-7140012c21d0 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:37.788920 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0b401-12d9-44c1-b6a1-7140012c21d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:37.789214 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0b401-12d9-44c1-b6a1-7140012c21d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:37.796385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0b401-12d9-44c1-b6a1-7140012c21d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:37.797997 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0b401-12d9-44c1-b6a1-7140012c21d0 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:37.812217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-06a0b401-12d9-44c1-b6a1-7140012c21d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:36:37.812217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:37.812217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:37.812217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:37.812217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:37.812217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:37.812217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:37.812217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:37.812217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:37.812217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:37.812217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:37.812217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:37.812217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:36:37.812217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:36:37.812217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:36:37.813348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:36:37.813348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:37.813348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:37.813348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:37.813348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:37.813348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:37.813348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:37.813348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:37.813348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:36:37.813348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:37.813348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:37.813348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:37.813348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:37.813348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:37.813348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:37.813348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:37.813348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:37.814257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:36:37.814257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:36:37.814257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:36:37.814257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:36:37.814257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:36:37.814257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:36:37.814257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:36:37.814257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:37.814257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 612/1244] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:37.819899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8fcee-245e-4d9f-bbda-fa1e686b5341 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:37.927825 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8fcee-245e-4d9f-bbda-fa1e686b5341 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:37.968169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d0d71-3e0c-45c5-8f0a-44b003d01383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:37.969943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d0d71-3e0c-45c5-8f0a-44b003d01383 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:37.970203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d0d71-3e0c-45c5-8f0a-44b003d01383 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:37.970491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d0d71-3e0c-45c5-8f0a-44b003d01383 None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:37.972146 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d0d71-3e0c-45c5-8f0a-44b003d01383 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:37.972544 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d0d71-3e0c-45c5-8f0a-44b003d01383 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:37.974195 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d0d71-3e0c-45c5-8f0a-44b003d01383 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:37.988677 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 633/1245] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:36:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:37.994965 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0b401-12d9-44c1-b6a1-7140012c21d0 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:38.116037 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0b401-12d9-44c1-b6a1-7140012c21d0 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:38.162715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85bcff8-04c3-4edb-8ac5-64ab35b00965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:38.163595 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bcff8-04c3-4edb-8ac5-64ab35b00965 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:38.163925 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bcff8-04c3-4edb-8ac5-64ab35b00965 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:38.164295 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bcff8-04c3-4edb-8ac5-64ab35b00965 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:38.165361 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bcff8-04c3-4edb-8ac5-64ab35b00965 None admin] RBAC: Adding query filter params (role.id=c1ee07ef1a1f4986afc3af5a357e2c4c, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=e203d7077af54930a640b2334a1d8fa6) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:38.165908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bcff8-04c3-4edb-8ac5-64ab35b00965 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:38.167461 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bcff8-04c3-4edb-8ac5-64ab35b00965 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:38.175698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 613/1246] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:36:37 2022] GET /identity/v3/role_assignments?user.id=e203d7077af54930a640b2334a1d8fa6&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=c1ee07ef1a1f4986afc3af5a357e2c4c => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:40.504002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1fa74-a270-4666-a2de-aecc0c1b525d None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:40.504552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1fa74-a270-4666-a2de-aecc0c1b525d None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:40.504552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1fa74-a270-4666-a2de-aecc0c1b525d None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:40.505960 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 634/1247] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:36:40.511271 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59091806-e6d2-45bd-91d9-8b8674898334 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:40.511862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59091806-e6d2-45bd-91d9-8b8674898334 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:40.511862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59091806-e6d2-45bd-91d9-8b8674898334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:40.530350 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-59091806-e6d2-45bd-91d9-8b8674898334 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:36:40.531559 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-59091806-e6d2-45bd-91d9-8b8674898334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:36:40.601695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 614/1248] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:36:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:36:40.625770 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1fa74-a270-4666-a2de-aecc0c1b525d None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:40.734613 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1fa74-a270-4666-a2de-aecc0c1b525d None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:40.773176 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553a376-aa64-4782-ac76-3be4b973cd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:40.774013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553a376-aa64-4782-ac76-3be4b973cd4e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:40.774449 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553a376-aa64-4782-ac76-3be4b973cd4e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:40.774829 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553a376-aa64-4782-ac76-3be4b973cd4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:40.786713 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553a376-aa64-4782-ac76-3be4b973cd4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:36:40.795291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-b553a376-aa64-4782-ac76-3be4b973cd4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:36:40.795291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:40.795291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:40.795291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:40.795291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:40.795291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:40.795291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:40.795291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:40.795291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:40.795291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:40.795291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:40.795291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:40.795291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:36:40.795291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:36:40.795291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:36:40.795291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:36:40.797450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:36:40.797450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:36:40.797450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:36:40.797450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:36:40.797450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:40.797450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:40.797450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:40.797450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:40.797450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:40.797450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:40.797450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:40.797450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:36:40.797450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:40.797450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:40.797450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:40.797450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:40.799139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:40.799139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:40.799139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:40.799139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:40.799139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:36:40.799139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:36:40.799139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:36:40.799139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:36:40.799139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:36:40.799139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:36:40.799139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:36:40.799139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:36:40.799139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 635/1249] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:36:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:40.803789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59091806-e6d2-45bd-91d9-8b8674898334 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:40.918550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59091806-e6d2-45bd-91d9-8b8674898334 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:40.955852 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710e7d9-754e-451c-a4fe-cc03a51abc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:40.956643 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710e7d9-754e-451c-a4fe-cc03a51abc92 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:40.956930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710e7d9-754e-451c-a4fe-cc03a51abc92 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:40.957216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710e7d9-754e-451c-a4fe-cc03a51abc92 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:40.958000 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710e7d9-754e-451c-a4fe-cc03a51abc92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:40.958289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710e7d9-754e-451c-a4fe-cc03a51abc92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:40.960160 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710e7d9-754e-451c-a4fe-cc03a51abc92 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:40.969458 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 615/1250] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:36:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:40.975691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553a376-aa64-4782-ac76-3be4b973cd4e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:41.084621 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553a376-aa64-4782-ac76-3be4b973cd4e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:41.122037 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8e572-35b4-4a4c-9d69-7ee63f0a69df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:41.122841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8e572-35b4-4a4c-9d69-7ee63f0a69df None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:41.123171 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8e572-35b4-4a4c-9d69-7ee63f0a69df None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:41.123582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8e572-35b4-4a4c-9d69-7ee63f0a69df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:41.136646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8e572-35b4-4a4c-9d69-7ee63f0a69df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:41.140054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8e572-35b4-4a4c-9d69-7ee63f0a69df None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:41.163409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-c8f8e572-35b4-4a4c-9d69-7ee63f0a69df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:41.163409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:41.163409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:41.163409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:41.163409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:41.163409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:41.163409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:41.163409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:41.163409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:41.163409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:41.163409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:41.163409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:41.163409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:36:41.163409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:36:41.163409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:36:41.164817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:36:41.164817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:41.164817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:41.164817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:41.164817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:41.164817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:41.164817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:41.164817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:41.164817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:36:41.164817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:41.164817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:41.164817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:41.164817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:41.164817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:41.164817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:41.164817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:41.164817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:41.165909 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:36:41.165909 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:36:41.165909 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:41.165909 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:36:41.165909 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 636/1251] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:41.172815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710e7d9-754e-451c-a4fe-cc03a51abc92 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:41.281985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710e7d9-754e-451c-a4fe-cc03a51abc92 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:41.322417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161007d7-d527-4718-abe6-fa771084a213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:41.323239 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161007d7-d527-4718-abe6-fa771084a213 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:41.323554 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161007d7-d527-4718-abe6-fa771084a213 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:41.323859 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161007d7-d527-4718-abe6-fa771084a213 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:41.324717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161007d7-d527-4718-abe6-fa771084a213 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:41.325071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161007d7-d527-4718-abe6-fa771084a213 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:41.326476 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161007d7-d527-4718-abe6-fa771084a213 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:41.340297 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 616/1252] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:36:41.346348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8e572-35b4-4a4c-9d69-7ee63f0a69df None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:41.452812 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8e572-35b4-4a4c-9d69-7ee63f0a69df None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:41.489206 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fea91-1f89-4dc7-a05b-e82ddcf86f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:41.490099 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fea91-1f89-4dc7-a05b-e82ddcf86f6d None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:41.490458 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fea91-1f89-4dc7-a05b-e82ddcf86f6d None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:41.490739 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fea91-1f89-4dc7-a05b-e82ddcf86f6d None admin] PATH_INFO: `/v3/users/placement` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:41.498713 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845fea91-1f89-4dc7-a05b-e82ddcf86f6d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:41.500218 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845fea91-1f89-4dc7-a05b-e82ddcf86f6d None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:41.515736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-845fea91-1f89-4dc7-a05b-e82ddcf86f6d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 21:36:41.515736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:41.515736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:41.515736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:41.515736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:41.515736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:41.515736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:41.515736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:41.515736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:41.515736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:41.515736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:41.515736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:41.515736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:36:41.515736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:36:41.515736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:36:41.515736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:36:41.517174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:41.517174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:41.517174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:36:41.517174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:36:41.517174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:36:41.517174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:36:41.517174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:41.517174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:41.517174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:41.517174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:41.517174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:41.517174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:36:41.517174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:41.517174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:41.517174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:41.517174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:41.517174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:41.517174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:41.518888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:41.518888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:41.518888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:36:41.518888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:36:41.518888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:36:41.518888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:36:41.518888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:36:41.518888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:36:41.518888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 21:36:41.518888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:36:41.518888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 637/1253] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:36:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:41.522931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161007d7-d527-4718-abe6-fa771084a213 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:41.639609 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161007d7-d527-4718-abe6-fa771084a213 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:41.678330 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657fcfc-26ce-422b-8a5e-0806da21ebaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:41.679006 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657fcfc-26ce-422b-8a5e-0806da21ebaa None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:41.679371 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657fcfc-26ce-422b-8a5e-0806da21ebaa None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:41.679589 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657fcfc-26ce-422b-8a5e-0806da21ebaa None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:41.680417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657fcfc-26ce-422b-8a5e-0806da21ebaa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:41.680731 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657fcfc-26ce-422b-8a5e-0806da21ebaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:41.682151 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657fcfc-26ce-422b-8a5e-0806da21ebaa None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:41.701202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 617/1254] 10.222.0.11 () {56 vars in 1143 bytes} [Wed May 4 21:36:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:41.708044 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fea91-1f89-4dc7-a05b-e82ddcf86f6d None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:41.818070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fea91-1f89-4dc7-a05b-e82ddcf86f6d None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:41.854470 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499af9a5-760b-4711-9914-49405bf401be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:41.855165 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499af9a5-760b-4711-9914-49405bf401be None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:41.855453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499af9a5-760b-4711-9914-49405bf401be None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:41.855739 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499af9a5-760b-4711-9914-49405bf401be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:41.923782 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499af9a5-760b-4711-9914-49405bf401be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:41.925326 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499af9a5-760b-4711-9914-49405bf401be None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:42.027694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 638/1255] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:36:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:36:42.033684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657fcfc-26ce-422b-8a5e-0806da21ebaa None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:42.141799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657fcfc-26ce-422b-8a5e-0806da21ebaa None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:42.176813 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b57b1-4c2c-4db6-9f9e-40315736b8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:42.177544 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b57b1-4c2c-4db6-9f9e-40315736b8cc None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:42.177826 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b57b1-4c2c-4db6-9f9e-40315736b8cc None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:42.178105 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b57b1-4c2c-4db6-9f9e-40315736b8cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:42.188375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b57b1-4c2c-4db6-9f9e-40315736b8cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:42.189904 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b57b1-4c2c-4db6-9f9e-40315736b8cc None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:42.207718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-920b57b1-4c2c-4db6-9f9e-40315736b8cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:42.207718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:42.207718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:42.207718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:42.207718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:42.207718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:42.207718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:42.207718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:42.207718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:42.207718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:42.207718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:42.207718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:42.207718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:36:42.207718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:36:42.207718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:36:42.208883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:36:42.208883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:42.208883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:42.208883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:42.208883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:42.208883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:42.208883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:42.208883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:42.208883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:36:42.208883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:42.208883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:42.208883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:42.208883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:42.208883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:42.208883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:42.208883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:42.208883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:42.209987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:36:42.209987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:36:42.209987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:42.209987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:42.214344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 618/1256] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:42.216366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499af9a5-760b-4711-9914-49405bf401be None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:42.321551 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499af9a5-760b-4711-9914-49405bf401be None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:42.357682 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85306f16-b36e-4efa-853e-3318e1a3b2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:42.358363 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85306f16-b36e-4efa-853e-3318e1a3b2f4 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:42.358655 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85306f16-b36e-4efa-853e-3318e1a3b2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:42.358930 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85306f16-b36e-4efa-853e-3318e1a3b2f4 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:42.359702 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85306f16-b36e-4efa-853e-3318e1a3b2f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:42.360016 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85306f16-b36e-4efa-853e-3318e1a3b2f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:42.361390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85306f16-b36e-4efa-853e-3318e1a3b2f4 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:42.372756 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 639/1257] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:42.378614 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b57b1-4c2c-4db6-9f9e-40315736b8cc None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:42.481893 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b57b1-4c2c-4db6-9f9e-40315736b8cc None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:42.515985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85702304-70aa-4666-bfc7-52cc24a2f4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:42.516811 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85702304-70aa-4666-bfc7-52cc24a2f4ee None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:42.517078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85702304-70aa-4666-bfc7-52cc24a2f4ee None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:42.517357 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85702304-70aa-4666-bfc7-52cc24a2f4ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:42.526082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85702304-70aa-4666-bfc7-52cc24a2f4ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:42.527930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85702304-70aa-4666-bfc7-52cc24a2f4ee None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:42.544367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-85702304-70aa-4666-bfc7-52cc24a2f4ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:36:42.544367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:42.544367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:42.544367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:42.544367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:42.544367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:42.544367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:42.544367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:42.544367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:42.544367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:42.544367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:42.544367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:42.544367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:36:42.544367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:36:42.544367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:36:42.545403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:36:42.545403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:42.545403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:42.545403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:42.545403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:42.545403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:42.545403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:42.545403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:42.545403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:36:42.545403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:42.545403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:42.545403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:42.545403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:42.545403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:42.545403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:42.545403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:42.545403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:42.546481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:36:42.546481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:36:42.546481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:36:42.546481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:36:42.546481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:36:42.546481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:36:42.546481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:36:42.546481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:42.546481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 619/1258] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:36:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:36:42.552380 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85306f16-b36e-4efa-853e-3318e1a3b2f4 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:42.655389 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85306f16-b36e-4efa-853e-3318e1a3b2f4 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:42.690268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a4eb0-d73f-44bd-b011-0f97426adceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:42.691169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a4eb0-d73f-44bd-b011-0f97426adceb None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:42.691452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a4eb0-d73f-44bd-b011-0f97426adceb None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:42.691789 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a4eb0-d73f-44bd-b011-0f97426adceb None admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:42.692602 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a4eb0-d73f-44bd-b011-0f97426adceb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:42.692914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a4eb0-d73f-44bd-b011-0f97426adceb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:42.694381 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a4eb0-d73f-44bd-b011-0f97426adceb None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:42.707657 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 640/1259] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:36:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:42.714010 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85702304-70aa-4666-bfc7-52cc24a2f4ee None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:42.823239 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85702304-70aa-4666-bfc7-52cc24a2f4ee None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:42.861112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bae97-5b00-458b-827d-2954ac26999d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:42.861873 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bae97-5b00-458b-827d-2954ac26999d None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:42.862291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bae97-5b00-458b-827d-2954ac26999d None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:42.862574 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bae97-5b00-458b-827d-2954ac26999d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:42.863465 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bae97-5b00-458b-827d-2954ac26999d None admin] RBAC: Adding query filter params (role.id=59778f07f0504e90a60212f460e8c774, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=e203d7077af54930a640b2334a1d8fa6) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:42.863786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bae97-5b00-458b-827d-2954ac26999d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:42.865264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bae97-5b00-458b-827d-2954ac26999d None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:42.883078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 620/1260] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:36:42 2022] GET /identity/v3/role_assignments?user.id=e203d7077af54930a640b2334a1d8fa6&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=59778f07f0504e90a60212f460e8c774 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:45.130461 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527f5f8-351e-4e68-95a0-b3ba04966243 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:45.131059 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527f5f8-351e-4e68-95a0-b3ba04966243 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:45.131059 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527f5f8-351e-4e68-95a0-b3ba04966243 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:45.132675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 641/1261] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:36:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:36:45.138224 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f649309-81d5-47e8-bb76-7fc8937dbc13 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:45.138635 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f649309-81d5-47e8-bb76-7fc8937dbc13 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:45.138788 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f649309-81d5-47e8-bb76-7fc8937dbc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:45.160905 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-3f649309-81d5-47e8-bb76-7fc8937dbc13 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:36:45.162303 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-3f649309-81d5-47e8-bb76-7fc8937dbc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:36:45.237836 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 621/1262] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:36:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:36:45.261303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527f5f8-351e-4e68-95a0-b3ba04966243 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:45.375743 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527f5f8-351e-4e68-95a0-b3ba04966243 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:45.409540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bc206-9268-4ea0-a689-5e551905b21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:45.410258 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bc206-9268-4ea0-a689-5e551905b21e None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:45.410539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bc206-9268-4ea0-a689-5e551905b21e None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:45.410808 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bc206-9268-4ea0-a689-5e551905b21e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:45.421117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bc206-9268-4ea0-a689-5e551905b21e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:36:45.428646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-988bc206-9268-4ea0-a689-5e551905b21e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:36:45.428646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:45.428646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:45.428646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:45.428646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:45.428646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:45.428646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:45.428646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:45.428646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:45.428646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:45.428646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:45.428646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:45.428646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:36:45.428646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:36:45.428646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:36:45.428646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:36:45.429732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:36:45.429732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:36:45.429732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:36:45.429732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:36:45.429732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:45.429732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:45.429732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:45.429732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:45.429732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:45.429732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:45.429732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:45.429732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:36:45.429732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:45.429732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:45.429732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:45.429732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:45.431374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:45.431374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:45.431374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:45.431374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:45.431374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:36:45.431374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:36:45.431374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:36:45.431374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:36:45.431374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:36:45.431374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:36:45.431374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:36:45.431374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:36:45.431374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 642/1263] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:36:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:45.439441 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f649309-81d5-47e8-bb76-7fc8937dbc13 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:45.539387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f649309-81d5-47e8-bb76-7fc8937dbc13 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:45.573406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f63d55-a238-4c3c-b0e1-efa9a067c553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:45.574073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f63d55-a238-4c3c-b0e1-efa9a067c553 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:45.574355 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f63d55-a238-4c3c-b0e1-efa9a067c553 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:45.574629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f63d55-a238-4c3c-b0e1-efa9a067c553 None admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:45.575402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f63d55-a238-4c3c-b0e1-efa9a067c553 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:45.575737 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f63d55-a238-4c3c-b0e1-efa9a067c553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:45.577107 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f63d55-a238-4c3c-b0e1-efa9a067c553 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:45.585599 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 622/1264] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:36:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:45.592362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bc206-9268-4ea0-a689-5e551905b21e None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:45.700385 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bc206-9268-4ea0-a689-5e551905b21e None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:45.734272 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dad92a-66e1-4950-a61a-cf2560a52005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:45.735072 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dad92a-66e1-4950-a61a-cf2560a52005 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:45.735346 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dad92a-66e1-4950-a61a-cf2560a52005 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:45.735617 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dad92a-66e1-4950-a61a-cf2560a52005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:45.746233 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dad92a-66e1-4950-a61a-cf2560a52005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:45.747730 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dad92a-66e1-4950-a61a-cf2560a52005 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:45.764471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-e1dad92a-66e1-4950-a61a-cf2560a52005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:45.764471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:45.764471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:45.764471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:45.764471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:45.764471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:45.764471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:45.764471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:45.764471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:45.764471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:45.764471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:45.764471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:45.764471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:36:45.764471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:36:45.764471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:36:45.765451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:36:45.765451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:45.765451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:45.765451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:45.765451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:45.765451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:45.765451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:45.765451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:45.765451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:36:45.765451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:45.765451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:45.765451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:45.765451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:45.765451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:45.765451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:45.765451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:45.765451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:45.766540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:36:45.766540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:36:45.766540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:45.766540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:36:45.766540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 643/1265] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:45.771934 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f63d55-a238-4c3c-b0e1-efa9a067c553 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:45.881403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f63d55-a238-4c3c-b0e1-efa9a067c553 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:45.914528 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74c7aa-e8ca-45c6-bae0-aac0ae5dd57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:45.915374 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74c7aa-e8ca-45c6-bae0-aac0ae5dd57c None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:45.915867 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74c7aa-e8ca-45c6-bae0-aac0ae5dd57c None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:45.916174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74c7aa-e8ca-45c6-bae0-aac0ae5dd57c None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:45.916901 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74c7aa-e8ca-45c6-bae0-aac0ae5dd57c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:45.917206 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74c7aa-e8ca-45c6-bae0-aac0ae5dd57c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:45.918621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74c7aa-e8ca-45c6-bae0-aac0ae5dd57c None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:45.930668 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 623/1266] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:45.936808 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dad92a-66e1-4950-a61a-cf2560a52005 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:46.043026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dad92a-66e1-4950-a61a-cf2560a52005 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:46.077901 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35eedc-3959-4df5-b3c8-0cf29159cec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:46.078706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35eedc-3959-4df5-b3c8-0cf29159cec3 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:46.078986 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35eedc-3959-4df5-b3c8-0cf29159cec3 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:46.079294 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35eedc-3959-4df5-b3c8-0cf29159cec3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:46.086546 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35eedc-3959-4df5-b3c8-0cf29159cec3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:46.088029 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35eedc-3959-4df5-b3c8-0cf29159cec3 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:46.103964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-cc35eedc-3959-4df5-b3c8-0cf29159cec3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 21:36:46.103964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:46.103964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:46.103964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:46.103964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:46.103964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:46.103964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:46.103964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:46.103964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:46.103964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:46.103964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:46.103964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:46.103964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:36:46.103964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:36:46.103964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:36:46.103964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:36:46.104936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:46.104936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:46.104936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:36:46.104936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:36:46.104936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:36:46.104936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:36:46.104936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:46.104936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:46.104936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:46.104936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:46.104936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:46.104936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:36:46.104936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:46.104936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:46.104936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:46.104936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:46.104936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:46.104936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:46.106039 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:46.106039 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:46.106039 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:36:46.106039 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:36:46.106039 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:36:46.106039 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:36:46.106039 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:36:46.106039 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:36:46.106039 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 21:36:46.106039 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:36:46.106039 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 644/1267] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:36:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:46.112342 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74c7aa-e8ca-45c6-bae0-aac0ae5dd57c None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:46.232358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74c7aa-e8ca-45c6-bae0-aac0ae5dd57c None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:46.266541 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f7d22-359d-451d-9d92-b5a458d7da7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:46.267251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f7d22-359d-451d-9d92-b5a458d7da7c None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:46.267534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f7d22-359d-451d-9d92-b5a458d7da7c None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:46.267843 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f7d22-359d-451d-9d92-b5a458d7da7c None admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:46.268686 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f7d22-359d-451d-9d92-b5a458d7da7c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:46.268968 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f7d22-359d-451d-9d92-b5a458d7da7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:46.270428 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f7d22-359d-451d-9d92-b5a458d7da7c None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:46.287103 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 624/1268] 10.222.0.11 () {56 vars in 1143 bytes} [Wed May 4 21:36:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:46.296207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35eedc-3959-4df5-b3c8-0cf29159cec3 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:46.398983 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35eedc-3959-4df5-b3c8-0cf29159cec3 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:46.432409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7acd4b-2b2a-4645-a041-209fe0db9847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:46.433219 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7acd4b-2b2a-4645-a041-209fe0db9847 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:46.433497 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7acd4b-2b2a-4645-a041-209fe0db9847 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:46.433769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7acd4b-2b2a-4645-a041-209fe0db9847 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:46.444471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7acd4b-2b2a-4645-a041-209fe0db9847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:46.445911 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7acd4b-2b2a-4645-a041-209fe0db9847 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:46.462826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-3c7acd4b-2b2a-4645-a041-209fe0db9847 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:46.462826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:46.462826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:46.462826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:46.462826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:46.462826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:46.462826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:46.462826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:46.462826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:46.462826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:46.462826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:46.462826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:46.462826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:36:46.462826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:36:46.462826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:36:46.463848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:36:46.463848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:46.463848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:46.463848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:46.463848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:46.463848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:46.463848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:46.463848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:46.463848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:36:46.463848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:46.463848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:46.463848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:46.463848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:46.463848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:46.463848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:46.463848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:46.463848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:46.464973 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:36:46.464973 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:36:46.464973 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:46.464973 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:36:46.464973 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 645/1269] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:46.470470 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f7d22-359d-451d-9d92-b5a458d7da7c None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:46.582632 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f7d22-359d-451d-9d92-b5a458d7da7c None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:46.624198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd7378-58fd-4ac1-9aec-f1f979e8ff3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:46.624866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd7378-58fd-4ac1-9aec-f1f979e8ff3e None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:46.625154 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd7378-58fd-4ac1-9aec-f1f979e8ff3e None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:46.625429 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd7378-58fd-4ac1-9aec-f1f979e8ff3e None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:46.626151 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd7378-58fd-4ac1-9aec-f1f979e8ff3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:46.626460 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd7378-58fd-4ac1-9aec-f1f979e8ff3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:46.628209 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd7378-58fd-4ac1-9aec-f1f979e8ff3e None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:46.639421 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 625/1270] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:46.648613 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7acd4b-2b2a-4645-a041-209fe0db9847 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:46.751318 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7acd4b-2b2a-4645-a041-209fe0db9847 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:46.785161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf7960-3623-4f3d-a35e-cfd642930f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:46.785944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf7960-3623-4f3d-a35e-cfd642930f05 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:46.786230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf7960-3623-4f3d-a35e-cfd642930f05 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:46.786500 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf7960-3623-4f3d-a35e-cfd642930f05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:46.793136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf7960-3623-4f3d-a35e-cfd642930f05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:46.794581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf7960-3623-4f3d-a35e-cfd642930f05 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:46.808569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-f9cf7960-3623-4f3d-a35e-cfd642930f05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:36:46.808569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:46.808569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:46.808569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:46.808569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:46.808569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:46.808569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:46.808569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:46.808569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:46.808569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:46.808569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:46.808569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:46.808569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:36:46.808569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:36:46.808569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:36:46.809586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:36:46.809586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:46.809586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:46.809586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:46.809586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:46.809586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:46.809586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:46.809586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:46.809586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:36:46.809586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:46.809586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:46.809586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:46.809586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:46.809586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:46.809586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:46.809586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:46.809586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:46.810688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:36:46.810688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:36:46.810688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:36:46.810688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:36:46.810688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:36:46.810688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:36:46.810688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:36:46.810688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:36:46.810688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 646/1271] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:36:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:46.816128 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd7378-58fd-4ac1-9aec-f1f979e8ff3e None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:46.918407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd7378-58fd-4ac1-9aec-f1f979e8ff3e None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:46.952343 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f6309-1068-46df-9587-9f484a97f230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:46.953017 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f6309-1068-46df-9587-9f484a97f230 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:46.953303 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f6309-1068-46df-9587-9f484a97f230 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:46.953582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f6309-1068-46df-9587-9f484a97f230 None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:46.954367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f6309-1068-46df-9587-9f484a97f230 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:46.954680 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f6309-1068-46df-9587-9f484a97f230 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:46.956253 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f6309-1068-46df-9587-9f484a97f230 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:46.968090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 626/1272] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:36:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:46.975485 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf7960-3623-4f3d-a35e-cfd642930f05 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:47.076495 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf7960-3623-4f3d-a35e-cfd642930f05 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:47.122324 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06168a57-d297-4e6b-9420-48165f074d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:47.124357 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168a57-d297-4e6b-9420-48165f074d95 None admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:47.124852 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168a57-d297-4e6b-9420-48165f074d95 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:47.125242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168a57-d297-4e6b-9420-48165f074d95 None admin] PATH_INFO: `/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/e203d7077af54930a640b2334a1d8fa6/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:47.128952 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06168a57-d297-4e6b-9420-48165f074d95 None admin] RBAC: Authorizing `identity:create_grant(project_id=3acb142d1aa34e18a018d3fdee8d7038, user_id=e203d7077af54930a640b2334a1d8fa6, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:47.131896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06168a57-d297-4e6b-9420-48165f074d95 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:47.154253 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 647/1273] 10.222.0.11 () {58 vars in 1439 bytes} [Wed May 4 21:36:46 2022] PUT /identity/v3/projects/3acb142d1aa34e18a018d3fdee8d7038/users/e203d7077af54930a640b2334a1d8fa6/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:36:49.374935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f590493-7003-4f43-9e3c-2d7373aa8c72 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:49.375572 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f590493-7003-4f43-9e3c-2d7373aa8c72 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:49.375572 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f590493-7003-4f43-9e3c-2d7373aa8c72 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:49.376939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 627/1274] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:36:49.383337 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f3cef-7633-4a7e-ba0e-30ae6c33a224 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:49.384079 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f3cef-7633-4a7e-ba0e-30ae6c33a224 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:49.384230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f3cef-7633-4a7e-ba0e-30ae6c33a224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:49.404837 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-b42f3cef-7633-4a7e-ba0e-30ae6c33a224 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:36:49.406025 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-b42f3cef-7633-4a7e-ba0e-30ae6c33a224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:36:49.474832 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 648/1275] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:36:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:36:49.498559 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f590493-7003-4f43-9e3c-2d7373aa8c72 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:49.623061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f590493-7003-4f43-9e3c-2d7373aa8c72 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:49.664558 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99b352-35dd-4b15-8f07-deaa0890d09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:49.665256 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99b352-35dd-4b15-8f07-deaa0890d09b None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:49.665534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99b352-35dd-4b15-8f07-deaa0890d09b None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:49.665813 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99b352-35dd-4b15-8f07-deaa0890d09b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:49.676505 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99b352-35dd-4b15-8f07-deaa0890d09b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:36:49.683891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-0f99b352-35dd-4b15-8f07-deaa0890d09b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:36:49.683891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:49.683891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:49.683891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:49.683891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:49.683891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:49.683891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:49.683891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:49.683891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:49.683891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:49.683891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:49.683891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:49.683891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:36:49.683891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:36:49.683891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:36:49.683891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:36:49.684939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:36:49.684939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:36:49.684939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:36:49.684939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:36:49.684939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:49.684939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:49.684939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:49.684939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:49.684939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:49.684939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:49.684939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:49.684939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:36:49.684939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:49.684939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:49.684939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:49.684939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:49.685804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:49.685804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:49.685804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:49.685804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:49.685804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:36:49.685804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:36:49.685804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:36:49.685804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:36:49.685804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:36:49.685804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:36:49.685804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:36:49.685804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:49.685804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 628/1276] 10.222.0.11 () {56 vars in 1096 bytes} [Wed May 4 21:36:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:49.693083 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f3cef-7633-4a7e-ba0e-30ae6c33a224 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:49.801954 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f3cef-7633-4a7e-ba0e-30ae6c33a224 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:49.835713 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81249f52-8a79-4e04-b7bb-056e7c314526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:49.836368 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81249f52-8a79-4e04-b7bb-056e7c314526 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:49.836650 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81249f52-8a79-4e04-b7bb-056e7c314526 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:49.836923 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81249f52-8a79-4e04-b7bb-056e7c314526 None admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:49.837664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81249f52-8a79-4e04-b7bb-056e7c314526 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:49.837978 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81249f52-8a79-4e04-b7bb-056e7c314526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:49.839370 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81249f52-8a79-4e04-b7bb-056e7c314526 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:49.847839 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 649/1277] 10.222.0.11 () {56 vars in 1099 bytes} [Wed May 4 21:36:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:49.854193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99b352-35dd-4b15-8f07-deaa0890d09b None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:49.967259 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99b352-35dd-4b15-8f07-deaa0890d09b None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:50.010076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00910fa5-2b53-4eb9-81d1-458553dab3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:50.010864 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00910fa5-2b53-4eb9-81d1-458553dab3de None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:50.011175 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00910fa5-2b53-4eb9-81d1-458553dab3de None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:50.011451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00910fa5-2b53-4eb9-81d1-458553dab3de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:50.024120 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00910fa5-2b53-4eb9-81d1-458553dab3de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:50.025582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00910fa5-2b53-4eb9-81d1-458553dab3de None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:50.042937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-00910fa5-2b53-4eb9-81d1-458553dab3de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:50.042937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:50.042937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:50.042937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:50.042937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:50.042937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:50.042937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:50.042937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:50.042937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:50.042937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:50.042937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:50.042937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:50.042937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:36:50.042937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:36:50.042937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:36:50.043947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:36:50.043947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:50.043947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:50.043947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:50.043947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:50.043947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:50.043947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:50.043947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:50.043947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:36:50.043947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:50.043947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:50.043947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:50.043947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:50.043947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:50.043947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:50.043947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:50.043947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:50.044978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:36:50.044978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:36:50.044978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:50.044978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:50.044978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 629/1278] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:50.050092 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81249f52-8a79-4e04-b7bb-056e7c314526 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:50.177648 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81249f52-8a79-4e04-b7bb-056e7c314526 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:50.215482 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c76304-0c87-4938-aa16-2bd459852c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:50.216159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c76304-0c87-4938-aa16-2bd459852c59 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:50.216440 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c76304-0c87-4938-aa16-2bd459852c59 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:50.216708 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c76304-0c87-4938-aa16-2bd459852c59 None admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:50.217479 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c76304-0c87-4938-aa16-2bd459852c59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:50.217732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c76304-0c87-4938-aa16-2bd459852c59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:50.219136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c76304-0c87-4938-aa16-2bd459852c59 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:50.231251 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 650/1279] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:50.237230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00910fa5-2b53-4eb9-81d1-458553dab3de None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:50.347095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00910fa5-2b53-4eb9-81d1-458553dab3de None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:50.381264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae4b9d-baf5-4cda-a1d0-ac87e177e7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:50.382064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae4b9d-baf5-4cda-a1d0-ac87e177e7b2 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:50.382336 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae4b9d-baf5-4cda-a1d0-ac87e177e7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:50.382613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae4b9d-baf5-4cda-a1d0-ac87e177e7b2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:50.390270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae4b9d-baf5-4cda-a1d0-ac87e177e7b2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:50.391754 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae4b9d-baf5-4cda-a1d0-ac87e177e7b2 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:50.405935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-ebae4b9d-baf5-4cda-a1d0-ac87e177e7b2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 21:36:50.405935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:50.405935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:50.405935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:50.405935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:50.405935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:50.405935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:50.405935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:50.405935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:50.405935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:50.405935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:50.405935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:50.405935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:36:50.405935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:36:50.405935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:36:50.405935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:36:50.406995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:50.406995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:50.406995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:36:50.406995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:36:50.406995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:36:50.406995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:36:50.406995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:50.406995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:50.406995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:50.406995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:50.406995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:50.406995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:36:50.406995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:50.406995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:50.406995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:50.406995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:50.406995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:50.406995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:50.408461 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:50.408461 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:50.408461 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:36:50.408461 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:36:50.408461 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:36:50.408461 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:36:50.408461 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:36:50.408461 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:36:50.408461 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 21:36:50.408461 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:50.408461 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 630/1280] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:36:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:50.416286 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c76304-0c87-4938-aa16-2bd459852c59 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:50.525559 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c76304-0c87-4938-aa16-2bd459852c59 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:50.569785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d65881-8940-4326-80c0-8cecd026aef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:50.570466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d65881-8940-4326-80c0-8cecd026aef7 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:50.570744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d65881-8940-4326-80c0-8cecd026aef7 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:50.571010 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d65881-8940-4326-80c0-8cecd026aef7 None admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:50.571890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d65881-8940-4326-80c0-8cecd026aef7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:50.572192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d65881-8940-4326-80c0-8cecd026aef7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:50.573632 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d65881-8940-4326-80c0-8cecd026aef7 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:50.591882 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 651/1281] 10.222.0.11 () {56 vars in 1143 bytes} [Wed May 4 21:36:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:50.598383 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae4b9d-baf5-4cda-a1d0-ac87e177e7b2 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:50.698777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae4b9d-baf5-4cda-a1d0-ac87e177e7b2 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:50.735220 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878e1da-eddc-493a-a712-c1d886bc6623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:50.735863 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878e1da-eddc-493a-a712-c1d886bc6623 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:50.736171 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878e1da-eddc-493a-a712-c1d886bc6623 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:50.736446 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878e1da-eddc-493a-a712-c1d886bc6623 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:50.801667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878e1da-eddc-493a-a712-c1d886bc6623 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:50.803071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878e1da-eddc-493a-a712-c1d886bc6623 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:50.898514 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 631/1282] 10.222.0.11 () {58 vars in 1282 bytes} [Wed May 4 21:36:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:36:50.907745 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d65881-8940-4326-80c0-8cecd026aef7 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:51.018657 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d65881-8940-4326-80c0-8cecd026aef7 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:51.054471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28eb4c-41ed-48e6-9f31-7237928e505d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:51.055237 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28eb4c-41ed-48e6-9f31-7237928e505d None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:51.055522 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28eb4c-41ed-48e6-9f31-7237928e505d None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:51.055803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28eb4c-41ed-48e6-9f31-7237928e505d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:51.066883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28eb4c-41ed-48e6-9f31-7237928e505d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:51.068392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28eb4c-41ed-48e6-9f31-7237928e505d None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:51.085360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-ab28eb4c-41ed-48e6-9f31-7237928e505d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:51.085360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:51.085360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:51.085360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:51.085360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:51.085360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:51.085360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:51.085360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:51.085360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:51.085360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:51.085360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:51.085360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:51.085360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:36:51.085360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:36:51.085360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:36:51.086292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:36:51.086292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:51.086292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:51.086292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:51.086292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:51.086292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:51.086292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:51.086292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:51.086292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:36:51.086292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:51.086292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:51.086292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:51.086292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:51.086292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:51.086292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:51.086292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:51.086292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:51.087205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:36:51.087205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:36:51.087205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:36:51.087205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:36:51.087205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 652/1283] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:51.092735 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878e1da-eddc-493a-a712-c1d886bc6623 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:51.200052 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878e1da-eddc-493a-a712-c1d886bc6623 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:51.233896 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35d321-4358-479f-a218-7f37983254a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:51.234576 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35d321-4358-479f-a218-7f37983254a8 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:51.234861 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35d321-4358-479f-a218-7f37983254a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:51.235215 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35d321-4358-479f-a218-7f37983254a8 None admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:51.235956 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35d321-4358-479f-a218-7f37983254a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:51.236265 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35d321-4358-479f-a218-7f37983254a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:51.237702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35d321-4358-479f-a218-7f37983254a8 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:51.249242 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 632/1284] 10.222.0.11 () {56 vars in 1109 bytes} [Wed May 4 21:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:51.255856 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28eb4c-41ed-48e6-9f31-7237928e505d None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:51.358940 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28eb4c-41ed-48e6-9f31-7237928e505d None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:51.395345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a85e6-e879-4771-9ec5-bb15896a12b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:51.396127 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a85e6-e879-4771-9ec5-bb15896a12b4 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:51.396409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a85e6-e879-4771-9ec5-bb15896a12b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:51.396678 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a85e6-e879-4771-9ec5-bb15896a12b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:51.403543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a85e6-e879-4771-9ec5-bb15896a12b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:51.405001 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a85e6-e879-4771-9ec5-bb15896a12b4 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:51.418687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-f91a85e6-e879-4771-9ec5-bb15896a12b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:36:51.418687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:51.418687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:51.418687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:51.418687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:51.418687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:51.418687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:51.418687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:51.418687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:51.418687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:51.418687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:51.418687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:51.418687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:36:51.418687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:36:51.418687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:36:51.420102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:36:51.420102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:51.420102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:51.420102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:51.420102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:51.420102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:51.420102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:51.420102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:51.420102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 21:36:51.420102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:51.420102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:51.420102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:51.420102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:51.420102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:51.420102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:51.420102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:51.420102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:51.421172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:36:51.421172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:36:51.421172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:36:51.421172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:36:51.421172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:36:51.421172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:36:51.421172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:36:51.421172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 21:36:51.421172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 653/1285] 10.222.0.11 () {56 vars in 1111 bytes} [Wed May 4 21:36:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:51.426079 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35d321-4358-479f-a218-7f37983254a8 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:51.529904 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35d321-4358-479f-a218-7f37983254a8 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:51.565222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a08a66-0ed3-46be-9261-b8d2b2090f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:51.565924 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a08a66-0ed3-46be-9261-b8d2b2090f94 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:51.566203 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a08a66-0ed3-46be-9261-b8d2b2090f94 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:51.566472 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a08a66-0ed3-46be-9261-b8d2b2090f94 None admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:51.567319 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a08a66-0ed3-46be-9261-b8d2b2090f94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:51.567614 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a08a66-0ed3-46be-9261-b8d2b2090f94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:51.569069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a08a66-0ed3-46be-9261-b8d2b2090f94 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:51.582262 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 633/1286] 10.222.0.11 () {56 vars in 1148 bytes} [Wed May 4 21:36:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:51.588579 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a85e6-e879-4771-9ec5-bb15896a12b4 None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:51.688013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a85e6-e879-4771-9ec5-bb15896a12b4 None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:51.722645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663ea83-6bfd-4ec9-908c-52ffe26af0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:51.723335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663ea83-6bfd-4ec9-908c-52ffe26af0fd None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:51.723618 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663ea83-6bfd-4ec9-908c-52ffe26af0fd None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:51.723899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663ea83-6bfd-4ec9-908c-52ffe26af0fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:51.724729 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663ea83-6bfd-4ec9-908c-52ffe26af0fd None admin] RBAC: Adding query filter params (role.id=59778f07f0504e90a60212f460e8c774, scope.project.id=3acb142d1aa34e18a018d3fdee8d7038, user.id=e203d7077af54930a640b2334a1d8fa6) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:51.725044 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663ea83-6bfd-4ec9-908c-52ffe26af0fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:51.726474 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663ea83-6bfd-4ec9-908c-52ffe26af0fd None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:51.732385 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 654/1287] 10.222.0.11 () {56 vars in 1374 bytes} [Wed May 4 21:36:51 2022] GET /identity/v3/role_assignments?user.id=e203d7077af54930a640b2334a1d8fa6&scope.project.id=3acb142d1aa34e18a018d3fdee8d7038&role.id=59778f07f0504e90a60212f460e8c774 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:53.965257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb670f0-b141-40d7-a0a7-971b2fa9b3c8 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:53.966245 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb670f0-b141-40d7-a0a7-971b2fa9b3c8 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:53.966245 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb670f0-b141-40d7-a0a7-971b2fa9b3c8 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:53.968428 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 634/1288] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:36:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:36:53.977656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a9c29-4f4e-4559-b27d-9734dea1189a None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:53.978093 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a9c29-4f4e-4559-b27d-9734dea1189a None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:53.978183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a9c29-4f4e-4559-b27d-9734dea1189a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:54.005131 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-8d9a9c29-4f4e-4559-b27d-9734dea1189a None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:36:54.007105 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-8d9a9c29-4f4e-4559-b27d-9734dea1189a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:36:54.084710 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 655/1289] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:36:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:36:54.117125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb670f0-b141-40d7-a0a7-971b2fa9b3c8 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:54.228475 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb670f0-b141-40d7-a0a7-971b2fa9b3c8 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:54.261521 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1cefa-af8b-459f-b1bc-c85606f2a2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:54.262305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1cefa-af8b-459f-b1bc-c85606f2a2f3 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:54.262585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1cefa-af8b-459f-b1bc-c85606f2a2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:54.262857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1cefa-af8b-459f-b1bc-c85606f2a2f3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:54.263542 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1cefa-af8b-459f-b1bc-c85606f2a2f3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:54.264898 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1cefa-af8b-459f-b1bc-c85606f2a2f3 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:54.276621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-d4d1cefa-af8b-459f-b1bc-c85606f2a2f3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 21:36:54.276621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:54.276621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:36:54.276621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:36:54.276621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:36:54.276621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:36:54.276621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:36:54.276621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:36:54.276621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 21:36:54.276621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:54.276621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:36:54.276621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:54.276621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:54.276621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:54.276621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:54.276621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:54.276621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:54.277784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:54.277784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:54.277784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:54.277784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:54.277784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:54.277784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:54.277784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:36:54.277784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:36:54.277784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:36:54.277784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:36:54.277784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:54.277784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:54.277784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:54.277784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:54.277784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:54.277784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:54.278807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:54.278807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:36:54.278807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:54.278807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:54.278807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:54.278807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:54.278807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:54.278807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:54.278807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:54.278807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:54.278807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:36:54.278807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:36:54.278807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 21:36:54.278807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:54.278807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 635/1290] 10.222.0.11 () {56 vars in 1117 bytes} [Wed May 4 21:36:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:54.284767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a9c29-4f4e-4559-b27d-9734dea1189a None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:54.394718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a9c29-4f4e-4559-b27d-9734dea1189a None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:54.429469 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04a9aa-1afc-429b-96ad-e3fbb0f10017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:54.430136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04a9aa-1afc-429b-96ad-e3fbb0f10017 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:54.430422 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04a9aa-1afc-429b-96ad-e3fbb0f10017 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:54.430698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04a9aa-1afc-429b-96ad-e3fbb0f10017 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:54.431432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04a9aa-1afc-429b-96ad-e3fbb0f10017 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:54.431742 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04a9aa-1afc-429b-96ad-e3fbb0f10017 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:54.433117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04a9aa-1afc-429b-96ad-e3fbb0f10017 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:54.437880 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 656/1291] 10.222.0.11 () {56 vars in 1116 bytes} [Wed May 4 21:36:54 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:54.444794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1cefa-af8b-459f-b1bc-c85606f2a2f3 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:54.558168 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1cefa-af8b-459f-b1bc-c85606f2a2f3 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:54.594724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2da1d7-64e6-4b60-a19e-e71bf23cd4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:54.595782 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2da1d7-64e6-4b60-a19e-e71bf23cd4ae None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:54.596070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2da1d7-64e6-4b60-a19e-e71bf23cd4ae None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:54.596348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2da1d7-64e6-4b60-a19e-e71bf23cd4ae None admin] PATH_INFO: `/v3/services` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:54.597092 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2da1d7-64e6-4b60-a19e-e71bf23cd4ae None admin] RBAC: Adding query filter params (type=placement) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:54.597404 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2da1d7-64e6-4b60-a19e-e71bf23cd4ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:54.598776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2da1d7-64e6-4b60-a19e-e71bf23cd4ae None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:54.603401 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 636/1292] 10.222.0.11 () {56 vars in 1116 bytes} [Wed May 4 21:36:54 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:56.831795 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591024c0-5f08-4289-b0bf-fb7fca9c3e60 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:56.832695 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591024c0-5f08-4289-b0bf-fb7fca9c3e60 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:56.832695 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591024c0-5f08-4289-b0bf-fb7fca9c3e60 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:56.835076 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 657/1293] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:36:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:36:56.840254 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a78bb8-095d-4605-9129-66369e7bff30 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:56.840695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a78bb8-095d-4605-9129-66369e7bff30 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:56.840812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a78bb8-095d-4605-9129-66369e7bff30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:56.859604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-24a78bb8-095d-4605-9129-66369e7bff30 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:36:56.860771 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-24a78bb8-095d-4605-9129-66369e7bff30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:36:56.932981 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 637/1294] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:36:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:36:56.965597 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591024c0-5f08-4289-b0bf-fb7fca9c3e60 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:57.073425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591024c0-5f08-4289-b0bf-fb7fca9c3e60 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:57.109435 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9880a-51da-42a0-a85d-be7df4128201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:57.110163 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9880a-51da-42a0-a85d-be7df4128201 None admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:57.110542 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9880a-51da-42a0-a85d-be7df4128201 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:57.110853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9880a-51da-42a0-a85d-be7df4128201 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:57.111668 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9880a-51da-42a0-a85d-be7df4128201 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:57.113364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9880a-51da-42a0-a85d-be7df4128201 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:57.130543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 658/1295] 10.222.0.11 () {60 vars in 1141 bytes} [Wed May 4 21:36:56 2022] POST /identity/v3/services => generated 246 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:36:59.359165 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de35dd8-604a-4332-8b94-b1173c772622 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:59.359782 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de35dd8-604a-4332-8b94-b1173c772622 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:59.359782 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de35dd8-604a-4332-8b94-b1173c772622 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:59.361083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 638/1296] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:36:59.367651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7164c-eba3-46ac-b40c-7e58befaeeb8 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:59.368330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7164c-eba3-46ac-b40c-7e58befaeeb8 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:59.368505 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7164c-eba3-46ac-b40c-7e58befaeeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:59.389664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-9fc7164c-eba3-46ac-b40c-7e58befaeeb8 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:36:59.390838 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-9fc7164c-eba3-46ac-b40c-7e58befaeeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:36:59.475704 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 659/1297] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:36:59 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:36:59.510028 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de35dd8-604a-4332-8b94-b1173c772622 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:59.627081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de35dd8-604a-4332-8b94-b1173c772622 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:59.661312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14649a-0a1e-4f4d-a673-26a35ab36ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:59.662098 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14649a-0a1e-4f4d-a673-26a35ab36ba0 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:59.662382 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14649a-0a1e-4f4d-a673-26a35ab36ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:59.662646 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14649a-0a1e-4f4d-a673-26a35ab36ba0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:59.663319 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14649a-0a1e-4f4d-a673-26a35ab36ba0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:59.664688 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14649a-0a1e-4f4d-a673-26a35ab36ba0 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:59.676469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-2d14649a-0a1e-4f4d-a673-26a35ab36ba0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 21:36:59.676469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:59.676469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:36:59.676469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:36:59.676469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:36:59.676469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:36:59.676469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:36:59.676469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:36:59.676469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 21:36:59.676469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:59.676469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:36:59.676469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:59.676469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:36:59.676469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:36:59.676469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:36:59.676469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:36:59.676469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:36:59.677605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:36:59.677605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:36:59.677605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:36:59.677605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:36:59.677605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:36:59.677605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:36:59.677605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:36:59.677605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:36:59.677605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:36:59.677605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:36:59.677605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:36:59.677605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:36:59.677605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:36:59.677605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:36:59.677605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:36:59.677605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:36:59.678449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:36:59.678449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:36:59.678449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:36:59.678449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:36:59.678449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:36:59.678449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:36:59.678449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:36:59.678449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:36:59.678449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:36:59.678449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:36:59.678449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:36:59.678449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:36:59.678449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 21:36:59.678449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:36:59.678449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 639/1298] 10.222.0.11 () {56 vars in 1117 bytes} [Wed May 4 21:36:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:36:59.685955 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7164c-eba3-46ac-b40c-7e58befaeeb8 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:59.790635 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7164c-eba3-46ac-b40c-7e58befaeeb8 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:59.839306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefec053-a3f5-47ee-ab52-4c8023379bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:59.839974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefec053-a3f5-47ee-ab52-4c8023379bba None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:59.840263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefec053-a3f5-47ee-ab52-4c8023379bba None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:59.840546 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefec053-a3f5-47ee-ab52-4c8023379bba None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:59.841257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefec053-a3f5-47ee-ab52-4c8023379bba None admin] RBAC: Adding query filter params (name=placement) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:59.841572 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefec053-a3f5-47ee-ab52-4c8023379bba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:59.842946 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefec053-a3f5-47ee-ab52-4c8023379bba None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:59.848910 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 660/1299] 10.222.0.11 () {56 vars in 1116 bytes} [Wed May 4 21:36:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:36:59.855747 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14649a-0a1e-4f4d-a673-26a35ab36ba0 None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:59.963611 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14649a-0a1e-4f4d-a673-26a35ab36ba0 None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:37:00.002325 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ee20e-310f-48ed-83fe-267324d26525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:37:00.003411 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ee20e-310f-48ed-83fe-267324d26525 None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:37:00.003753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ee20e-310f-48ed-83fe-267324d26525 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:37:00.004156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ee20e-310f-48ed-83fe-267324d26525 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:37:00.005385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ee20e-310f-48ed-83fe-267324d26525 None admin] RBAC: Adding query filter params (interface=public, service_id=9439bb3fc825479a95286e2d6b891974, region_id=RegionOne) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:37:00.005843 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ee20e-310f-48ed-83fe-267324d26525 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:37:00.008035 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ee20e-310f-48ed-83fe-267324d26525 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:37:00.014708 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 640/1300] 10.222.0.11 () {56 vars in 1251 bytes} [Wed May 4 21:36:59 2022] GET /identity/v3/endpoints?service_id=9439bb3fc825479a95286e2d6b891974&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:37:00.021875 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefec053-a3f5-47ee-ab52-4c8023379bba None admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:37:00.133457 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefec053-a3f5-47ee-ab52-4c8023379bba None admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:37:00.168823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d810572-e1ec-4ed0-a6e0-a339a3bec9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:37:00.169497 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d810572-e1ec-4ed0-a6e0-a339a3bec9ca None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:37:00.169785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d810572-e1ec-4ed0-a6e0-a339a3bec9ca None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:37:00.170060 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d810572-e1ec-4ed0-a6e0-a339a3bec9ca None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:37:00.170745 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d810572-e1ec-4ed0-a6e0-a339a3bec9ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:37:00.172172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d810572-e1ec-4ed0-a6e0-a339a3bec9ca None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:37:00.178843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 661/1301] 10.222.0.11 () {56 vars in 1087 bytes} [Wed May 4 21:37:00 2022] GET /identity/v3/services => generated 2191 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:37:02.372008 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e7f82-3d91-4a6a-8566-3e61e7ab6e3b None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:37:02.372908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e7f82-3d91-4a6a-8566-3e61e7ab6e3b None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:37:02.372908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e7f82-3d91-4a6a-8566-3e61e7ab6e3b None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:37:02.375111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 641/1302] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:37:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:37:02.381253 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29b27e-72f5-487c-b117-d413df4258b5 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:37:02.382022 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29b27e-72f5-487c-b117-d413df4258b5 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:37:02.382145 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29b27e-72f5-487c-b117-d413df4258b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:37:02.410209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-ae29b27e-72f5-487c-b117-d413df4258b5 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:37:02.411425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ae29b27e-72f5-487c-b117-d413df4258b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:37:02.489867 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 662/1303] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:37:02 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:37:02.513418 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e7f82-3d91-4a6a-8566-3e61e7ab6e3b None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:37:02.616452 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e7f82-3d91-4a6a-8566-3e61e7ab6e3b None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:37:02.649976 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfe2ee-2a0f-44c9-b95e-8b3cd797c0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:37:02.650704 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfe2ee-2a0f-44c9-b95e-8b3cd797c0cc None admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:37:02.650987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfe2ee-2a0f-44c9-b95e-8b3cd797c0cc None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:37:02.651296 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfe2ee-2a0f-44c9-b95e-8b3cd797c0cc None admin] PATH_INFO: `/v3/services/placement` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:37:02.651946 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfe2ee-2a0f-44c9-b95e-8b3cd797c0cc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:37:02.653343 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfe2ee-2a0f-44c9-b95e-8b3cd797c0cc None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:37:02.665291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-ffdfe2ee-2a0f-44c9-b95e-8b3cd797c0cc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 21:37:02.665291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:37:02.665291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:37:02.665291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:37:02.665291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:37:02.665291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:37:02.665291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:37:02.665291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:37:02.665291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 21:37:02.665291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:37:02.665291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:37:02.665291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:37:02.665291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:37:02.665291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:37:02.665291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:37:02.665291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:37:02.665291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:37:02.666432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:37:02.666432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:37:02.666432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:37:02.666432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:37:02.666432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:37:02.666432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:37:02.666432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:37:02.666432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:37:02.666432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:37:02.666432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:37:02.666432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:37:02.666432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:37:02.666432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:37:02.666432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:37:02.666432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:37:02.666432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:37:02.667478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:37:02.667478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 21:37:02.667478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:37:02.667478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 21:37:02.667478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:37:02.667478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:37:02.667478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:37:02.667478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 21:37:02.667478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:37:02.667478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 21:37:02.667478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:37:02.667478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:37:02.667478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 21:37:02.667478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 21:37:02.671221 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 642/1304] 10.222.0.11 () {56 vars in 1117 bytes} [Wed May 4 21:37:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:37:02.673191 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29b27e-72f5-487c-b117-d413df4258b5 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:37:02.776796 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29b27e-72f5-487c-b117-d413df4258b5 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:37:02.810398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5238c7-931e-4966-bcb3-e69388200ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:37:02.811088 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5238c7-931e-4966-bcb3-e69388200ad4 None admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:37:02.811365 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5238c7-931e-4966-bcb3-e69388200ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:37:02.811642 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5238c7-931e-4966-bcb3-e69388200ad4 None admin] PATH_INFO: `/v3/services` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:37:02.812354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5238c7-931e-4966-bcb3-e69388200ad4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:37:02.812663 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5238c7-931e-4966-bcb3-e69388200ad4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:37:02.814037 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5238c7-931e-4966-bcb3-e69388200ad4 None admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:37:02.819433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 663/1305] 10.222.0.11 () {56 vars in 1116 bytes} [Wed May 4 21:37:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:37:02.825468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfe2ee-2a0f-44c9-b95e-8b3cd797c0cc None admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:37:02.940999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfe2ee-2a0f-44c9-b95e-8b3cd797c0cc None admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:37:02.976625 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd101d-63cf-403b-ae59-a14aab1ab842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:37:02.977274 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd101d-63cf-403b-ae59-a14aab1ab842 None admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:37:02.977563 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd101d-63cf-403b-ae59-a14aab1ab842 None admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:37:02.977828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd101d-63cf-403b-ae59-a14aab1ab842 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:37:02.978561 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd101d-63cf-403b-ae59-a14aab1ab842 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:37:02.979950 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd101d-63cf-403b-ae59-a14aab1ab842 None admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:37:03.006548 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 643/1306] 10.222.0.11 () {60 vars in 1144 bytes} [Wed May 4 21:37:02 2022] POST /identity/v3/endpoints => generated 331 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:38:07.486725 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df642aa-0600-4977-82d3-d2ea074d9316 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:07.487241 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df642aa-0600-4977-82d3-d2ea074d9316 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:07.487339 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df642aa-0600-4977-82d3-d2ea074d9316 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:07.492429 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 664/1307] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:38:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:07.493844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368892c-d736-47a9-bf6b-fbc74e31721a None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:07.494249 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368892c-d736-47a9-bf6b-fbc74e31721a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:07.494545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368892c-d736-47a9-bf6b-fbc74e31721a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:07.577621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-2368892c-d736-47a9-bf6b-fbc74e31721a None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:07.578814 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-2368892c-d736-47a9-bf6b-fbc74e31721a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:07.679028 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 644/1308] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:07.736939 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e1930-8b61-45cd-a528-5ecd46b806bc None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:07.738220 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e1930-8b61-45cd-a528-5ecd46b806bc None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:07.738733 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e1930-8b61-45cd-a528-5ecd46b806bc None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:07.740568 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 665/1309] 10.222.0.11 () {54 vars in 964 bytes} [Wed May 4 21:38:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:07.748911 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4bd2f-036d-4b1d-806f-019bf4d2fdd3 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:07.749210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4bd2f-036d-4b1d-806f-019bf4d2fdd3 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:07.749721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4bd2f-036d-4b1d-806f-019bf4d2fdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:07.837994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-8ca4bd2f-036d-4b1d-806f-019bf4d2fdd3 None None] MFA Rules not processed for user `e4e5d4fe283447c59672398a26dea225`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:07.839430 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-8ca4bd2f-036d-4b1d-806f-019bf4d2fdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:07.930024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e1930-8b61-45cd-a528-5ecd46b806bc None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:38:07.932618 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ba4e1930-8b61-45cd-a528-5ecd46b806bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:07.936569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 645/1310] 10.222.0.11 () {58 vars in 1061 bytes} [Wed May 4 21:38:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:08.059994 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e1930-8b61-45cd-a528-5ecd46b806bc None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:38:08.142002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18224717-295e-4592-a0ea-c392b31ecf1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:38:08.143480 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18224717-295e-4592-a0ea-c392b31ecf1d service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:08.143941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18224717-295e-4592-a0ea-c392b31ecf1d service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:08.144411 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18224717-295e-4592-a0ea-c392b31ecf1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:08.146532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-18224717-295e-4592-a0ea-c392b31ecf1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:08.265779 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18224717-295e-4592-a0ea-c392b31ecf1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:38:08.267517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18224717-295e-4592-a0ea-c392b31ecf1d service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:38:08.286591 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 666/1311] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:38:10.848364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63473031-598f-443d-98c2-b232523a66cb None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:10.848880 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63473031-598f-443d-98c2-b232523a66cb None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:10.848880 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63473031-598f-443d-98c2-b232523a66cb None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:10.850504 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 646/1312] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:10.855786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bd13d-5ce1-4906-9d46-65497474c451 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:10.856202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bd13d-5ce1-4906-9d46-65497474c451 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:10.856708 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bd13d-5ce1-4906-9d46-65497474c451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:10.940445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-649bd13d-5ce1-4906-9d46-65497474c451 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:10.941690 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-649bd13d-5ce1-4906-9d46-65497474c451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:11.041772 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 667/1313] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:11.076749 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63473031-598f-443d-98c2-b232523a66cb None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:38:11.078284 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-63473031-598f-443d-98c2-b232523a66cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:11.183082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63473031-598f-443d-98c2-b232523a66cb None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:38:11.256809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e4eb9-5ec8-4222-8e93-94d564c63151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:38:11.257470 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e4eb9-5ec8-4222-8e93-94d564c63151 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:11.257756 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e4eb9-5ec8-4222-8e93-94d564c63151 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:11.258037 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e4eb9-5ec8-4222-8e93-94d564c63151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:11.259723 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a34e4eb9-5ec8-4222-8e93-94d564c63151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:11.370391 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e4eb9-5ec8-4222-8e93-94d564c63151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:38:11.371885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e4eb9-5ec8-4222-8e93-94d564c63151 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:38:11.390554 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 647/1314] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:38:13.983031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5970a9e-9a28-450d-89b4-b04811197866 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:13.983904 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5970a9e-9a28-450d-89b4-b04811197866 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:13.983904 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5970a9e-9a28-450d-89b4-b04811197866 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:13.986079 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 668/1315] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:38:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:13.993850 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ade876-9cd8-4206-a371-598144d6d826 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:13.994260 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ade876-9cd8-4206-a371-598144d6d826 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:13.994401 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ade876-9cd8-4206-a371-598144d6d826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:14.059034 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-a0ade876-9cd8-4206-a371-598144d6d826 None None] MFA Rules not processed for user `ba8f59d247b54efd9168081ed348571f`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:14.060269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a0ade876-9cd8-4206-a371-598144d6d826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:14.162378 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 648/1316] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:38:13 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:14.222356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca395a2-cb85-453c-9bb2-f54312ef8417 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:14.222695 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca395a2-cb85-453c-9bb2-f54312ef8417 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:14.223193 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca395a2-cb85-453c-9bb2-f54312ef8417 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:14.225401 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 669/1317] 10.222.0.11 () {54 vars in 964 bytes} [Wed May 4 21:38:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:14.234573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79becb49-2603-4373-b4b8-69b2986316fa None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:14.234883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79becb49-2603-4373-b4b8-69b2986316fa None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:14.235494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79becb49-2603-4373-b4b8-69b2986316fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:14.314929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-79becb49-2603-4373-b4b8-69b2986316fa None None] MFA Rules not processed for user `e4e5d4fe283447c59672398a26dea225`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:14.316157 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-79becb49-2603-4373-b4b8-69b2986316fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:14.392047 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 649/1318] 10.222.0.11 () {58 vars in 1061 bytes} [Wed May 4 21:38:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:14.405259 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca395a2-cb85-453c-9bb2-f54312ef8417 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:38:14.406874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-fca395a2-cb85-453c-9bb2-f54312ef8417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:14.510582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca395a2-cb85-453c-9bb2-f54312ef8417 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:38:14.590384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5477df-a9d9-4c1b-9558-095a90468012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:38:14.591034 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5477df-a9d9-4c1b-9558-095a90468012 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:14.591344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5477df-a9d9-4c1b-9558-095a90468012 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:14.591612 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5477df-a9d9-4c1b-9558-095a90468012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:14.593228 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-3d5477df-a9d9-4c1b-9558-095a90468012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:14.699340 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5477df-a9d9-4c1b-9558-095a90468012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:38:14.700756 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5477df-a9d9-4c1b-9558-095a90468012 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:38:14.718412 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 670/1319] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:38:14 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:38:17.849620 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a431f-000f-43d0-90d9-d2c7e0611b7b None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:17.850475 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a431f-000f-43d0-90d9-d2c7e0611b7b None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:17.850475 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a431f-000f-43d0-90d9-d2c7e0611b7b None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:17.852765 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 650/1320] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:38:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:17.861135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0381584-36b2-43b4-ba00-e55b231d0f4f None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:17.861540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0381584-36b2-43b4-ba00-e55b231d0f4f None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:17.861693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0381584-36b2-43b4-ba00-e55b231d0f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:17.933981 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-f0381584-36b2-43b4-ba00-e55b231d0f4f None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:17.935897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-f0381584-36b2-43b4-ba00-e55b231d0f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:18.044496 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 671/1321] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:38:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:18.086539 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a431f-000f-43d0-90d9-d2c7e0611b7b None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:38:18.088104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-0f0a431f-000f-43d0-90d9-d2c7e0611b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:18.206769 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a431f-000f-43d0-90d9-d2c7e0611b7b None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:38:18.284175 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec28329-b53c-4d36-a580-9925672116ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:38:18.284827 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec28329-b53c-4d36-a580-9925672116ec service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:18.285113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec28329-b53c-4d36-a580-9925672116ec service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:18.285383 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec28329-b53c-4d36-a580-9925672116ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:18.287076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-aec28329-b53c-4d36-a580-9925672116ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:18.410810 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec28329-b53c-4d36-a580-9925672116ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:38:18.412289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec28329-b53c-4d36-a580-9925672116ec service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:38:18.430422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 651/1322] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:38:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:38:21.335948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863282b5-a798-4923-8b85-902f5f63fdef None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:21.336521 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863282b5-a798-4923-8b85-902f5f63fdef None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:21.336615 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863282b5-a798-4923-8b85-902f5f63fdef None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:21.337997 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 672/1323] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:21.343812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedc12e-d430-47b5-8042-d7af562fe5f3 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:21.344435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedc12e-d430-47b5-8042-d7af562fe5f3 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:21.344537 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedc12e-d430-47b5-8042-d7af562fe5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:21.409063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-7eedc12e-d430-47b5-8042-d7af562fe5f3 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:21.410244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-7eedc12e-d430-47b5-8042-d7af562fe5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:21.511428 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 652/1324] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:38:21.549035 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863282b5-a798-4923-8b85-902f5f63fdef None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:38:21.550572 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-863282b5-a798-4923-8b85-902f5f63fdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:21.654979 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863282b5-a798-4923-8b85-902f5f63fdef None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:38:21.732811 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1067d66-0c91-4eb7-aded-bc76c5106df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:38:21.733465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1067d66-0c91-4eb7-aded-bc76c5106df7 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:21.733749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1067d66-0c91-4eb7-aded-bc76c5106df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:21.734021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1067d66-0c91-4eb7-aded-bc76c5106df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:21.735797 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-d1067d66-0c91-4eb7-aded-bc76c5106df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:21.846021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1067d66-0c91-4eb7-aded-bc76c5106df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:38:21.847535 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1067d66-0c91-4eb7-aded-bc76c5106df7 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:38:21.866708 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 673/1325] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:38:24.163895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556f245-c7ee-4d60-9a92-e36901a401be None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:24.164483 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556f245-c7ee-4d60-9a92-e36901a401be None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:24.164483 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556f245-c7ee-4d60-9a92-e36901a401be None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:24.165850 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 653/1326] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:24.171249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2159e6-f2ce-4671-869b-a0664c1ae8e4 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:24.171677 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2159e6-f2ce-4671-869b-a0664c1ae8e4 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:24.171799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2159e6-f2ce-4671-869b-a0664c1ae8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:24.240512 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-5a2159e6-f2ce-4671-869b-a0664c1ae8e4 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:24.241710 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5a2159e6-f2ce-4671-869b-a0664c1ae8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:24.339874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 674/1327] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:24.375729 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556f245-c7ee-4d60-9a92-e36901a401be None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:38:24.377262 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c556f245-c7ee-4d60-9a92-e36901a401be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:24.482379 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556f245-c7ee-4d60-9a92-e36901a401be None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:38:24.556536 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9698c2c-3184-4aa7-a71a-5868b2b72d4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:38:24.557195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9698c2c-3184-4aa7-a71a-5868b2b72d4b service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:24.557471 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9698c2c-3184-4aa7-a71a-5868b2b72d4b service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:24.557728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9698c2c-3184-4aa7-a71a-5868b2b72d4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:24.559399 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c9698c2c-3184-4aa7-a71a-5868b2b72d4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:24.674858 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9698c2c-3184-4aa7-a71a-5868b2b72d4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:38:24.676351 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9698c2c-3184-4aa7-a71a-5868b2b72d4b service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:38:24.695501 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 654/1328] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:38:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:38:26.960847 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ce863-9ea1-493a-9578-2b1d5e4ef76a None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:26.961462 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ce863-9ea1-493a-9578-2b1d5e4ef76a None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:26.961462 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ce863-9ea1-493a-9578-2b1d5e4ef76a None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:26.962880 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 675/1329] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:26.968861 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8591af8-e02f-4b8e-8eae-8c9454f5a676 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:26.969359 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8591af8-e02f-4b8e-8eae-8c9454f5a676 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:26.969447 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8591af8-e02f-4b8e-8eae-8c9454f5a676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:27.034414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-b8591af8-e02f-4b8e-8eae-8c9454f5a676 None None] MFA Rules not processed for user `ba8f59d247b54efd9168081ed348571f`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:27.035709 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b8591af8-e02f-4b8e-8eae-8c9454f5a676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:27.138010 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 655/1330] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:38:26 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:27.174664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ce863-9ea1-493a-9578-2b1d5e4ef76a None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:38:27.176207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-697ce863-9ea1-493a-9578-2b1d5e4ef76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:27.282013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ce863-9ea1-493a-9578-2b1d5e4ef76a None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:38:27.357505 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c5625-4fb0-4742-a3b6-721064ce7cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:38:27.358152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c5625-4fb0-4742-a3b6-721064ce7cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:27.358434 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c5625-4fb0-4742-a3b6-721064ce7cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:27.358707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c5625-4fb0-4742-a3b6-721064ce7cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:27.360456 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-3a1c5625-4fb0-4742-a3b6-721064ce7cb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:27.469831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c5625-4fb0-4742-a3b6-721064ce7cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:38:27.471296 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c5625-4fb0-4742-a3b6-721064ce7cb4 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:38:27.490031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 676/1331] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:38:27 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:38:30.065334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf19292-5f62-412a-9b7d-f837e89c3469 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:30.066181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf19292-5f62-412a-9b7d-f837e89c3469 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:30.066181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf19292-5f62-412a-9b7d-f837e89c3469 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:30.067952 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 656/1332] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:38:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:30.074013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bdd98-21cd-43ac-8581-304de1d96bd0 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:30.074713 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bdd98-21cd-43ac-8581-304de1d96bd0 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:30.074867 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bdd98-21cd-43ac-8581-304de1d96bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:30.146617 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-f89bdd98-21cd-43ac-8581-304de1d96bd0 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:30.147777 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-f89bdd98-21cd-43ac-8581-304de1d96bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:30.256070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 677/1333] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:30.295891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf19292-5f62-412a-9b7d-f837e89c3469 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:38:30.298965 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-8bf19292-5f62-412a-9b7d-f837e89c3469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:30.410953 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf19292-5f62-412a-9b7d-f837e89c3469 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:38:30.500006 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da68cdb-2f72-48be-908f-8df6d3e4d15c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:38:30.501258 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da68cdb-2f72-48be-908f-8df6d3e4d15c service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:30.501562 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da68cdb-2f72-48be-908f-8df6d3e4d15c service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:30.501812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da68cdb-2f72-48be-908f-8df6d3e4d15c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:30.503541 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-9da68cdb-2f72-48be-908f-8df6d3e4d15c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:30.627436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da68cdb-2f72-48be-908f-8df6d3e4d15c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:38:30.628890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da68cdb-2f72-48be-908f-8df6d3e4d15c service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:38:30.648630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 657/1334] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:38:32.933464 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e98784-681d-4a37-bd9b-ef06c535d07c None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:32.934021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e98784-681d-4a37-bd9b-ef06c535d07c None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:32.934021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e98784-681d-4a37-bd9b-ef06c535d07c None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:32.935457 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 678/1335] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:32.942766 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992c6cd-39dd-479e-8266-2832ff2e1e74 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:32.943282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992c6cd-39dd-479e-8266-2832ff2e1e74 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:32.943377 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992c6cd-39dd-479e-8266-2832ff2e1e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:33.011211 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-a992c6cd-39dd-479e-8266-2832ff2e1e74 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:33.012406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a992c6cd-39dd-479e-8266-2832ff2e1e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:33.113838 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 658/1336] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:33.157560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e98784-681d-4a37-bd9b-ef06c535d07c None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:38:33.159634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-f9e98784-681d-4a37-bd9b-ef06c535d07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:33.274067 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e98784-681d-4a37-bd9b-ef06c535d07c None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:38:33.345726 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae8369-2dd3-49f6-88e1-251f319b63dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:38:33.346372 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae8369-2dd3-49f6-88e1-251f319b63dd service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:33.346658 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae8369-2dd3-49f6-88e1-251f319b63dd service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:33.346935 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae8369-2dd3-49f6-88e1-251f319b63dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:33.348600 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-f9ae8369-2dd3-49f6-88e1-251f319b63dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:33.459374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae8369-2dd3-49f6-88e1-251f319b63dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:38:33.460816 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae8369-2dd3-49f6-88e1-251f319b63dd service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:38:33.479399 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 679/1337] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:38:36.137084 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51715771-4c58-45f3-bc89-146b831d34fe None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:36.137714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51715771-4c58-45f3-bc89-146b831d34fe None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:36.137714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51715771-4c58-45f3-bc89-146b831d34fe None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:36.139243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 659/1338] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:36.145769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d72f7-d3ca-4ace-9307-932bae2a75bb None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:36.146490 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d72f7-d3ca-4ace-9307-932bae2a75bb None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:36.146693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d72f7-d3ca-4ace-9307-932bae2a75bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:36.219551 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-910d72f7-d3ca-4ace-9307-932bae2a75bb None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:36.220779 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-910d72f7-d3ca-4ace-9307-932bae2a75bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:36.322102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 680/1339] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:38:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:36.363281 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51715771-4c58-45f3-bc89-146b831d34fe None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:38:36.364806 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-51715771-4c58-45f3-bc89-146b831d34fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:36.493206 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51715771-4c58-45f3-bc89-146b831d34fe None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:38:36.579871 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13035f5a-9b2c-4c56-b034-be2915bb9a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:38:36.580535 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13035f5a-9b2c-4c56-b034-be2915bb9a1e service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:36.580822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13035f5a-9b2c-4c56-b034-be2915bb9a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:36.581098 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13035f5a-9b2c-4c56-b034-be2915bb9a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:36.582718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-13035f5a-9b2c-4c56-b034-be2915bb9a1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:36.704484 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13035f5a-9b2c-4c56-b034-be2915bb9a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:38:36.705925 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13035f5a-9b2c-4c56-b034-be2915bb9a1e service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:38:36.726177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 660/1340] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:38:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:38:41.001741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4549b2-1682-4d98-ac3d-8e0d68c32d26 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:41.002361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4549b2-1682-4d98-ac3d-8e0d68c32d26 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:41.002361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4549b2-1682-4d98-ac3d-8e0d68c32d26 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:41.003602 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 681/1341] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:41.008888 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49894d-36d5-4365-9040-1dcbc9d12e3b None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:41.009329 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49894d-36d5-4365-9040-1dcbc9d12e3b None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:41.009441 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49894d-36d5-4365-9040-1dcbc9d12e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:41.083016 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-6f49894d-36d5-4365-9040-1dcbc9d12e3b None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:41.084233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-6f49894d-36d5-4365-9040-1dcbc9d12e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:41.188943 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 661/1342] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:41.236921 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4549b2-1682-4d98-ac3d-8e0d68c32d26 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:38:41.239467 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-fb4549b2-1682-4d98-ac3d-8e0d68c32d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:41.340183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4549b2-1682-4d98-ac3d-8e0d68c32d26 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:38:41.345039 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32a5d2-c457-4a38-8cea-50caef474766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:38:41.345698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32a5d2-c457-4a38-8cea-50caef474766 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:41.345985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32a5d2-c457-4a38-8cea-50caef474766 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:41.346268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32a5d2-c457-4a38-8cea-50caef474766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:41.355745 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32a5d2-c457-4a38-8cea-50caef474766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:38:41.357179 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32a5d2-c457-4a38-8cea-50caef474766 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:38:41.367484 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 682/1343] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:38:44.210840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7a7d8-c1ce-4792-9608-95085b94f6a8 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:44.211466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7a7d8-c1ce-4792-9608-95085b94f6a8 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:44.211466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7a7d8-c1ce-4792-9608-95085b94f6a8 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:44.212776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 662/1344] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:44.218447 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fa9d0-acdc-427e-a302-62f4cd8ed234 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:44.219034 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fa9d0-acdc-427e-a302-62f4cd8ed234 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:44.219034 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fa9d0-acdc-427e-a302-62f4cd8ed234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:44.247643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-fe6fa9d0-acdc-427e-a302-62f4cd8ed234 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:44.248819 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-fe6fa9d0-acdc-427e-a302-62f4cd8ed234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:44.324998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 683/1345] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:38:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:44.362753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7a7d8-c1ce-4792-9608-95085b94f6a8 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:38:44.375508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7a7d8-c1ce-4792-9608-95085b94f6a8 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:38:44.379691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ec81d-9325-4131-afc3-5dcd88df25d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:38:44.380337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ec81d-9325-4131-afc3-5dcd88df25d6 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:44.380622 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ec81d-9325-4131-afc3-5dcd88df25d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:44.380896 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ec81d-9325-4131-afc3-5dcd88df25d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:44.390134 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ec81d-9325-4131-afc3-5dcd88df25d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:38:44.391782 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ec81d-9325-4131-afc3-5dcd88df25d6 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:38:44.401327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 663/1346] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:38:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:38:48.616214 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb1067-064f-4771-8f9a-c3fa67345582 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:48.616754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb1067-064f-4771-8f9a-c3fa67345582 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:48.616860 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb1067-064f-4771-8f9a-c3fa67345582 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:48.618236 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 684/1347] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:48.623586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ff79c-de45-49d4-9744-955edb484ea9 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:48.623972 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ff79c-de45-49d4-9744-955edb484ea9 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:48.624541 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ff79c-de45-49d4-9744-955edb484ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:48.642762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-8c1ff79c-de45-49d4-9744-955edb484ea9 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:48.643968 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-8c1ff79c-de45-49d4-9744-955edb484ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:48.652184 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 664/1348] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:48.689371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb1067-064f-4771-8f9a-c3fa67345582 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:38:48.700781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb1067-064f-4771-8f9a-c3fa67345582 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:38:48.704719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c9724-953c-4c6f-b836-cbf91ae4531c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:38:48.705426 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c9724-953c-4c6f-b836-cbf91ae4531c service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:48.705801 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c9724-953c-4c6f-b836-cbf91ae4531c service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:48.706139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c9724-953c-4c6f-b836-cbf91ae4531c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:48.715112 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c9724-953c-4c6f-b836-cbf91ae4531c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:38:48.716570 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c9724-953c-4c6f-b836-cbf91ae4531c service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:38:48.726478 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 685/1349] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:38:54.283355 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0cd76-b511-4566-a05f-2f80bb81e2bd None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:54.283883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0cd76-b511-4566-a05f-2f80bb81e2bd None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:54.284008 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0cd76-b511-4566-a05f-2f80bb81e2bd None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:54.294107 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 665/1350] 10.222.0.11 () {54 vars in 921 bytes} [Wed May 4 21:38:54 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:54.299977 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c6556-7fb3-4b98-8648-0b76c9027b24 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:54.300942 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c6556-7fb3-4b98-8648-0b76c9027b24 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:54.301462 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c6556-7fb3-4b98-8648-0b76c9027b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:54.399907 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-6d5c6556-7fb3-4b98-8648-0b76c9027b24 None None] MFA Rules not processed for user `e203d7077af54930a640b2334a1d8fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:54.401496 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-6d5c6556-7fb3-4b98-8648-0b76c9027b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:54.549400 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 686/1351] 10.222.0.11 () {58 vars in 1018 bytes} [Wed May 4 21:38:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:58.660303 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1658e-062c-44f7-9f91-262e353c8435 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:58.661140 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1658e-062c-44f7-9f91-262e353c8435 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:58.661140 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1658e-062c-44f7-9f91-262e353c8435 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:58.663211 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 666/1352] 10.222.0.11 () {54 vars in 921 bytes} [Wed May 4 21:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:58.668811 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659f8f0-555f-4f4c-85b7-97d701d62e53 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:58.669395 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659f8f0-555f-4f4c-85b7-97d701d62e53 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:58.669395 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659f8f0-555f-4f4c-85b7-97d701d62e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:58.693116 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-1659f8f0-555f-4f4c-85b7-97d701d62e53 None None] MFA Rules not processed for user `e203d7077af54930a640b2334a1d8fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:58.695358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-1659f8f0-555f-4f4c-85b7-97d701d62e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:58.706905 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 687/1353] 10.222.0.11 () {58 vars in 1018 bytes} [Wed May 4 21:38:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:00.131694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6c59c-14d5-44de-9943-d3f9d0a73647 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:00.132274 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6c59c-14d5-44de-9943-d3f9d0a73647 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:00.132274 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6c59c-14d5-44de-9943-d3f9d0a73647 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:00.133613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 667/1354] 10.222.0.11 () {54 vars in 921 bytes} [Wed May 4 21:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:00.139408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cda187-e1d5-496e-8525-33d4df0d3b5f None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:00.139866 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cda187-e1d5-496e-8525-33d4df0d3b5f None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:00.140009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cda187-e1d5-496e-8525-33d4df0d3b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:00.161428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-d5cda187-e1d5-496e-8525-33d4df0d3b5f None None] MFA Rules not processed for user `e203d7077af54930a640b2334a1d8fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:00.162622 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-d5cda187-e1d5-496e-8525-33d4df0d3b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:00.172153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 688/1355] 10.222.0.11 () {58 vars in 1018 bytes} [Wed May 4 21:39:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:04.011887 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a02070-c51e-4e49-bae7-528754395a2c None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:04.012752 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a02070-c51e-4e49-bae7-528754395a2c None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:04.013220 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a02070-c51e-4e49-bae7-528754395a2c None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:04.014551 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 668/1356] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:04.019923 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b998c9c-f412-43c0-8a40-1ca2e0d282d2 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:04.020353 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b998c9c-f412-43c0-8a40-1ca2e0d282d2 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:04.020684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b998c9c-f412-43c0-8a40-1ca2e0d282d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:04.039284 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-8b998c9c-f412-43c0-8a40-1ca2e0d282d2 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:04.040655 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-8b998c9c-f412-43c0-8a40-1ca2e0d282d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:04.051463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 689/1357] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:04.096746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4b423-340c-4418-8e48-e58fcd6969e2 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:04.097156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4b423-340c-4418-8e48-e58fcd6969e2 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:04.097527 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4b423-340c-4418-8e48-e58fcd6969e2 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:04.099015 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 669/1358] 10.222.0.11 () {54 vars in 960 bytes} [Wed May 4 21:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:04.104428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0e926-55d8-4454-a04f-0257045bca0b None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:04.104722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0e926-55d8-4454-a04f-0257045bca0b None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:04.105003 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0e926-55d8-4454-a04f-0257045bca0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:04.152703 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-fee0e926-55d8-4454-a04f-0257045bca0b None None] MFA Rules not processed for user `f4f207481ccb4cfcbbcffd9df73d2985`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:04.153888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-fee0e926-55d8-4454-a04f-0257045bca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:04.234605 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 690/1359] 10.222.0.11 () {58 vars in 1057 bytes} [Wed May 4 21:39:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:04.247290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4b423-340c-4418-8e48-e58fcd6969e2 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:04.263786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4b423-340c-4418-8e48-e58fcd6969e2 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:04.270792 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1710b9-f318-4b2a-8168-5dbc99c98a79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:04.271797 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1710b9-f318-4b2a-8168-5dbc99c98a79 service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:04.272308 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1710b9-f318-4b2a-8168-5dbc99c98a79 service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:04.272805 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1710b9-f318-4b2a-8168-5dbc99c98a79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:04.283664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1710b9-f318-4b2a-8168-5dbc99c98a79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:04.285475 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1710b9-f318-4b2a-8168-5dbc99c98a79 service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:04.298195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 670/1360] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:06.772859 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048caff-29e9-4af1-80a8-8fb7ba7a8005 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:06.773418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048caff-29e9-4af1-80a8-8fb7ba7a8005 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:06.773418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048caff-29e9-4af1-80a8-8fb7ba7a8005 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:06.774788 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 691/1361] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:06.780039 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7c45f-6b13-4850-b61e-18c2d05231d9 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:06.780992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7c45f-6b13-4850-b61e-18c2d05231d9 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:06.781898 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7c45f-6b13-4850-b61e-18c2d05231d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:06.800417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-b0c7c45f-6b13-4850-b61e-18c2d05231d9 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:06.801617 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b0c7c45f-6b13-4850-b61e-18c2d05231d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:06.809756 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 671/1362] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:39:06.853453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048caff-29e9-4af1-80a8-8fb7ba7a8005 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:06.869518 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048caff-29e9-4af1-80a8-8fb7ba7a8005 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:06.875281 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d12ea0-faa9-4d0e-9665-b18954dc6903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:06.875950 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d12ea0-faa9-4d0e-9665-b18954dc6903 service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:06.876353 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d12ea0-faa9-4d0e-9665-b18954dc6903 service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:06.876635 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d12ea0-faa9-4d0e-9665-b18954dc6903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:06.885092 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d12ea0-faa9-4d0e-9665-b18954dc6903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:06.886728 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d12ea0-faa9-4d0e-9665-b18954dc6903 service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:06.896480 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 692/1363] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:39:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:09.461032 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3545d-83d9-40b5-9c4c-1f7e4d675eb0 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:09.461588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3545d-83d9-40b5-9c4c-1f7e4d675eb0 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:09.461588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3545d-83d9-40b5-9c4c-1f7e4d675eb0 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:09.463185 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 672/1364] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:09.468357 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da936f63-a748-430a-a367-bddaa8695906 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:09.469130 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da936f63-a748-430a-a367-bddaa8695906 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:09.469241 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da936f63-a748-430a-a367-bddaa8695906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:09.486938 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-da936f63-a748-430a-a367-bddaa8695906 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:09.488079 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-da936f63-a748-430a-a367-bddaa8695906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:09.495932 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 693/1365] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:09.540422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74835c8-f078-438f-a980-9169b60100c9 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:09.540786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74835c8-f078-438f-a980-9169b60100c9 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:09.541128 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74835c8-f078-438f-a980-9169b60100c9 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:09.542530 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 673/1366] 10.222.0.11 () {54 vars in 960 bytes} [Wed May 4 21:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:09.548080 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646ea6-e450-48d3-a203-7c26c4708735 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:09.548370 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646ea6-e450-48d3-a203-7c26c4708735 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:09.548645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646ea6-e450-48d3-a203-7c26c4708735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:09.566769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-05646ea6-e450-48d3-a203-7c26c4708735 None None] MFA Rules not processed for user `f4f207481ccb4cfcbbcffd9df73d2985`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:09.568010 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-05646ea6-e450-48d3-a203-7c26c4708735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:09.579258 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 694/1367] 10.222.0.11 () {58 vars in 1057 bytes} [Wed May 4 21:39:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:39:09.587084 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74835c8-f078-438f-a980-9169b60100c9 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:09.601958 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74835c8-f078-438f-a980-9169b60100c9 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:09.607470 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5f29a-d675-4f57-84d2-21603aefcdbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:09.608107 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5f29a-d675-4f57-84d2-21603aefcdbe service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:09.608394 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5f29a-d675-4f57-84d2-21603aefcdbe service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:09.608664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5f29a-d675-4f57-84d2-21603aefcdbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:09.616816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5f29a-d675-4f57-84d2-21603aefcdbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:09.618380 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5f29a-d675-4f57-84d2-21603aefcdbe service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:09.628548 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 674/1368] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:39:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:11.939629 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ebdc9-9108-401c-8b21-e2c5058e7a86 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:11.940194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ebdc9-9108-401c-8b21-e2c5058e7a86 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:11.940194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ebdc9-9108-401c-8b21-e2c5058e7a86 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:11.941745 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 695/1369] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:11.947058 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa612d8-ca0b-4ef5-a045-357818e18323 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:11.947513 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa612d8-ca0b-4ef5-a045-357818e18323 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:11.947603 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa612d8-ca0b-4ef5-a045-357818e18323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:11.966996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-daa612d8-ca0b-4ef5-a045-357818e18323 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:11.968373 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-daa612d8-ca0b-4ef5-a045-357818e18323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:11.976804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 675/1370] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:12.023168 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ebdc9-9108-401c-8b21-e2c5058e7a86 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:12.038523 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ebdc9-9108-401c-8b21-e2c5058e7a86 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:12.044141 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef35750-1bcd-47a6-971b-9dad0d64c2df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:12.044794 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef35750-1bcd-47a6-971b-9dad0d64c2df service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:12.045111 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef35750-1bcd-47a6-971b-9dad0d64c2df service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:12.045355 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef35750-1bcd-47a6-971b-9dad0d64c2df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:12.054319 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef35750-1bcd-47a6-971b-9dad0d64c2df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:12.055943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef35750-1bcd-47a6-971b-9dad0d64c2df service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:12.066265 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 696/1371] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:12.195581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31117f6b-7b27-430f-a630-8609b2e517c7 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:12.195839 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31117f6b-7b27-430f-a630-8609b2e517c7 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:12.195996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31117f6b-7b27-430f-a630-8609b2e517c7 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:12.197602 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 676/1372] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:12.203770 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66992eb-b693-47e9-88d7-ce25c1ad97ff None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:12.204742 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66992eb-b693-47e9-88d7-ce25c1ad97ff None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:12.205235 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66992eb-b693-47e9-88d7-ce25c1ad97ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:12.228447 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-e66992eb-b693-47e9-88d7-ce25c1ad97ff None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:12.229848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-e66992eb-b693-47e9-88d7-ce25c1ad97ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:12.243099 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 697/1373] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:12.549892 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c169de-39fb-4437-bd2d-d50e360ed25f None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:12.550942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c169de-39fb-4437-bd2d-d50e360ed25f None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:12.550942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c169de-39fb-4437-bd2d-d50e360ed25f None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:12.552214 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 677/1374] 10.222.0.11 () {54 vars in 963 bytes} [Wed May 4 21:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:12.557152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634a759-d5e0-489e-b2db-7ca23ca62543 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:12.557527 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634a759-d5e0-489e-b2db-7ca23ca62543 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:12.557882 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634a759-d5e0-489e-b2db-7ca23ca62543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:12.619502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-d634a759-d5e0-489e-b2db-7ca23ca62543 None None] MFA Rules not processed for user `b9a86016cde040e7b8a9eeaf34cf0715`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:12.620797 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-d634a759-d5e0-489e-b2db-7ca23ca62543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:12.680917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 698/1375] 10.222.0.11 () {58 vars in 1060 bytes} [Wed May 4 21:39:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:12.688747 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c169de-39fb-4437-bd2d-d50e360ed25f None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:12.699432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c169de-39fb-4437-bd2d-d50e360ed25f None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:12.703280 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b206739-5027-4a42-945a-f6dd9f391d67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:12.703996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b206739-5027-4a42-945a-f6dd9f391d67 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:12.704380 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b206739-5027-4a42-945a-f6dd9f391d67 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:12.704725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b206739-5027-4a42-945a-f6dd9f391d67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:12.714409 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b206739-5027-4a42-945a-f6dd9f391d67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:12.715996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b206739-5027-4a42-945a-f6dd9f391d67 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:12.728017 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 678/1376] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:14.381707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb7ba9-7501-4e0a-a8ab-072f397fdf00 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:14.382276 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb7ba9-7501-4e0a-a8ab-072f397fdf00 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:14.382276 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb7ba9-7501-4e0a-a8ab-072f397fdf00 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:14.383610 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 699/1377] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:14.389612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2efe8-6a07-4416-90f3-16ef271ec3ee None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:14.390213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2efe8-6a07-4416-90f3-16ef271ec3ee None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:14.390714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2efe8-6a07-4416-90f3-16ef271ec3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:14.410339 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-23d2efe8-6a07-4416-90f3-16ef271ec3ee None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:14.411676 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-23d2efe8-6a07-4416-90f3-16ef271ec3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:14.422744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 679/1378] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:14.468314 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb7ba9-7501-4e0a-a8ab-072f397fdf00 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:14.484714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb7ba9-7501-4e0a-a8ab-072f397fdf00 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:14.490472 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbff7f1-c514-4e99-9428-4e7d3f380097 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:14.491226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbff7f1-c514-4e99-9428-4e7d3f380097 service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:14.491511 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbff7f1-c514-4e99-9428-4e7d3f380097 service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:14.491787 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbff7f1-c514-4e99-9428-4e7d3f380097 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:14.500645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbff7f1-c514-4e99-9428-4e7d3f380097 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:14.502225 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbff7f1-c514-4e99-9428-4e7d3f380097 service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:14.512060 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 700/1379] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:16.801999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0de7c-5a13-426f-a698-9b1bb20a48f5 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:16.802894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0de7c-5a13-426f-a698-9b1bb20a48f5 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:16.803210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0de7c-5a13-426f-a698-9b1bb20a48f5 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:16.804727 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 680/1380] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:16.810167 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55c386-c977-4a5c-99e2-ff29b3a224ab None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:16.810644 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55c386-c977-4a5c-99e2-ff29b3a224ab None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:16.810726 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55c386-c977-4a5c-99e2-ff29b3a224ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:16.829549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-bb55c386-c977-4a5c-99e2-ff29b3a224ab None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:16.830779 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-bb55c386-c977-4a5c-99e2-ff29b3a224ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:16.839167 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 701/1381] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:16.884367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0de7c-5a13-426f-a698-9b1bb20a48f5 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:16.901463 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0de7c-5a13-426f-a698-9b1bb20a48f5 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:16.907917 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91749e1f-fbd4-4dda-9dd0-24545dc983ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:16.908711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91749e1f-fbd4-4dda-9dd0-24545dc983ee service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:16.909098 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91749e1f-fbd4-4dda-9dd0-24545dc983ee service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:16.909475 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91749e1f-fbd4-4dda-9dd0-24545dc983ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:16.918126 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91749e1f-fbd4-4dda-9dd0-24545dc983ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:16.919859 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91749e1f-fbd4-4dda-9dd0-24545dc983ee service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:16.929549 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 681/1382] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:19.187524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39a56e-89ea-4092-b490-6da5740af860 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:19.188121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39a56e-89ea-4092-b490-6da5740af860 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:19.188121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39a56e-89ea-4092-b490-6da5740af860 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:19.191455 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 702/1383] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:39:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:19.194592 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14326a1-1c4d-4baf-af21-48e0fb426650 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:19.195090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14326a1-1c4d-4baf-af21-48e0fb426650 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:19.195190 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14326a1-1c4d-4baf-af21-48e0fb426650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:19.213284 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-f14326a1-1c4d-4baf-af21-48e0fb426650 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:19.214494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f14326a1-1c4d-4baf-af21-48e0fb426650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:19.222971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 682/1384] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:19.265349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39a56e-89ea-4092-b490-6da5740af860 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:19.280609 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39a56e-89ea-4092-b490-6da5740af860 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:19.286404 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26371c90-26e0-41c7-987d-06501747df6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:19.287178 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26371c90-26e0-41c7-987d-06501747df6e service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:19.287461 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26371c90-26e0-41c7-987d-06501747df6e service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:19.287739 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26371c90-26e0-41c7-987d-06501747df6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:19.296611 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26371c90-26e0-41c7-987d-06501747df6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:19.298198 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26371c90-26e0-41c7-987d-06501747df6e service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:19.307792 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 703/1385] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:39:21.701216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929374eb-60e9-4698-be6f-ec9dc804ce8d None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:21.701808 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929374eb-60e9-4698-be6f-ec9dc804ce8d None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:21.702179 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929374eb-60e9-4698-be6f-ec9dc804ce8d None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:21.704592 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 683/1386] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:39:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:21.712019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a4fb8-a8db-4ef1-8d24-57fa83af41bd None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:21.712475 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a4fb8-a8db-4ef1-8d24-57fa83af41bd None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:21.712567 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a4fb8-a8db-4ef1-8d24-57fa83af41bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:21.731456 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-bc5a4fb8-a8db-4ef1-8d24-57fa83af41bd None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:21.732644 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-bc5a4fb8-a8db-4ef1-8d24-57fa83af41bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:21.740649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 704/1387] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:21.814228 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929374eb-60e9-4698-be6f-ec9dc804ce8d None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:21.830622 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929374eb-60e9-4698-be6f-ec9dc804ce8d None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:21.836565 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0f809-e853-4611-8746-2e0f3cf7641c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:21.837242 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0f809-e853-4611-8746-2e0f3cf7641c service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:21.837538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0f809-e853-4611-8746-2e0f3cf7641c service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:21.837824 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0f809-e853-4611-8746-2e0f3cf7641c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:21.847414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0f809-e853-4611-8746-2e0f3cf7641c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:21.849002 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0f809-e853-4611-8746-2e0f3cf7641c service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:21.859144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 684/1388] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:24.229535 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112fec0-6c93-403e-b14d-b8537158bfd9 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:24.230180 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112fec0-6c93-403e-b14d-b8537158bfd9 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:24.230180 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112fec0-6c93-403e-b14d-b8537158bfd9 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:24.231718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 705/1389] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:24.237737 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5c0ba-f759-4820-b09b-d18693969282 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:24.238172 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5c0ba-f759-4820-b09b-d18693969282 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:24.238392 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5c0ba-f759-4820-b09b-d18693969282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:24.259255 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-e7f5c0ba-f759-4820-b09b-d18693969282 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:24.260521 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e7f5c0ba-f759-4820-b09b-d18693969282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:24.273457 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 685/1390] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:39:24.322638 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112fec0-6c93-403e-b14d-b8537158bfd9 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:24.346465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112fec0-6c93-403e-b14d-b8537158bfd9 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:24.353819 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788e7c4-3697-463c-8e24-7e31b6a800b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:24.354483 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788e7c4-3697-463c-8e24-7e31b6a800b9 service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:24.354794 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788e7c4-3697-463c-8e24-7e31b6a800b9 service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:24.355155 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788e7c4-3697-463c-8e24-7e31b6a800b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:24.365868 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788e7c4-3697-463c-8e24-7e31b6a800b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:24.367780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788e7c4-3697-463c-8e24-7e31b6a800b9 service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:24.378697 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 706/1391] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:26.647566 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9d051-24e7-46d2-9156-eb8963e353de None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:26.648188 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9d051-24e7-46d2-9156-eb8963e353de None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:26.648188 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9d051-24e7-46d2-9156-eb8963e353de None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:26.649456 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 686/1392] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:26.654852 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93774b92-b22f-49be-8f61-b8c4e7ff7a71 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:26.655315 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93774b92-b22f-49be-8f61-b8c4e7ff7a71 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:26.655432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93774b92-b22f-49be-8f61-b8c4e7ff7a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:26.673887 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-93774b92-b22f-49be-8f61-b8c4e7ff7a71 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:26.675098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-93774b92-b22f-49be-8f61-b8c4e7ff7a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:26.684062 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 707/1393] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:26.727147 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9d051-24e7-46d2-9156-eb8963e353de None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:26.743503 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9d051-24e7-46d2-9156-eb8963e353de None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:26.749407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af607c-5cd3-4d37-a1c7-b5424b0e4bff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:26.750039 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af607c-5cd3-4d37-a1c7-b5424b0e4bff service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:26.750319 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af607c-5cd3-4d37-a1c7-b5424b0e4bff service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:26.750593 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af607c-5cd3-4d37-a1c7-b5424b0e4bff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:26.759480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af607c-5cd3-4d37-a1c7-b5424b0e4bff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:26.761079 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af607c-5cd3-4d37-a1c7-b5424b0e4bff service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:26.770969 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 687/1394] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:28.449231 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c100042-2c6a-4d91-9f7b-155b96086079 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:28.449846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c100042-2c6a-4d91-9f7b-155b96086079 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:28.449846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c100042-2c6a-4d91-9f7b-155b96086079 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:28.451198 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 708/1395] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:28.456764 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a934e-6d13-4c1f-899c-94e7f0f0a27f None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:28.457230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a934e-6d13-4c1f-899c-94e7f0f0a27f None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:28.457344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a934e-6d13-4c1f-899c-94e7f0f0a27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:28.475631 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-5f9a934e-6d13-4c1f-899c-94e7f0f0a27f None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:28.476799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-5f9a934e-6d13-4c1f-899c-94e7f0f0a27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:28.485041 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 688/1396] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:28.540346 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dbc1d-beed-416b-904f-0ebe8f67c928 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:28.540631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dbc1d-beed-416b-904f-0ebe8f67c928 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:28.540907 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dbc1d-beed-416b-904f-0ebe8f67c928 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:28.542304 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 709/1397] 10.222.0.11 () {54 vars in 962 bytes} [Wed May 4 21:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:28.547402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49912c9-673e-488b-84b7-b7451051af1f None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:28.547691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49912c9-673e-488b-84b7-b7451051af1f None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:28.547959 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49912c9-673e-488b-84b7-b7451051af1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:28.605699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-a49912c9-673e-488b-84b7-b7451051af1f None None] MFA Rules not processed for user `c61205d7e96f496ab9f8ca84ab9408b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:28.606914 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a49912c9-673e-488b-84b7-b7451051af1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:28.668958 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 689/1398] 10.222.0.11 () {58 vars in 1059 bytes} [Wed May 4 21:39:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:28.676621 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dbc1d-beed-416b-904f-0ebe8f67c928 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:28.688073 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dbc1d-beed-416b-904f-0ebe8f67c928 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:28.692291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27991cda-3434-4dae-a47c-c15e7271f468 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c61205d7e96f496ab9f8ca84ab9408b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:28.693010 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27991cda-3434-4dae-a47c-c15e7271f468 service glance] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:28.693370 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27991cda-3434-4dae-a47c-c15e7271f468 service glance] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:28.693643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27991cda-3434-4dae-a47c-c15e7271f468 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:28.703122 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27991cda-3434-4dae-a47c-c15e7271f468 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:28.704527 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27991cda-3434-4dae-a47c-c15e7271f468 service glance] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:28.713890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 710/1399] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:29.093334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e5000-fb9d-4ee9-8953-93b8138b0cca None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:29.093622 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e5000-fb9d-4ee9-8953-93b8138b0cca None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:29.094251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e5000-fb9d-4ee9-8953-93b8138b0cca None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:29.095789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 690/1400] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:29.101275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4eb3ed-eb9b-4723-82c5-578ac050d717 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:29.101565 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4eb3ed-eb9b-4723-82c5-578ac050d717 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:29.101843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4eb3ed-eb9b-4723-82c5-578ac050d717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:29.121191 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-5f4eb3ed-eb9b-4723-82c5-578ac050d717 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:29.123079 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5f4eb3ed-eb9b-4723-82c5-578ac050d717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:29.133393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 711/1401] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:29.140664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea120e1-7699-4dd9-b144-aa86d92c0623 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:29.140954 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea120e1-7699-4dd9-b144-aa86d92c0623 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:29.141226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea120e1-7699-4dd9-b144-aa86d92c0623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:29.177354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4eb3ed-eb9b-4723-82c5-578ac050d717 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:29.190160 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4eb3ed-eb9b-4723-82c5-578ac050d717 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:29.192832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-cea120e1-7699-4dd9-b144-aa86d92c0623 None None] MFA Rules not processed for user `82b2e79995f94ab880f5d798ddd649b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:29.194054 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-cea120e1-7699-4dd9-b144-aa86d92c0623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:29.195720 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527e129-df6d-459a-8d12-7bec22e39893 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:29.196369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527e129-df6d-459a-8d12-7bec22e39893 service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:29.196655 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527e129-df6d-459a-8d12-7bec22e39893 service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:29.196932 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527e129-df6d-459a-8d12-7bec22e39893 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:29.205466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527e129-df6d-459a-8d12-7bec22e39893 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:29.207067 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527e129-df6d-459a-8d12-7bec22e39893 service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:29.216222 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 712/1402] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:29.259859 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 691/1403] 10.222.0.11 () {58 vars in 1009 bytes} [Wed May 4 21:39:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:29.303870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9f5ed-10d1-4e6f-9396-e6ce6e5bdf12 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:29.304384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9f5ed-10d1-4e6f-9396-e6ce6e5bdf12 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:29.304743 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9f5ed-10d1-4e6f-9396-e6ce6e5bdf12 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:29.306357 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 713/1404] 10.222.0.11 () {54 vars in 942 bytes} [Wed May 4 21:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:29.314040 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8efe6-9f41-436e-b7ba-7de84d39077a None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:29.314325 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8efe6-9f41-436e-b7ba-7de84d39077a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:29.314600 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8efe6-9f41-436e-b7ba-7de84d39077a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:29.370425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-f5e8efe6-9f41-436e-b7ba-7de84d39077a None None] MFA Rules not processed for user `8358da535a104873ad9f5676989a9e21`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:29.371679 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f5e8efe6-9f41-436e-b7ba-7de84d39077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:29.450780 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 692/1405] 10.222.0.11 () {58 vars in 1039 bytes} [Wed May 4 21:39:29 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:29.460440 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9f5ed-10d1-4e6f-9396-e6ce6e5bdf12 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:29.475012 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9f5ed-10d1-4e6f-9396-e6ce6e5bdf12 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:29.480863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392eddc8-f6f0-4f31-bccc-fec79176b35a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8358da535a104873ad9f5676989a9e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:29.481528 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392eddc8-f6f0-4f31-bccc-fec79176b35a service swift] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:29.481813 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392eddc8-f6f0-4f31-bccc-fec79176b35a service swift] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:29.482093 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392eddc8-f6f0-4f31-bccc-fec79176b35a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:29.491351 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392eddc8-f6f0-4f31-bccc-fec79176b35a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:29.492944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392eddc8-f6f0-4f31-bccc-fec79176b35a service swift] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:29.501753 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 714/1406] 10.222.0.11 () {60 vars in 1384 bytes} [Wed May 4 21:39:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:39:31.620114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2d376-2df3-4ca5-aa87-3fdd477a6ef5 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:31.620679 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2d376-2df3-4ca5-aa87-3fdd477a6ef5 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:31.620679 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2d376-2df3-4ca5-aa87-3fdd477a6ef5 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:31.622040 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 693/1407] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:31.627315 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d592a-fafc-4134-944c-f0d878ed1b10 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:31.627728 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d592a-fafc-4134-944c-f0d878ed1b10 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:31.627878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d592a-fafc-4134-944c-f0d878ed1b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:31.646294 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-bb1d592a-fafc-4134-944c-f0d878ed1b10 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:31.647520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-bb1d592a-fafc-4134-944c-f0d878ed1b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:31.656143 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 715/1408] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:31.700033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2d376-2df3-4ca5-aa87-3fdd477a6ef5 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:31.719502 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2d376-2df3-4ca5-aa87-3fdd477a6ef5 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:31.724944 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48571688-354a-414d-9d96-c418e974ce6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:31.725593 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48571688-354a-414d-9d96-c418e974ce6c service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:31.725881 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48571688-354a-414d-9d96-c418e974ce6c service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:31.726161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48571688-354a-414d-9d96-c418e974ce6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:31.734474 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48571688-354a-414d-9d96-c418e974ce6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:31.736128 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48571688-354a-414d-9d96-c418e974ce6c service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:31.755398 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 694/1409] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:39:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:52.642905 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120920f-4075-4204-9836-2dd4e1d83ca4 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:52.643582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120920f-4075-4204-9836-2dd4e1d83ca4 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:52.643582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120920f-4075-4204-9836-2dd4e1d83ca4 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:52.644888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 716/1410] 10.222.0.11 () {54 vars in 918 bytes} [Wed May 4 21:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:52.652246 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695a369-9660-4cc0-8707-203f5a984bbc None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:52.652677 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695a369-9660-4cc0-8707-203f5a984bbc None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:52.652788 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695a369-9660-4cc0-8707-203f5a984bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:52.671769 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-7695a369-9660-4cc0-8707-203f5a984bbc None None] MFA Rules not processed for user `e203d7077af54930a640b2334a1d8fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:52.673272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-7695a369-9660-4cc0-8707-203f5a984bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:52.682975 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 695/1411] 10.222.0.11 () {58 vars in 1015 bytes} [Wed May 4 21:39:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:52.697785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c6b51-47e8-47f8-92bf-6e7669fca72f None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:52.698075 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c6b51-47e8-47f8-92bf-6e7669fca72f None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:52.698359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c6b51-47e8-47f8-92bf-6e7669fca72f None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:52.699778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 717/1412] 10.222.0.11 () {54 vars in 918 bytes} [Wed May 4 21:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:52.704347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec331583-f6ad-4221-9c0e-1bff79f74916 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:52.704632 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec331583-f6ad-4221-9c0e-1bff79f74916 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:52.704914 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec331583-f6ad-4221-9c0e-1bff79f74916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:52.722504 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-ec331583-f6ad-4221-9c0e-1bff79f74916 None None] MFA Rules not processed for user `f4f207481ccb4cfcbbcffd9df73d2985`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:52.723683 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ec331583-f6ad-4221-9c0e-1bff79f74916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:52.733112 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 696/1413] 10.222.0.11 () {58 vars in 1015 bytes} [Wed May 4 21:39:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:55.474509 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a81404-bb30-47f6-a142-51649973c8a8 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.475418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a81404-bb30-47f6-a142-51649973c8a8 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.475418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a81404-bb30-47f6-a142-51649973c8a8 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.477731 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 718/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:39:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:55.483272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0328f1-bcc6-4989-8c3a-b63759da5baa None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.483717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0328f1-bcc6-4989-8c3a-b63759da5baa None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.483825 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0328f1-bcc6-4989-8c3a-b63759da5baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.503588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-3b0328f1-bcc6-4989-8c3a-b63759da5baa None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:55.504779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-3b0328f1-bcc6-4989-8c3a-b63759da5baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:55.513093 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 697/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:55.559885 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a81404-bb30-47f6-a142-51649973c8a8 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.577310 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a81404-bb30-47f6-a142-51649973c8a8 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:55.584914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991330d-11e2-4579-b58e-6018ab1f1583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:55.585685 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991330d-11e2-4579-b58e-6018ab1f1583 service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.585892 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991330d-11e2-4579-b58e-6018ab1f1583 service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.586145 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991330d-11e2-4579-b58e-6018ab1f1583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.596201 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991330d-11e2-4579-b58e-6018ab1f1583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:55.597796 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991330d-11e2-4579-b58e-6018ab1f1583 service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:55.607758 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 719/1416] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:56.890693 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c39782-c874-4df5-8f62-e158bad04f78 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.891275 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c39782-c874-4df5-8f62-e158bad04f78 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.891275 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c39782-c874-4df5-8f62-e158bad04f78 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.892571 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 698/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:56.898712 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e39c42-e122-4ed2-8cd6-76549603ad27 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.899546 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e39c42-e122-4ed2-8cd6-76549603ad27 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.899731 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e39c42-e122-4ed2-8cd6-76549603ad27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.928790 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-c5e39c42-e122-4ed2-8cd6-76549603ad27 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:56.929990 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c5e39c42-e122-4ed2-8cd6-76549603ad27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:56.939535 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 720/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:57.111681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c39782-c874-4df5-8f62-e158bad04f78 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:57.133107 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c39782-c874-4df5-8f62-e158bad04f78 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:57.139799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b40c6-9038-434a-930d-03164b3ceb6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:57.140443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b40c6-9038-434a-930d-03164b3ceb6f service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:57.140777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b40c6-9038-434a-930d-03164b3ceb6f service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:57.140996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b40c6-9038-434a-930d-03164b3ceb6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:57.150107 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b40c6-9038-434a-930d-03164b3ceb6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:57.151754 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b40c6-9038-434a-930d-03164b3ceb6f service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:57.161523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 699/1419] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:58.414707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93ab54-334b-4ae1-b38d-4b0ff7b96357 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:58.415624 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93ab54-334b-4ae1-b38d-4b0ff7b96357 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:58.415624 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93ab54-334b-4ae1-b38d-4b0ff7b96357 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:58.417855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 721/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:39:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:58.423075 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc5a3b-b46b-44ea-a915-b5668f78c1bb None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:58.423519 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc5a3b-b46b-44ea-a915-b5668f78c1bb None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:58.423746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc5a3b-b46b-44ea-a915-b5668f78c1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:58.443903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-4bcc5a3b-b46b-44ea-a915-b5668f78c1bb None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:58.445109 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-4bcc5a3b-b46b-44ea-a915-b5668f78c1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:58.455583 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 700/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:58.605628 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93ab54-334b-4ae1-b38d-4b0ff7b96357 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:58.628119 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93ab54-334b-4ae1-b38d-4b0ff7b96357 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:58.633919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fb8c1-0266-4df6-8e10-5979722ef882 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:58.634565 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fb8c1-0266-4df6-8e10-5979722ef882 service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:58.634850 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fb8c1-0266-4df6-8e10-5979722ef882 service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:58.635153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fb8c1-0266-4df6-8e10-5979722ef882 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:58.644440 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fb8c1-0266-4df6-8e10-5979722ef882 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:58.646038 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fb8c1-0266-4df6-8e10-5979722ef882 service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:58.656282 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 722/1422] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:59.880873 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff8e4a-20f1-4b60-9b67-f573f1ae16d2 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:59.881508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff8e4a-20f1-4b60-9b67-f573f1ae16d2 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:59.881508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff8e4a-20f1-4b60-9b67-f573f1ae16d2 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:59.882796 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 701/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:59.888842 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec92535-3072-4764-b124-63cf672e15c3 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:59.889277 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec92535-3072-4764-b124-63cf672e15c3 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:59.889437 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec92535-3072-4764-b124-63cf672e15c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:59.909833 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-0ec92535-3072-4764-b124-63cf672e15c3 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:59.911027 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-0ec92535-3072-4764-b124-63cf672e15c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:59.921074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 723/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:00.073743 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff8e4a-20f1-4b60-9b67-f573f1ae16d2 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:00.089082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff8e4a-20f1-4b60-9b67-f573f1ae16d2 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:00.095296 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d2c0a-e737-4fae-8019-005c42ffb636 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:00.096016 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d2c0a-e737-4fae-8019-005c42ffb636 service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:00.096304 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d2c0a-e737-4fae-8019-005c42ffb636 service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:00.096587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d2c0a-e737-4fae-8019-005c42ffb636 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:00.104663 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d2c0a-e737-4fae-8019-005c42ffb636 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:00.106257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d2c0a-e737-4fae-8019-005c42ffb636 service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:00.116142 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 702/1425] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:40:01.360131 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170be227-a2ae-4a52-a589-224870dbccdf None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:01.360902 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170be227-a2ae-4a52-a589-224870dbccdf None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:01.360902 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170be227-a2ae-4a52-a589-224870dbccdf None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:01.362106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 724/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:40:01.368240 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc7823-bf62-4d39-bd69-696500b5550d None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:01.368993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc7823-bf62-4d39-bd69-696500b5550d None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:01.369122 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc7823-bf62-4d39-bd69-696500b5550d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:01.396217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-fadc7823-bf62-4d39-bd69-696500b5550d None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:01.397414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-fadc7823-bf62-4d39-bd69-696500b5550d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:01.406063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 703/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:01.557056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170be227-a2ae-4a52-a589-224870dbccdf None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:01.573038 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170be227-a2ae-4a52-a589-224870dbccdf None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:01.579609 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2522b-58fa-45cb-ba2b-acc1244cbe51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:01.580298 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2522b-58fa-45cb-ba2b-acc1244cbe51 service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:01.580643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2522b-58fa-45cb-ba2b-acc1244cbe51 service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:01.580921 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2522b-58fa-45cb-ba2b-acc1244cbe51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:01.589520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2522b-58fa-45cb-ba2b-acc1244cbe51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:01.591173 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2522b-58fa-45cb-ba2b-acc1244cbe51 service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:01.600756 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 725/1428] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:02.782675 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe5440-ae7e-413b-b7be-295b3ebc2b6a None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:02.783277 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe5440-ae7e-413b-b7be-295b3ebc2b6a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:02.783277 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe5440-ae7e-413b-b7be-295b3ebc2b6a None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:02.784681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 704/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:40:02.790853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088351c-97c7-4344-b0f9-8cba22344207 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:02.791625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088351c-97c7-4344-b0f9-8cba22344207 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:02.791794 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088351c-97c7-4344-b0f9-8cba22344207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:02.813330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-9088351c-97c7-4344-b0f9-8cba22344207 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:02.814520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-9088351c-97c7-4344-b0f9-8cba22344207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:02.823380 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 726/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:02.973014 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe5440-ae7e-413b-b7be-295b3ebc2b6a None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:02.989558 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe5440-ae7e-413b-b7be-295b3ebc2b6a None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:02.995769 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5305df8-48c0-48df-8622-f4298309ed2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:02.996403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5305df8-48c0-48df-8622-f4298309ed2a service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:02.996690 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5305df8-48c0-48df-8622-f4298309ed2a service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:02.996963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5305df8-48c0-48df-8622-f4298309ed2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:03.005170 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5305df8-48c0-48df-8622-f4298309ed2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:03.006748 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5305df8-48c0-48df-8622-f4298309ed2a service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:03.016005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 705/1431] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:04.194420 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626ace8-4acb-42b0-a888-4c8a71350819 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:04.195027 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626ace8-4acb-42b0-a888-4c8a71350819 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:04.195027 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626ace8-4acb-42b0-a888-4c8a71350819 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:04.196386 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 727/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:40:04.204552 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa8fd-fa63-41ff-ada8-f9292f5488ee None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:04.204973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa8fd-fa63-41ff-ada8-f9292f5488ee None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:04.205084 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa8fd-fa63-41ff-ada8-f9292f5488ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:04.232564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-cc4aa8fd-fa63-41ff-ada8-f9292f5488ee None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:04.234442 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-cc4aa8fd-fa63-41ff-ada8-f9292f5488ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:04.243020 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 706/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:04.393941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626ace8-4acb-42b0-a888-4c8a71350819 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:04.418320 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626ace8-4acb-42b0-a888-4c8a71350819 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:04.426354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5f86f-da97-4c46-9cb6-46e9ad16ab1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:04.426990 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5f86f-da97-4c46-9cb6-46e9ad16ab1d service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:04.427305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5f86f-da97-4c46-9cb6-46e9ad16ab1d service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:04.427576 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5f86f-da97-4c46-9cb6-46e9ad16ab1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:04.436384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5f86f-da97-4c46-9cb6-46e9ad16ab1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:04.437991 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5f86f-da97-4c46-9cb6-46e9ad16ab1d service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:04.447974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 728/1434] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:05.637547 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c36e7-452d-49ed-8965-f0487e4b5d9f None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:05.638144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c36e7-452d-49ed-8965-f0487e4b5d9f None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:05.638144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c36e7-452d-49ed-8965-f0487e4b5d9f None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:05.639514 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 707/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:40:05.645021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23075e-d4cd-4b50-9a02-4ba45a981460 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:05.645747 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23075e-d4cd-4b50-9a02-4ba45a981460 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:05.645907 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23075e-d4cd-4b50-9a02-4ba45a981460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:05.674593 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-4d23075e-d4cd-4b50-9a02-4ba45a981460 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:05.675824 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-4d23075e-d4cd-4b50-9a02-4ba45a981460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:05.685118 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 729/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:05.831480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c36e7-452d-49ed-8965-f0487e4b5d9f None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:05.855772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c36e7-452d-49ed-8965-f0487e4b5d9f None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:05.863794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c685dfd-2481-49fd-9303-c371ce45d620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:05.864445 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c685dfd-2481-49fd-9303-c371ce45d620 service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:05.864730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c685dfd-2481-49fd-9303-c371ce45d620 service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:05.865011 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c685dfd-2481-49fd-9303-c371ce45d620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:05.873654 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c685dfd-2481-49fd-9303-c371ce45d620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:05.875296 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c685dfd-2481-49fd-9303-c371ce45d620 service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:05.885145 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 708/1437] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:07.063971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b828192-3346-4627-94b3-d8d1b9b921f1 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:07.064577 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b828192-3346-4627-94b3-d8d1b9b921f1 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:07.064577 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b828192-3346-4627-94b3-d8d1b9b921f1 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:07.066761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 730/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:40:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:40:07.071892 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf0d73-9b83-4e6f-8c3c-6a934e70acb0 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:07.072339 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf0d73-9b83-4e6f-8c3c-6a934e70acb0 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:07.072436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf0d73-9b83-4e6f-8c3c-6a934e70acb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:07.091297 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-9daf0d73-9b83-4e6f-8c3c-6a934e70acb0 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:07.092508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-9daf0d73-9b83-4e6f-8c3c-6a934e70acb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:07.102293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 709/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:07.252997 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b828192-3346-4627-94b3-d8d1b9b921f1 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:07.269582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b828192-3346-4627-94b3-d8d1b9b921f1 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:07.275543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857734c-3f66-4949-94ef-64c01bbc9783 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:07.276186 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857734c-3f66-4949-94ef-64c01bbc9783 service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:07.276472 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857734c-3f66-4949-94ef-64c01bbc9783 service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:07.276748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857734c-3f66-4949-94ef-64c01bbc9783 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:07.285006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857734c-3f66-4949-94ef-64c01bbc9783 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:07.286584 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857734c-3f66-4949-94ef-64c01bbc9783 service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:07.298863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 731/1440] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:40:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:09.420917 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b31bb-ada2-457b-8e45-254615363ca4 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:09.420917 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b31bb-ada2-457b-8e45-254615363ca4 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:09.421352 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b31bb-ada2-457b-8e45-254615363ca4 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:09.422370 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 710/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:40:09.430384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5924e67-205f-4781-b2af-46c5123ad57d None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:09.430816 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5924e67-205f-4781-b2af-46c5123ad57d None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:09.430986 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5924e67-205f-4781-b2af-46c5123ad57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:09.457378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-a5924e67-205f-4781-b2af-46c5123ad57d None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:09.458582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a5924e67-205f-4781-b2af-46c5123ad57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:09.467790 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 732/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:09.506473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b31bb-ada2-457b-8e45-254615363ca4 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:09.518887 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b31bb-ada2-457b-8e45-254615363ca4 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:09.523480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48f737-7666-424a-aa0e-c622dd89352d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:09.524127 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48f737-7666-424a-aa0e-c622dd89352d service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:09.524409 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48f737-7666-424a-aa0e-c622dd89352d service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:09.524684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48f737-7666-424a-aa0e-c622dd89352d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:09.534604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48f737-7666-424a-aa0e-c622dd89352d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:09.536083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48f737-7666-424a-aa0e-c622dd89352d service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:09.545793 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 711/1443] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:40:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:11.941400 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3e763-2461-45f0-8aff-52aabad1231a None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:11.941981 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3e763-2461-45f0-8aff-52aabad1231a None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:11.941981 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3e763-2461-45f0-8aff-52aabad1231a None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:11.943474 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:40:11.950222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f03e5-ca82-495c-8489-07dbaa9d0185 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:11.950925 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f03e5-ca82-495c-8489-07dbaa9d0185 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:11.951085 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f03e5-ca82-495c-8489-07dbaa9d0185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:11.971159 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-482f03e5-ca82-495c-8489-07dbaa9d0185 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:11.972368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-482f03e5-ca82-495c-8489-07dbaa9d0185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:11.981475 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:12.022904 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3e763-2461-45f0-8aff-52aabad1231a None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:12.035667 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3e763-2461-45f0-8aff-52aabad1231a None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:12.040702 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b7e7c-1949-4eaf-bf75-c42c98daf391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:12.041350 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b7e7c-1949-4eaf-bf75-c42c98daf391 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:12.041734 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b7e7c-1949-4eaf-bf75-c42c98daf391 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:12.042111 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b7e7c-1949-4eaf-bf75-c42c98daf391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:12.053684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b7e7c-1949-4eaf-bf75-c42c98daf391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:12.055373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b7e7c-1949-4eaf-bf75-c42c98daf391 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:12.066796 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 734/1446] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:40:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:40:14.600205 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f4fb6-1210-4176-8759-a4704ffb3519 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:14.600755 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f4fb6-1210-4176-8759-a4704ffb3519 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:14.600755 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f4fb6-1210-4176-8759-a4704ffb3519 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:14.602100 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:40:14.607421 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07941a-ea10-4b06-856f-c4240b6af82c None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:14.607896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07941a-ea10-4b06-856f-c4240b6af82c None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:14.607998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07941a-ea10-4b06-856f-c4240b6af82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:14.628617 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-df07941a-ea10-4b06-856f-c4240b6af82c None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:14.629823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-df07941a-ea10-4b06-856f-c4240b6af82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:14.639209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:14.683304 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f4fb6-1210-4176-8759-a4704ffb3519 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:14.686697 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-1d8f4fb6-1210-4176-8759-a4704ffb3519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:14.708268 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f4fb6-1210-4176-8759-a4704ffb3519 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:14.713169 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b75f9-cc51-4a7f-b3e5-490664c4fded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:14.713871 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b75f9-cc51-4a7f-b3e5-490664c4fded service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:14.714310 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b75f9-cc51-4a7f-b3e5-490664c4fded service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:14.714738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b75f9-cc51-4a7f-b3e5-490664c4fded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:14.726200 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b75f9-cc51-4a7f-b3e5-490664c4fded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:14.727689 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b75f9-cc51-4a7f-b3e5-490664c4fded service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:14.737724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 714/1449] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:17.107298 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea90e04-86a8-4673-882e-3f7199594c53 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:17.107957 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea90e04-86a8-4673-882e-3f7199594c53 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:17.107957 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea90e04-86a8-4673-882e-3f7199594c53 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:17.109242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:40:17.116064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f95015-5ff7-40f7-95fe-fc9de4d6eee6 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:17.116788 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f95015-5ff7-40f7-95fe-fc9de4d6eee6 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:17.116961 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f95015-5ff7-40f7-95fe-fc9de4d6eee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:17.145003 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-68f95015-5ff7-40f7-95fe-fc9de4d6eee6 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:17.146242 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-68f95015-5ff7-40f7-95fe-fc9de4d6eee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:17.161769 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:17.200991 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea90e04-86a8-4673-882e-3f7199594c53 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:17.214089 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea90e04-86a8-4673-882e-3f7199594c53 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:17.218355 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda05fa2-7844-4ef5-a7b3-8072ec90921f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:17.219004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda05fa2-7844-4ef5-a7b3-8072ec90921f service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:17.219335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda05fa2-7844-4ef5-a7b3-8072ec90921f service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:17.220009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda05fa2-7844-4ef5-a7b3-8072ec90921f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:17.235865 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda05fa2-7844-4ef5-a7b3-8072ec90921f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:17.237294 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda05fa2-7844-4ef5-a7b3-8072ec90921f service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:17.247242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 737/1452] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:19.626090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ce662-159e-4c27-8f00-2c970b70be2c None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:19.626748 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ce662-159e-4c27-8f00-2c970b70be2c None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:19.626748 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ce662-159e-4c27-8f00-2c970b70be2c None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:19.627997 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:40:19.633442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710c8e0-12b8-47b6-8ef6-2fed6838a4b2 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:19.633937 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710c8e0-12b8-47b6-8ef6-2fed6838a4b2 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:19.634028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710c8e0-12b8-47b6-8ef6-2fed6838a4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:19.653704 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-8710c8e0-12b8-47b6-8ef6-2fed6838a4b2 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:19.654894 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-8710c8e0-12b8-47b6-8ef6-2fed6838a4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:19.663757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:19.705901 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ce662-159e-4c27-8f00-2c970b70be2c None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:19.723069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ce662-159e-4c27-8f00-2c970b70be2c None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:19.727520 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59313cb-b412-4f2f-9a96-c7341bf6b791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:19.728143 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59313cb-b412-4f2f-9a96-c7341bf6b791 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:19.728424 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59313cb-b412-4f2f-9a96-c7341bf6b791 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:19.728699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59313cb-b412-4f2f-9a96-c7341bf6b791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:19.737588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59313cb-b412-4f2f-9a96-c7341bf6b791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:19.739012 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59313cb-b412-4f2f-9a96-c7341bf6b791 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:19.748373 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 717/1455] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:22.081939 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9452d-1c5a-4f7a-a079-95ce0eb255a8 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:22.082846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9452d-1c5a-4f7a-a079-95ce0eb255a8 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:22.082846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9452d-1c5a-4f7a-a079-95ce0eb255a8 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:22.085158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:40:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:40:22.090563 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287060ff-d3e9-46c5-9f0e-900bfdcf9f7b None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:22.091012 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287060ff-d3e9-46c5-9f0e-900bfdcf9f7b None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:22.091150 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287060ff-d3e9-46c5-9f0e-900bfdcf9f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:22.110517 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-287060ff-d3e9-46c5-9f0e-900bfdcf9f7b None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:22.111722 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-287060ff-d3e9-46c5-9f0e-900bfdcf9f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:22.119936 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:22.157668 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9452d-1c5a-4f7a-a079-95ce0eb255a8 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:22.171402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9452d-1c5a-4f7a-a079-95ce0eb255a8 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:22.176542 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829183e5-f631-4e2c-a8be-ccca7635dbc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:22.177187 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829183e5-f631-4e2c-a8be-ccca7635dbc6 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:22.177470 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829183e5-f631-4e2c-a8be-ccca7635dbc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:22.177785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829183e5-f631-4e2c-a8be-ccca7635dbc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:22.187450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829183e5-f631-4e2c-a8be-ccca7635dbc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:22.188838 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829183e5-f631-4e2c-a8be-ccca7635dbc6 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:22.198133 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 740/1458] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:24.498054 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763309b-7371-4810-9993-829c6397575a None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:24.498665 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763309b-7371-4810-9993-829c6397575a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:24.498665 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763309b-7371-4810-9993-829c6397575a None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:24.500111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:40:24.505837 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849cb29-20f2-4c51-8a1e-65cb02d63440 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:24.506311 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849cb29-20f2-4c51-8a1e-65cb02d63440 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:24.506414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849cb29-20f2-4c51-8a1e-65cb02d63440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:24.527660 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-4849cb29-20f2-4c51-8a1e-65cb02d63440 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:24.528864 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-4849cb29-20f2-4c51-8a1e-65cb02d63440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:24.537864 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:24.575486 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763309b-7371-4810-9993-829c6397575a None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:24.587491 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763309b-7371-4810-9993-829c6397575a None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:24.591474 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4136aa-a783-440d-a5ce-600b4963699e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:24.592123 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4136aa-a783-440d-a5ce-600b4963699e service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:24.592417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4136aa-a783-440d-a5ce-600b4963699e service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:24.592698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4136aa-a783-440d-a5ce-600b4963699e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:24.602209 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4136aa-a783-440d-a5ce-600b4963699e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:24.603698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4136aa-a783-440d-a5ce-600b4963699e service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:24.612811 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 720/1461] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:26.904097 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b879d-ad74-4655-ac24-c47be2a3fdbd None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:26.904745 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b879d-ad74-4655-ac24-c47be2a3fdbd None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:26.904745 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b879d-ad74-4655-ac24-c47be2a3fdbd None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:26.905944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:40:26.912676 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23b321-57ad-4feb-bf97-6df715559cbc None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:26.913409 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23b321-57ad-4feb-bf97-6df715559cbc None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:26.913562 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23b321-57ad-4feb-bf97-6df715559cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:26.937026 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-7f23b321-57ad-4feb-bf97-6df715559cbc None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:26.938713 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-7f23b321-57ad-4feb-bf97-6df715559cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:26.947346 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:26.988709 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b879d-ad74-4655-ac24-c47be2a3fdbd None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:27.005167 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b879d-ad74-4655-ac24-c47be2a3fdbd None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:27.009437 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056c225-4381-4fe9-9612-1402e636fcfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:27.010153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056c225-4381-4fe9-9612-1402e636fcfe service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:27.010442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056c225-4381-4fe9-9612-1402e636fcfe service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:27.010725 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056c225-4381-4fe9-9612-1402e636fcfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:27.020840 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056c225-4381-4fe9-9612-1402e636fcfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:27.022291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056c225-4381-4fe9-9612-1402e636fcfe service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:27.032234 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 743/1464] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:40:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:29.310846 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95e724-86d9-4599-b256-53cbeed50c26 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:29.311778 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95e724-86d9-4599-b256-53cbeed50c26 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:29.311778 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95e724-86d9-4599-b256-53cbeed50c26 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:29.314037 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:40:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:40:29.319639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9fe9-10ae-460d-ba28-5a0125dab139 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:29.320042 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9fe9-10ae-460d-ba28-5a0125dab139 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:29.320220 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9fe9-10ae-460d-ba28-5a0125dab139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:29.347969 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-98dc9fe9-10ae-460d-ba28-5a0125dab139 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:29.349224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-98dc9fe9-10ae-460d-ba28-5a0125dab139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:29.358686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:29.397447 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95e724-86d9-4599-b256-53cbeed50c26 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:29.411340 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95e724-86d9-4599-b256-53cbeed50c26 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:29.416208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d86566-c6d9-472a-8d64-c5b69d2b4904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:29.416857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d86566-c6d9-472a-8d64-c5b69d2b4904 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:29.417140 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d86566-c6d9-472a-8d64-c5b69d2b4904 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:29.417416 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d86566-c6d9-472a-8d64-c5b69d2b4904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:29.427913 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d86566-c6d9-472a-8d64-c5b69d2b4904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:29.429330 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d86566-c6d9-472a-8d64-c5b69d2b4904 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:29.439156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 723/1467] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:40:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:31.706394 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e1775-11d6-44a5-bfdb-83b8e9973c81 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:31.706943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e1775-11d6-44a5-bfdb-83b8e9973c81 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:31.706943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e1775-11d6-44a5-bfdb-83b8e9973c81 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:31.708261 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:40:31.714687 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6f152-b09b-49f0-9181-78bdccb21249 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:31.715449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6f152-b09b-49f0-9181-78bdccb21249 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:31.715627 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6f152-b09b-49f0-9181-78bdccb21249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:31.736343 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-3fc6f152-b09b-49f0-9181-78bdccb21249 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:31.737533 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-3fc6f152-b09b-49f0-9181-78bdccb21249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:31.747019 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:31.783073 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e1775-11d6-44a5-bfdb-83b8e9973c81 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:31.795196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e1775-11d6-44a5-bfdb-83b8e9973c81 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:31.799331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d664d-5e75-4d9a-be7e-5a91144f61c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:31.799969 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d664d-5e75-4d9a-be7e-5a91144f61c9 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:31.800257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d664d-5e75-4d9a-be7e-5a91144f61c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:31.800534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d664d-5e75-4d9a-be7e-5a91144f61c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:31.809923 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d664d-5e75-4d9a-be7e-5a91144f61c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:31.811395 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d664d-5e75-4d9a-be7e-5a91144f61c9 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:31.820661 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 746/1470] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:41:05.183481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc9d7-eb51-4220-ab7e-71f334b52365 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:05.184495 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc9d7-eb51-4220-ab7e-71f334b52365 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:05.184495 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc9d7-eb51-4220-ab7e-71f334b52365 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:05.186526 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 725/1471] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:41:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:41:05.195755 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d36148-122b-427b-996a-f05422906815 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:05.196228 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d36148-122b-427b-996a-f05422906815 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:05.196337 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d36148-122b-427b-996a-f05422906815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:05.217563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-c1d36148-122b-427b-996a-f05422906815 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:05.218753 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c1d36148-122b-427b-996a-f05422906815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:05.228025 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 747/1472] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:05.281048 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1ba36-955a-4567-8f63-49478d1b4b59 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:05.281938 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1ba36-955a-4567-8f63-49478d1b4b59 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:05.281938 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1ba36-955a-4567-8f63-49478d1b4b59 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:05.283359 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 726/1473] 10.222.0.11 () {54 vars in 962 bytes} [Wed May 4 21:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:41:05.288440 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4af0bd-7afd-49f9-ab63-d9a4dc41b39a None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:05.288741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4af0bd-7afd-49f9-ab63-d9a4dc41b39a None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:05.289023 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4af0bd-7afd-49f9-ab63-d9a4dc41b39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:05.308555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-ac4af0bd-7afd-49f9-ab63-d9a4dc41b39a None None] MFA Rules not processed for user `c61205d7e96f496ab9f8ca84ab9408b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:05.309760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ac4af0bd-7afd-49f9-ab63-d9a4dc41b39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:05.318140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 748/1474] 10.222.0.11 () {58 vars in 1059 bytes} [Wed May 4 21:41:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:05.325664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1ba36-955a-4567-8f63-49478d1b4b59 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:05.339111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1ba36-955a-4567-8f63-49478d1b4b59 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:05.345048 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818c3ba-8877-4532-889d-acc2a16c643a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c61205d7e96f496ab9f8ca84ab9408b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:05.345999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818c3ba-8877-4532-889d-acc2a16c643a service glance] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:05.346281 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818c3ba-8877-4532-889d-acc2a16c643a service glance] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:05.346552 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818c3ba-8877-4532-889d-acc2a16c643a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:05.356577 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818c3ba-8877-4532-889d-acc2a16c643a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:05.358005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818c3ba-8877-4532-889d-acc2a16c643a service glance] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:05.367984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 727/1475] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:07.723347 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da42b5-8108-4e61-a8ce-45229d5fe5bc None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.723870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da42b5-8108-4e61-a8ce-45229d5fe5bc None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.723870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da42b5-8108-4e61-a8ce-45229d5fe5bc None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.725341 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 749/1476] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:41:07.731738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0824406-c7be-48f0-8d62-b669ede0d6b2 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.732194 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0824406-c7be-48f0-8d62-b669ede0d6b2 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.732301 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0824406-c7be-48f0-8d62-b669ede0d6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.751853 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-b0824406-c7be-48f0-8d62-b669ede0d6b2 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:07.753062 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b0824406-c7be-48f0-8d62-b669ede0d6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:07.761408 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 728/1477] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:07.785150 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da42b5-8108-4e61-a8ce-45229d5fe5bc None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:07.805048 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da42b5-8108-4e61-a8ce-45229d5fe5bc None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:07.810636 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04301aa0-2f2c-45bd-81d1-fd3b867d15d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:07.811337 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04301aa0-2f2c-45bd-81d1-fd3b867d15d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.811619 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04301aa0-2f2c-45bd-81d1-fd3b867d15d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.811896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04301aa0-2f2c-45bd-81d1-fd3b867d15d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.812798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04301aa0-2f2c-45bd-81d1-fd3b867d15d6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:07.814694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: WARNING py.warnings [None req-04301aa0-2f2c-45bd-81d1-fd3b867d15d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:41:07.814694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: warnings.warn(msg) May 04 21:41:07.814694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: May 04 21:41:07.815916 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04301aa0-2f2c-45bd-81d1-fd3b867d15d6 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:07.835301 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 750/1478] 10.222.0.11 () {56 vars in 1108 bytes} [Wed May 4 21:41:07 2022] GET /identity/v3/projects => generated 2553 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:10.068103 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c25c9-da92-4254-9882-faa60c27cdf7 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:10.068711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c25c9-da92-4254-9882-faa60c27cdf7 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:10.068711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c25c9-da92-4254-9882-faa60c27cdf7 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:10.069989 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 729/1479] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:41:10.077958 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe5d65-ee2e-4db0-84a7-c91de20f6188 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:10.078961 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe5d65-ee2e-4db0-84a7-c91de20f6188 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:10.078961 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe5d65-ee2e-4db0-84a7-c91de20f6188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:10.098071 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-5cfe5d65-ee2e-4db0-84a7-c91de20f6188 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:10.099301 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5cfe5d65-ee2e-4db0-84a7-c91de20f6188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:10.106965 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 751/1480] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:10.148204 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c25c9-da92-4254-9882-faa60c27cdf7 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:10.169240 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c25c9-da92-4254-9882-faa60c27cdf7 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:10.175860 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf8cdd-9ada-4166-96a0-391c651034c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:10.176500 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf8cdd-9ada-4166-96a0-391c651034c1 service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:10.176782 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf8cdd-9ada-4166-96a0-391c651034c1 service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:10.177058 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf8cdd-9ada-4166-96a0-391c651034c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:10.185235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf8cdd-9ada-4166-96a0-391c651034c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:10.186816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf8cdd-9ada-4166-96a0-391c651034c1 service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:10.196084 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 730/1481] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:12.621621 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e14cec-aa83-48e0-9f84-5d0b892f1cbd None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:12.622138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e14cec-aa83-48e0-9f84-5d0b892f1cbd None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:12.622138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e14cec-aa83-48e0-9f84-5d0b892f1cbd None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:12.623593 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 752/1482] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:41:12.628925 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a1aaf-41ae-42ff-bdd6-ab9c9f69211e None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:12.629387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a1aaf-41ae-42ff-bdd6-ab9c9f69211e None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:12.629483 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a1aaf-41ae-42ff-bdd6-ab9c9f69211e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:12.648306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-844a1aaf-41ae-42ff-bdd6-ab9c9f69211e None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:12.649500 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-844a1aaf-41ae-42ff-bdd6-ab9c9f69211e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:12.657994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 731/1483] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:12.697352 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e14cec-aa83-48e0-9f84-5d0b892f1cbd None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:12.711600 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e14cec-aa83-48e0-9f84-5d0b892f1cbd None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:12.715702 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ce1cd-0227-4fbd-be33-ea6d2dcdbbfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:12.716358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ce1cd-0227-4fbd-be33-ea6d2dcdbbfb service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:12.716642 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ce1cd-0227-4fbd-be33-ea6d2dcdbbfb service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:12.716922 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ce1cd-0227-4fbd-be33-ea6d2dcdbbfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:12.726558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ce1cd-0227-4fbd-be33-ea6d2dcdbbfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:12.728026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ce1cd-0227-4fbd-be33-ea6d2dcdbbfb service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:12.738057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 753/1484] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:41:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:15.010315 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def15eb8-f64a-4927-9a47-e41c645d2ff8 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:15.011332 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def15eb8-f64a-4927-9a47-e41c645d2ff8 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:15.011332 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def15eb8-f64a-4927-9a47-e41c645d2ff8 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:15.013634 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 732/1485] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:41:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:41:15.019186 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e91dd-e2b9-4eb2-a4b8-488dae376548 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:15.019636 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e91dd-e2b9-4eb2-a4b8-488dae376548 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:15.019737 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e91dd-e2b9-4eb2-a4b8-488dae376548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:15.038545 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-c01e91dd-e2b9-4eb2-a4b8-488dae376548 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:15.039773 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c01e91dd-e2b9-4eb2-a4b8-488dae376548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:15.048154 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 754/1486] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:15.088976 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def15eb8-f64a-4927-9a47-e41c645d2ff8 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:15.103884 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def15eb8-f64a-4927-9a47-e41c645d2ff8 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:15.108305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b00c71-8034-4a8f-921e-546a10f72932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:15.108949 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b00c71-8034-4a8f-921e-546a10f72932 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:15.109236 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b00c71-8034-4a8f-921e-546a10f72932 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:15.109565 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b00c71-8034-4a8f-921e-546a10f72932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:15.119234 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b00c71-8034-4a8f-921e-546a10f72932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:15.120676 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b00c71-8034-4a8f-921e-546a10f72932 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:15.130870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 733/1487] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:17.604129 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8145f-c9c7-441d-b13c-15125d03a3dc None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:17.604607 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8145f-c9c7-441d-b13c-15125d03a3dc None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:17.604709 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8145f-c9c7-441d-b13c-15125d03a3dc None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:17.606037 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 755/1488] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:41:17.611633 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b5ae0-3afd-49ab-bc6f-b96e2f19c584 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:17.612070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b5ae0-3afd-49ab-bc6f-b96e2f19c584 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:17.612213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b5ae0-3afd-49ab-bc6f-b96e2f19c584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:17.631669 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-5a7b5ae0-3afd-49ab-bc6f-b96e2f19c584 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:17.632855 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-5a7b5ae0-3afd-49ab-bc6f-b96e2f19c584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:17.641960 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 734/1489] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:17.690213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8145f-c9c7-441d-b13c-15125d03a3dc None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:17.707396 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8145f-c9c7-441d-b13c-15125d03a3dc None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:17.711550 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6e1cb-0486-45df-bf23-810528ad597b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:17.712128 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6e1cb-0486-45df-bf23-810528ad597b service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:17.712422 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6e1cb-0486-45df-bf23-810528ad597b service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:17.712693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6e1cb-0486-45df-bf23-810528ad597b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:17.722482 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6e1cb-0486-45df-bf23-810528ad597b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:17.723957 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6e1cb-0486-45df-bf23-810528ad597b service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:17.733301 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 756/1490] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:41:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:20.141680 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b60e0c-79c9-493d-9e1b-44f699e73bbd None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:20.142274 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b60e0c-79c9-493d-9e1b-44f699e73bbd None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:20.142274 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b60e0c-79c9-493d-9e1b-44f699e73bbd None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:20.143684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 735/1491] 10.222.0.11 () {54 vars in 926 bytes} [Wed May 4 21:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:41:20.149702 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e6f5c-6e12-4c9b-920b-48bdd06d92d2 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:20.150166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e6f5c-6e12-4c9b-920b-48bdd06d92d2 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:20.150273 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e6f5c-6e12-4c9b-920b-48bdd06d92d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:20.173137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-cd1e6f5c-6e12-4c9b-920b-48bdd06d92d2 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:20.174349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-cd1e6f5c-6e12-4c9b-920b-48bdd06d92d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:20.183555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 757/1492] 10.222.0.11 () {58 vars in 1023 bytes} [Wed May 4 21:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:20.227937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b60e0c-79c9-493d-9e1b-44f699e73bbd None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:20.242712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b60e0c-79c9-493d-9e1b-44f699e73bbd None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:20.247247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc83b12-2fa2-40ea-b2a2-df3d516c28c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:20.247886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc83b12-2fa2-40ea-b2a2-df3d516c28c9 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:20.248169 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc83b12-2fa2-40ea-b2a2-df3d516c28c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:20.248518 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc83b12-2fa2-40ea-b2a2-df3d516c28c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:20.257412 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc83b12-2fa2-40ea-b2a2-df3d516c28c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:20.258840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc83b12-2fa2-40ea-b2a2-df3d516c28c9 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:20.268094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 736/1493] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:41:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:42:48.477300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b75112-b37d-45ef-b0fc-9527f2d5f34e None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:48.477929 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b75112-b37d-45ef-b0fc-9527f2d5f34e None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:48.477929 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b75112-b37d-45ef-b0fc-9527f2d5f34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:48.502345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-25b75112-b37d-45ef-b0fc-9527f2d5f34e None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:48.503577 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-25b75112-b37d-45ef-b0fc-9527f2d5f34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:48.512805 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 758/1494] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:48.520707 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f508b-dd96-4ba0-a6c2-4c8e8b088e26 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:48.521221 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f508b-dd96-4ba0-a6c2-4c8e8b088e26 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:48.521221 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f508b-dd96-4ba0-a6c2-4c8e8b088e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:48.540532 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-408f508b-dd96-4ba0-a6c2-4c8e8b088e26 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:48.541708 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-408f508b-dd96-4ba0-a6c2-4c8e8b088e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:48.550411 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 737/1495] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:48.554919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b75112-b37d-45ef-b0fc-9527f2d5f34e None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:48.564978 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b75112-b37d-45ef-b0fc-9527f2d5f34e None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:48.570457 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfd247-118a-4854-a82e-fa428f6d1342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:48.571284 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfd247-118a-4854-a82e-fa428f6d1342 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:48.571576 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfd247-118a-4854-a82e-fa428f6d1342 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:48.571863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfd247-118a-4854-a82e-fa428f6d1342 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:48.572602 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfd247-118a-4854-a82e-fa428f6d1342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:42:48.572914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfd247-118a-4854-a82e-fa428f6d1342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:48.573926 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: WARNING py.warnings [None req-aabfd247-118a-4854-a82e-fa428f6d1342 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 21:42:48.573926 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: warnings.warn(msg) May 04 21:42:48.573926 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: May 04 21:42:48.574826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfd247-118a-4854-a82e-fa428f6d1342 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:48.588167 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 759/1496] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:42:48.597910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f508b-dd96-4ba0-a6c2-4c8e8b088e26 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:48.606965 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f508b-dd96-4ba0-a6c2-4c8e8b088e26 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:48.612550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501d95c-176b-4e8c-8da3-feb462ffb3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:48.613204 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501d95c-176b-4e8c-8da3-feb462ffb3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:48.613498 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501d95c-176b-4e8c-8da3-feb462ffb3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:48.613773 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501d95c-176b-4e8c-8da3-feb462ffb3e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:48.614474 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501d95c-176b-4e8c-8da3-feb462ffb3e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:48.616300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: WARNING py.warnings [None req-c501d95c-176b-4e8c-8da3-feb462ffb3e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:42:48.616300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: warnings.warn(msg) May 04 21:42:48.616300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: May 04 21:42:48.617521 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501d95c-176b-4e8c-8da3-feb462ffb3e7 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:48.655759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 738/1497] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:42:48 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:42:48.660027 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfd247-118a-4854-a82e-fa428f6d1342 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:48.670391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfd247-118a-4854-a82e-fa428f6d1342 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:48.724518 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980cd95-6ec0-4192-9973-df38170eeab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:48.725822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980cd95-6ec0-4192-9973-df38170eeab2 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:48.726112 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980cd95-6ec0-4192-9973-df38170eeab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:48.726394 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980cd95-6ec0-4192-9973-df38170eeab2 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:48.727118 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980cd95-6ec0-4192-9973-df38170eeab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:48.728179 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: WARNING py.warnings [None req-7980cd95-6ec0-4192-9973-df38170eeab2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:42:48.728179 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: warnings.warn(msg) May 04 21:42:48.728179 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: May 04 21:42:48.729332 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980cd95-6ec0-4192-9973-df38170eeab2 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:48.752888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 760/1498] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:42:48 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:42:48.757027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501d95c-176b-4e8c-8da3-feb462ffb3e7 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:48.767181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501d95c-176b-4e8c-8da3-feb462ffb3e7 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:48.771597 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572fc1b-9cf2-4263-bada-229ef992c32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:48.772255 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572fc1b-9cf2-4263-bada-229ef992c32a admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:48.772540 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572fc1b-9cf2-4263-bada-229ef992c32a admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:48.772820 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572fc1b-9cf2-4263-bada-229ef992c32a admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:48.773546 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572fc1b-9cf2-4263-bada-229ef992c32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:48.774564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: WARNING py.warnings [None req-a572fc1b-9cf2-4263-bada-229ef992c32a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 21:42:48.774564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: warnings.warn(msg) May 04 21:42:48.774564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: May 04 21:42:48.775487 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572fc1b-9cf2-4263-bada-229ef992c32a admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:48.788009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 739/1499] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:42:48.792157 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980cd95-6ec0-4192-9973-df38170eeab2 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:48.802688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980cd95-6ec0-4192-9973-df38170eeab2 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:48.807838 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6d7a5-1162-493f-8c2a-1240b22b113c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:48.808507 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6d7a5-1162-493f-8c2a-1240b22b113c admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:48.808792 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6d7a5-1162-493f-8c2a-1240b22b113c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:48.809071 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6d7a5-1162-493f-8c2a-1240b22b113c admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:48.809777 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6d7a5-1162-493f-8c2a-1240b22b113c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:48.811470 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: WARNING py.warnings [None req-5fd6d7a5-1162-493f-8c2a-1240b22b113c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 21:42:48.811470 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: warnings.warn(msg) May 04 21:42:48.811470 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: May 04 21:42:48.812376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6d7a5-1162-493f-8c2a-1240b22b113c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:48.826189 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 761/1500] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:42:48.831978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572fc1b-9cf2-4263-bada-229ef992c32a admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:48.842302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572fc1b-9cf2-4263-bada-229ef992c32a admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:48.849183 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2831b6-a787-41a5-9ad9-af5033f48d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:48.850076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2831b6-a787-41a5-9ad9-af5033f48d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:48.850384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2831b6-a787-41a5-9ad9-af5033f48d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:48.850659 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2831b6-a787-41a5-9ad9-af5033f48d99 admin admin] PATH_INFO: `/v3/projects/6222741632af4dada0fc8a63572d7b27/users/cb5f855e7fda43cd924048fc81af134f/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:48.867516 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2831b6-a787-41a5-9ad9-af5033f48d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6222741632af4dada0fc8a63572d7b27, user_id=cb5f855e7fda43cd924048fc81af134f, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:48.868551 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: WARNING py.warnings [None req-3a2831b6-a787-41a5-9ad9-af5033f48d99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:42:48.868551 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: warnings.warn(msg) May 04 21:42:48.868551 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: May 04 21:42:48.870474 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2831b6-a787-41a5-9ad9-af5033f48d99 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:48.887377 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 740/1501] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:42:48 2022] PUT /identity/v3/projects/6222741632af4dada0fc8a63572d7b27/users/cb5f855e7fda43cd924048fc81af134f/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:48.900496 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75cb4a-3ea3-45de-950e-c8e25c88a1af None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:48.900871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75cb4a-3ea3-45de-950e-c8e25c88a1af None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:48.901257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75cb4a-3ea3-45de-950e-c8e25c88a1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:48.935200 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-cd75cb4a-3ea3-45de-950e-c8e25c88a1af None None] MFA Rules not processed for user `cb5f855e7fda43cd924048fc81af134f`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:48.937130 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-cd75cb4a-3ea3-45de-950e-c8e25c88a1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:49.009035 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 762/1502] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:42:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:49.020360 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2831b6-a787-41a5-9ad9-af5033f48d99 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:49.094480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2831b6-a787-41a5-9ad9-af5033f48d99 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:49.101171 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047df0e-5de6-4d67-9247-890f2441fb37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:49.101815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047df0e-5de6-4d67-9247-890f2441fb37 service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:49.102105 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047df0e-5de6-4d67-9247-890f2441fb37 service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:49.102374 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047df0e-5de6-4d67-9247-890f2441fb37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:49.110673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047df0e-5de6-4d67-9247-890f2441fb37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:49.112304 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047df0e-5de6-4d67-9247-890f2441fb37 service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:49.121091 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 741/1503] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:42:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:42:49.198388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f6bb1-fd9c-4b07-9d01-7590644112cc None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:49.198691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f6bb1-fd9c-4b07-9d01-7590644112cc None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:49.198976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f6bb1-fd9c-4b07-9d01-7590644112cc None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:49.200317 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 763/1504] 10.222.0.11 () {52 vars in 829 bytes} [Wed May 4 21:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:42:49.204191 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047df0e-5de6-4d67-9247-890f2441fb37 service nova] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:49.274480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047df0e-5de6-4d67-9247-890f2441fb37 service nova] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:49.280100 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16610b1-a073-477a-b716-9ab8e3a54f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:49.280975 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16610b1-a073-477a-b716-9ab8e3a54f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:49.281251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16610b1-a073-477a-b716-9ab8e3a54f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:49.281522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16610b1-a073-477a-b716-9ab8e3a54f67 admin admin] PATH_INFO: `/v3/users/cb5f855e7fda43cd924048fc81af134f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:49.282804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16610b1-a073-477a-b716-9ab8e3a54f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb5f855e7fda43cd924048fc81af134f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:49.283869 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: WARNING py.warnings [None req-e16610b1-a073-477a-b716-9ab8e3a54f67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:42:49.283869 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: warnings.warn(msg) May 04 21:42:49.283869 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: May 04 21:42:49.285077 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16610b1-a073-477a-b716-9ab8e3a54f67 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:49.355923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e16610b1-a073-477a-b716-9ab8e3a54f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb5f855e7fda43cd924048fc81af134f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:49.369196 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e16610b1-a073-477a-b716-9ab8e3a54f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb5f855e7fda43cd924048fc81af134f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:49.381814 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e16610b1-a073-477a-b716-9ab8e3a54f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb5f855e7fda43cd924048fc81af134f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:49.382697 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e16610b1-a073-477a-b716-9ab8e3a54f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb5f855e7fda43cd924048fc81af134f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:49.383578 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e16610b1-a073-477a-b716-9ab8e3a54f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb5f855e7fda43cd924048fc81af134f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:49.408323 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 742/1505] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:42:49 2022] DELETE /identity/v3/users/cb5f855e7fda43cd924048fc81af134f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:49.412968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a0319-33ba-47d1-a59a-d4bedbbbd618 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:49.413308 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a0319-33ba-47d1-a59a-d4bedbbbd618 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:49.413596 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a0319-33ba-47d1-a59a-d4bedbbbd618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:49.434209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-4a8a0319-33ba-47d1-a59a-d4bedbbbd618 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:49.435441 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-4a8a0319-33ba-47d1-a59a-d4bedbbbd618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:49.496318 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 764/1506] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:49.507322 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16610b1-a073-477a-b716-9ab8e3a54f67 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:49.509048 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e16610b1-a073-477a-b716-9ab8e3a54f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:49.566771 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16610b1-a073-477a-b716-9ab8e3a54f67 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:49.570975 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f9e23-6333-4d6f-b322-fcf921779770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:49.571674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f9e23-6333-4d6f-b322-fcf921779770 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:49.571966 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f9e23-6333-4d6f-b322-fcf921779770 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:49.572257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f9e23-6333-4d6f-b322-fcf921779770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:49.582363 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f9e23-6333-4d6f-b322-fcf921779770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:49.583845 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f9e23-6333-4d6f-b322-fcf921779770 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:49.593902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 743/1507] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:42:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:42:49.922844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a0319-33ba-47d1-a59a-d4bedbbbd618 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:49.924353 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-4a8a0319-33ba-47d1-a59a-d4bedbbbd618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:49.936434 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a0319-33ba-47d1-a59a-d4bedbbbd618 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:49.942250 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f753d6e-f58c-4352-9b03-e606df8cdc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:49.943513 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f753d6e-f58c-4352-9b03-e606df8cdc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:49.943798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f753d6e-f58c-4352-9b03-e606df8cdc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:49.944333 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f753d6e-f58c-4352-9b03-e606df8cdc8f admin admin] PATH_INFO: `/v3/projects/6222741632af4dada0fc8a63572d7b27` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:49.945544 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f753d6e-f58c-4352-9b03-e606df8cdc8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6222741632af4dada0fc8a63572d7b27)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:49.947810 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: WARNING py.warnings [None req-1f753d6e-f58c-4352-9b03-e606df8cdc8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:42:49.947810 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: warnings.warn(msg) May 04 21:42:49.947810 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: May 04 21:42:49.949061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f753d6e-f58c-4352-9b03-e606df8cdc8f admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:50.010883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-1f753d6e-f58c-4352-9b03-e606df8cdc8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6222741632af4dada0fc8a63572d7b27', 'request_id': 'req-1f753d6e-f58c-4352-9b03-e606df8cdc8f'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:50.021798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-1f753d6e-f58c-4352-9b03-e606df8cdc8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6222741632af4dada0fc8a63572d7b27', 'request_id': 'req-1f753d6e-f58c-4352-9b03-e606df8cdc8f'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:50.035403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-1f753d6e-f58c-4352-9b03-e606df8cdc8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6222741632af4dada0fc8a63572d7b27', 'request_id': 'req-1f753d6e-f58c-4352-9b03-e606df8cdc8f'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:50.046428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-1f753d6e-f58c-4352-9b03-e606df8cdc8f admin admin] The token cache is being invalidate because project 6222741632af4dada0fc8a63572d7b27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:42:50.046711 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-1f753d6e-f58c-4352-9b03-e606df8cdc8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:50.047402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-1f753d6e-f58c-4352-9b03-e606df8cdc8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:50.049110 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 765/1508] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:42:49 2022] DELETE /identity/v3/projects/6222741632af4dada0fc8a63572d7b27 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:44:25.542256 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e35bd-7cd4-47bb-8777-b59d59ed3e2a None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:25.542871 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e35bd-7cd4-47bb-8777-b59d59ed3e2a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:25.542871 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e35bd-7cd4-47bb-8777-b59d59ed3e2a None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:25.544228 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 744/1509] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:44:25.550297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d20250-3aea-471d-a00a-0c577614c100 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:25.550759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d20250-3aea-471d-a00a-0c577614c100 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:25.550864 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d20250-3aea-471d-a00a-0c577614c100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:25.574156 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-29d20250-3aea-471d-a00a-0c577614c100 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:25.576042 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-29d20250-3aea-471d-a00a-0c577614c100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:25.647618 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 766/1510] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:44:25.799980 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e35bd-7cd4-47bb-8777-b59d59ed3e2a None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:25.802992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-927e35bd-7cd4-47bb-8777-b59d59ed3e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:25.888743 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e35bd-7cd4-47bb-8777-b59d59ed3e2a None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:25.895663 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9d445-6a58-4c6e-ad0b-b833fe28e036 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:25.896311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9d445-6a58-4c6e-ad0b-b833fe28e036 service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:25.896593 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9d445-6a58-4c6e-ad0b-b833fe28e036 service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:25.896864 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9d445-6a58-4c6e-ad0b-b833fe28e036 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:25.905728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9d445-6a58-4c6e-ad0b-b833fe28e036 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:25.907358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9d445-6a58-4c6e-ad0b-b833fe28e036 service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:25.917224 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 745/1511] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:44:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:44:26.046539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be30b65-1607-4a30-ad98-9ba2acfea37e None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:26.046794 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be30b65-1607-4a30-ad98-9ba2acfea37e None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:26.047106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be30b65-1607-4a30-ad98-9ba2acfea37e None None] PATH_INFO: `/v3` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:26.048794 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 767/1512] 10.222.0.48 () {54 vars in 925 bytes} [Wed May 4 21:44:26 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:44:26.058360 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363923fc-0f04-4e70-acae-a7cb04d3a0e7 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:26.058894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363923fc-0f04-4e70-acae-a7cb04d3a0e7 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:26.059379 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363923fc-0f04-4e70-acae-a7cb04d3a0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:26.080034 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-363923fc-0f04-4e70-acae-a7cb04d3a0e7 None None] MFA Rules not processed for user `e203d7077af54930a640b2334a1d8fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:26.081245 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-363923fc-0f04-4e70-acae-a7cb04d3a0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:26.146781 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 746/1513] 10.222.0.48 () {58 vars in 1015 bytes} [Wed May 4 21:44:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:44:27.142992 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daadd9c-e5be-4975-b6db-a628e6d3ae24 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:27.143588 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daadd9c-e5be-4975-b6db-a628e6d3ae24 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:27.143588 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daadd9c-e5be-4975-b6db-a628e6d3ae24 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:27.145013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 768/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:44:27.152611 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a12f70-538d-4357-91d6-ed3ea48ef4a8 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:27.153064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a12f70-538d-4357-91d6-ed3ea48ef4a8 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:27.153156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a12f70-538d-4357-91d6-ed3ea48ef4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:27.173801 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-89a12f70-538d-4357-91d6-ed3ea48ef4a8 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:27.175024 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-89a12f70-538d-4357-91d6-ed3ea48ef4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:27.184653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 747/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:44:27.346549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daadd9c-e5be-4975-b6db-a628e6d3ae24 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:27.362855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daadd9c-e5be-4975-b6db-a628e6d3ae24 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:27.369542 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61756cd-0e8b-41a8-8a0f-9f7957d68265 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:27.370191 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61756cd-0e8b-41a8-8a0f-9f7957d68265 service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:27.370472 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61756cd-0e8b-41a8-8a0f-9f7957d68265 service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:27.370749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61756cd-0e8b-41a8-8a0f-9f7957d68265 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:27.379490 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61756cd-0e8b-41a8-8a0f-9f7957d68265 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:27.381137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61756cd-0e8b-41a8-8a0f-9f7957d68265 service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:27.390634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 769/1516] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:44:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:44:30.042409 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eac0b-f3d5-45d9-965e-1e3cf5802a39 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:30.042980 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eac0b-f3d5-45d9-965e-1e3cf5802a39 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:30.043125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eac0b-f3d5-45d9-965e-1e3cf5802a39 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:30.044631 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 748/1517] 10.222.0.11 () {54 vars in 960 bytes} [Wed May 4 21:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:44:30.049823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a930c86-d66c-4ea2-9d84-79d409692097 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:30.050254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a930c86-d66c-4ea2-9d84-79d409692097 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:30.050386 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a930c86-d66c-4ea2-9d84-79d409692097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:30.069686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-1a930c86-d66c-4ea2-9d84-79d409692097 None None] MFA Rules not processed for user `e203d7077af54930a640b2334a1d8fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:30.070889 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-1a930c86-d66c-4ea2-9d84-79d409692097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:30.079678 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 770/1518] 10.222.0.11 () {58 vars in 1057 bytes} [Wed May 4 21:44:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:44:30.087444 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995eac0b-f3d5-45d9-965e-1e3cf5802a39 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:30.101742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995eac0b-f3d5-45d9-965e-1e3cf5802a39 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:30.106823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9c068-9604-40a0-86e8-e54e96a1e29e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e203d7077af54930a640b2334a1d8fa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:30.107488 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9c068-9604-40a0-86e8-e54e96a1e29e service placement] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:30.107775 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9c068-9604-40a0-86e8-e54e96a1e29e service placement] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:30.108047 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9c068-9604-40a0-86e8-e54e96a1e29e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:30.116841 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9c068-9604-40a0-86e8-e54e96a1e29e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:30.118507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9c068-9604-40a0-86e8-e54e96a1e29e service placement] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:30.128810 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 749/1519] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:44:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:44:39.051799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897cfcb-f51a-4260-a7e0-91bb6d57dd89 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:39.052375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897cfcb-f51a-4260-a7e0-91bb6d57dd89 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:39.052571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897cfcb-f51a-4260-a7e0-91bb6d57dd89 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:39.054436 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 771/1520] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:44:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:44:39.060003 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92816e-33b1-4ebd-b592-1a745fa475a1 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:39.060473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92816e-33b1-4ebd-b592-1a745fa475a1 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:39.060717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92816e-33b1-4ebd-b592-1a745fa475a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:39.082744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-cf92816e-33b1-4ebd-b592-1a745fa475a1 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:39.084004 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-cf92816e-33b1-4ebd-b592-1a745fa475a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:39.094928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 750/1521] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:44:39.247714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897cfcb-f51a-4260-a7e0-91bb6d57dd89 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:39.270110 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897cfcb-f51a-4260-a7e0-91bb6d57dd89 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:39.276520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bedb0a-9aee-4774-8104-260512d1ccd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:39.277431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bedb0a-9aee-4774-8104-260512d1ccd1 service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:39.277955 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bedb0a-9aee-4774-8104-260512d1ccd1 service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:39.278319 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bedb0a-9aee-4774-8104-260512d1ccd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:39.289191 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bedb0a-9aee-4774-8104-260512d1ccd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:39.290836 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bedb0a-9aee-4774-8104-260512d1ccd1 service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:39.304464 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 772/1522] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:44:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:44:40.515186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ed0a4-2095-4ac7-8599-cdf230d3604b None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:40.515805 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ed0a4-2095-4ac7-8599-cdf230d3604b None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:40.515805 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ed0a4-2095-4ac7-8599-cdf230d3604b None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:40.517424 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 751/1523] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:44:40.526254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299aa724-44e9-4fac-a397-820374f0a4b4 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:40.526788 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299aa724-44e9-4fac-a397-820374f0a4b4 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:40.526880 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299aa724-44e9-4fac-a397-820374f0a4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:40.551989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-299aa724-44e9-4fac-a397-820374f0a4b4 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:40.553237 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-299aa724-44e9-4fac-a397-820374f0a4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:40.562964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 773/1524] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:44:40.719660 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ed0a4-2095-4ac7-8599-cdf230d3604b None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:40.737856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ed0a4-2095-4ac7-8599-cdf230d3604b None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:40.743792 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3753c53-675b-4caf-a6ed-52ef332c931a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:40.744442 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3753c53-675b-4caf-a6ed-52ef332c931a service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:40.744729 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3753c53-675b-4caf-a6ed-52ef332c931a service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:40.745008 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3753c53-675b-4caf-a6ed-52ef332c931a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:40.753283 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3753c53-675b-4caf-a6ed-52ef332c931a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:40.754910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3753c53-675b-4caf-a6ed-52ef332c931a service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:40.764795 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 752/1525] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:44:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:44:45.912915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35eede-b285-4ed8-aa39-dfd6e564ed97 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:45.913454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35eede-b285-4ed8-aa39-dfd6e564ed97 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:45.913454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35eede-b285-4ed8-aa39-dfd6e564ed97 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:45.915522 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 774/1526] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:44:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:44:45.924307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca940f3-cbb8-4770-a3ab-3b19a0fc6ec4 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:45.924728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca940f3-cbb8-4770-a3ab-3b19a0fc6ec4 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:45.924954 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca940f3-cbb8-4770-a3ab-3b19a0fc6ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:45.948864 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-7ca940f3-cbb8-4770-a3ab-3b19a0fc6ec4 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:45.950071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-7ca940f3-cbb8-4770-a3ab-3b19a0fc6ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:45.961150 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 753/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:44:45.999395 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35eede-b285-4ed8-aa39-dfd6e564ed97 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:46.001172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-2d35eede-b285-4ed8-aa39-dfd6e564ed97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:46.061664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35eede-b285-4ed8-aa39-dfd6e564ed97 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:46.066364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7124d-90cb-4f31-9fdd-355bae1434be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:46.067071 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7124d-90cb-4f31-9fdd-355bae1434be service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:46.067378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7124d-90cb-4f31-9fdd-355bae1434be service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:46.067661 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7124d-90cb-4f31-9fdd-355bae1434be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:46.077209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7124d-90cb-4f31-9fdd-355bae1434be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:46.078694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7124d-90cb-4f31-9fdd-355bae1434be service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:46.088423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 775/1528] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:44:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:44:48.570668 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda487a-cbe2-4e14-95ea-b77cbbb8c36e None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:48.571622 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda487a-cbe2-4e14-95ea-b77cbbb8c36e None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:48.571718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda487a-cbe2-4e14-95ea-b77cbbb8c36e None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:48.573873 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 754/1529] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:44:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:44:48.581594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdc3dd-d406-48eb-9f94-3e0763031741 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:48.582094 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdc3dd-d406-48eb-9f94-3e0763031741 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:48.582094 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdc3dd-d406-48eb-9f94-3e0763031741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:48.604403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-a1fdc3dd-d406-48eb-9f94-3e0763031741 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:48.607195 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a1fdc3dd-d406-48eb-9f94-3e0763031741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:48.615577 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 776/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:44:48.654383 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda487a-cbe2-4e14-95ea-b77cbbb8c36e None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:48.656311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-6eda487a-cbe2-4e14-95ea-b77cbbb8c36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:48.671084 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda487a-cbe2-4e14-95ea-b77cbbb8c36e None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:48.674951 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4110b-bf1d-4191-802b-af14b23c8a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:48.675746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4110b-bf1d-4191-802b-af14b23c8a45 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:48.676062 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4110b-bf1d-4191-802b-af14b23c8a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:48.676315 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4110b-bf1d-4191-802b-af14b23c8a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:48.686026 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4110b-bf1d-4191-802b-af14b23c8a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:48.687489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4110b-bf1d-4191-802b-af14b23c8a45 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:48.696978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 755/1531] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:44:52.479966 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc231067-e6c0-4f95-a261-3b89c75c98bd None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:52.480538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc231067-e6c0-4f95-a261-3b89c75c98bd None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:52.480538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc231067-e6c0-4f95-a261-3b89c75c98bd None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:52.481904 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 777/1532] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:44:52.488677 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828e8d4-2719-46c5-b0b3-64cc1a8e446d None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:52.489426 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828e8d4-2719-46c5-b0b3-64cc1a8e446d None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:52.489613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828e8d4-2719-46c5-b0b3-64cc1a8e446d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:52.514350 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-4828e8d4-2719-46c5-b0b3-64cc1a8e446d None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:52.515538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-4828e8d4-2719-46c5-b0b3-64cc1a8e446d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:52.524905 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 756/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:44:52.800659 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc231067-e6c0-4f95-a261-3b89c75c98bd None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:52.802699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-bc231067-e6c0-4f95-a261-3b89c75c98bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:52.874052 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc231067-e6c0-4f95-a261-3b89c75c98bd None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:52.878373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8167372-082d-4721-a272-40b99946a3a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:52.879026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8167372-082d-4721-a272-40b99946a3a6 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:52.879341 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8167372-082d-4721-a272-40b99946a3a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:52.879614 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8167372-082d-4721-a272-40b99946a3a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:52.888866 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8167372-082d-4721-a272-40b99946a3a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:52.890293 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8167372-082d-4721-a272-40b99946a3a6 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:52.899599 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 778/1534] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:44:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:44:55.197131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ae0d3-f713-47cc-8276-77c413e6a312 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.197765 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ae0d3-f713-47cc-8276-77c413e6a312 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.197765 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ae0d3-f713-47cc-8276-77c413e6a312 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.199056 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 757/1535] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:44:55.205380 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540b3de-3a0f-471d-888b-0f10600c4da6 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.206115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540b3de-3a0f-471d-888b-0f10600c4da6 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.206636 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540b3de-3a0f-471d-888b-0f10600c4da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.228590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-a540b3de-3a0f-471d-888b-0f10600c4da6 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:55.229781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a540b3de-3a0f-471d-888b-0f10600c4da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:55.239734 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 779/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:44:55.504729 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80525240-3556-4646-bf19-5b98144e5beb None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.505019 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80525240-3556-4646-bf19-5b98144e5beb None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.505294 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80525240-3556-4646-bf19-5b98144e5beb None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.506664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 758/1537] 10.222.0.11 () {54 vars in 963 bytes} [Wed May 4 21:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:44:55.511746 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4a6fa-2b9a-45d9-8de7-2d828a4926a2 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.517320 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4a6fa-2b9a-45d9-8de7-2d828a4926a2 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.517609 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4a6fa-2b9a-45d9-8de7-2d828a4926a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.538577 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-86c4a6fa-2b9a-45d9-8de7-2d828a4926a2 None None] MFA Rules not processed for user `b9a86016cde040e7b8a9eeaf34cf0715`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:55.539799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-86c4a6fa-2b9a-45d9-8de7-2d828a4926a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:55.547541 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 780/1538] 10.222.0.11 () {58 vars in 1060 bytes} [Wed May 4 21:44:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:44:55.555342 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80525240-3556-4646-bf19-5b98144e5beb None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:55.566919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80525240-3556-4646-bf19-5b98144e5beb None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:55.570789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae95343-42e9-4c12-b560-8289b993995d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:55.571465 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae95343-42e9-4c12-b560-8289b993995d service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.571744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae95343-42e9-4c12-b560-8289b993995d service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.572016 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae95343-42e9-4c12-b560-8289b993995d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.581505 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae95343-42e9-4c12-b560-8289b993995d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:55.582946 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae95343-42e9-4c12-b560-8289b993995d service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:55.592694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 759/1539] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:44:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:24.108592 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23952b-1210-4f58-b512-a580489698c3 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.109277 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23952b-1210-4f58-b512-a580489698c3 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.109277 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23952b-1210-4f58-b512-a580489698c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.138472 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-3e23952b-1210-4f58-b512-a580489698c3 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:24.144032 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-3e23952b-1210-4f58-b512-a580489698c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:24.153471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 781/1540] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:24.165292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bc52b-de71-4a06-9d8b-9d825da11fd8 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.165894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bc52b-de71-4a06-9d8b-9d825da11fd8 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.165894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bc52b-de71-4a06-9d8b-9d825da11fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.191250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-ef4bc52b-de71-4a06-9d8b-9d825da11fd8 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:24.192483 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ef4bc52b-de71-4a06-9d8b-9d825da11fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:24.209153 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 760/1541] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:46:24.209830 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce9a14-ae08-40ed-9243-112ada4f5b7a None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.210075 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce9a14-ae08-40ed-9243-112ada4f5b7a None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.210366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce9a14-ae08-40ed-9243-112ada4f5b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.216666 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bc52b-de71-4a06-9d8b-9d825da11fd8 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:24.226520 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bc52b-de71-4a06-9d8b-9d825da11fd8 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:24.239510 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-57ce9a14-ae08-40ed-9243-112ada4f5b7a None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:24.240906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-57ce9a14-ae08-40ed-9243-112ada4f5b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:24.244991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4bc8f-6f3f-43ec-8c80-2986cd2b44ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:24.245689 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4bc8f-6f3f-43ec-8c80-2986cd2b44ec admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.245978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4bc8f-6f3f-43ec-8c80-2986cd2b44ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.246251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4bc8f-6f3f-43ec-8c80-2986cd2b44ec admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.246991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4bc8f-6f3f-43ec-8c80-2986cd2b44ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:46:24.247328 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4bc8f-6f3f-43ec-8c80-2986cd2b44ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:24.248390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: WARNING py.warnings [None req-b2e4bc8f-6f3f-43ec-8c80-2986cd2b44ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 21:46:24.248390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: warnings.warn(msg) May 04 21:46:24.248390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: May 04 21:46:24.249313 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4bc8f-6f3f-43ec-8c80-2986cd2b44ec admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:24.255742 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 782/1542] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:24.265830 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d4884-ba67-49c8-b19d-196650ba658c None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.266177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d4884-ba67-49c8-b19d-196650ba658c None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.266419 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d4884-ba67-49c8-b19d-196650ba658c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.268519 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 761/1543] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:46:24.288653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4bc8f-6f3f-43ec-8c80-2986cd2b44ec admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:24.303983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4bc8f-6f3f-43ec-8c80-2986cd2b44ec admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:24.304753 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-a25d4884-ba67-49c8-b19d-196650ba658c None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:24.306051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a25d4884-ba67-49c8-b19d-196650ba658c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:24.317312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfc1e4-ed45-4393-ab3c-3b500db4261e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:24.318010 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfc1e4-ed45-4393-ab3c-3b500db4261e admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.318297 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfc1e4-ed45-4393-ab3c-3b500db4261e admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.318580 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfc1e4-ed45-4393-ab3c-3b500db4261e admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.319346 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfc1e4-ed45-4393-ab3c-3b500db4261e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:24.321500 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 783/1544] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:24.321668 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfc1e4-ed45-4393-ab3c-3b500db4261e admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:24.326112 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d4884-ba67-49c8-b19d-196650ba658c None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:24.336050 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d4884-ba67-49c8-b19d-196650ba658c None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:24.347896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72146890-512b-4067-a470-e75e4bffe328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:24.348659 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72146890-512b-4067-a470-e75e4bffe328 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.348954 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72146890-512b-4067-a470-e75e4bffe328 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.349236 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72146890-512b-4067-a470-e75e4bffe328 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.350015 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72146890-512b-4067-a470-e75e4bffe328 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:46:24.350335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72146890-512b-4067-a470-e75e4bffe328 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:24.352146 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72146890-512b-4067-a470-e75e4bffe328 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:24.376821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 784/1545] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:46:24.386569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72146890-512b-4067-a470-e75e4bffe328 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:24.394689 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 762/1546] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:24 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:46:24.398593 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfc1e4-ed45-4393-ab3c-3b500db4261e admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:24.404173 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72146890-512b-4067-a470-e75e4bffe328 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:24.494079 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfc1e4-ed45-4393-ab3c-3b500db4261e admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:24.507929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd273fe-6847-4237-9417-02355aae037d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:24.508760 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd273fe-6847-4237-9417-02355aae037d admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.509053 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd273fe-6847-4237-9417-02355aae037d admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.509333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd273fe-6847-4237-9417-02355aae037d admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.510251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd273fe-6847-4237-9417-02355aae037d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:24.511822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: WARNING py.warnings [None req-3cd273fe-6847-4237-9417-02355aae037d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:46:24.511822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: warnings.warn(msg) May 04 21:46:24.511822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: May 04 21:46:24.513073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd273fe-6847-4237-9417-02355aae037d admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:24.543538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52238fb6-114c-492d-9697-b5dfc0b72e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:24.544458 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52238fb6-114c-492d-9697-b5dfc0b72e50 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.544749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52238fb6-114c-492d-9697-b5dfc0b72e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.545029 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52238fb6-114c-492d-9697-b5dfc0b72e50 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.545775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52238fb6-114c-492d-9697-b5dfc0b72e50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:24.546852 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: WARNING py.warnings [None req-52238fb6-114c-492d-9697-b5dfc0b72e50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:46:24.546852 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: warnings.warn(msg) May 04 21:46:24.546852 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: May 04 21:46:24.549802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 763/1547] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:24 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:46:24.551449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4acfc-86b7-4210-ae56-60885906990a None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.551935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4acfc-86b7-4210-ae56-60885906990a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.552258 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4acfc-86b7-4210-ae56-60885906990a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.554538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52238fb6-114c-492d-9697-b5dfc0b72e50 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:24.594074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-e5a4acfc-86b7-4210-ae56-60885906990a None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:24.595683 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e5a4acfc-86b7-4210-ae56-60885906990a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:24.612279 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 764/1548] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:24.613128 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4acfc-86b7-4210-ae56-60885906990a None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:24.613794 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 785/1549] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:24 2022] POST /identity/v3/projects => generated 375 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:46:24.618175 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7791cd-ec73-430b-ad07-3a9e53e0b9c5 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.618314 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7791cd-ec73-430b-ad07-3a9e53e0b9c5 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.618575 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7791cd-ec73-430b-ad07-3a9e53e0b9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.638178 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4acfc-86b7-4210-ae56-60885906990a None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:24.650091 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-fa7791cd-ec73-430b-ad07-3a9e53e0b9c5 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:24.651341 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-fa7791cd-ec73-430b-ad07-3a9e53e0b9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:24.709873 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35685ed2-cdb1-47ae-9898-c2298fbf0902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:24.710585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35685ed2-cdb1-47ae-9898-c2298fbf0902 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.710868 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35685ed2-cdb1-47ae-9898-c2298fbf0902 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.711176 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35685ed2-cdb1-47ae-9898-c2298fbf0902 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.711996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35685ed2-cdb1-47ae-9898-c2298fbf0902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:24.713654 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35685ed2-cdb1-47ae-9898-c2298fbf0902 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:24.720246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 786/1550] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:24.721891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef780c-d412-423c-bd2a-9c4f10fe390f None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.722369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef780c-d412-423c-bd2a-9c4f10fe390f None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.722645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef780c-d412-423c-bd2a-9c4f10fe390f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.724283 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 765/1551] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:24.727073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35685ed2-cdb1-47ae-9898-c2298fbf0902 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:24.736027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35685ed2-cdb1-47ae-9898-c2298fbf0902 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:24.740664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100188ee-5b87-41c8-9849-7d410fd5c02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:24.741326 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100188ee-5b87-41c8-9849-7d410fd5c02f admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.741610 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100188ee-5b87-41c8-9849-7d410fd5c02f admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.741885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100188ee-5b87-41c8-9849-7d410fd5c02f admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.742568 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100188ee-5b87-41c8-9849-7d410fd5c02f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:24.743540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-15ef780c-d412-423c-bd2a-9c4f10fe390f None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:24.744718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100188ee-5b87-41c8-9849-7d410fd5c02f admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:24.744831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-15ef780c-d412-423c-bd2a-9c4f10fe390f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:24.752349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 787/1552] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:24.753653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b81163-691f-40df-9354-86ca2d5d8276 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.753939 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b81163-691f-40df-9354-86ca2d5d8276 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.754213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b81163-691f-40df-9354-86ca2d5d8276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.773534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-e9b81163-691f-40df-9354-86ca2d5d8276 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:24.773869 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 766/1553] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:24 2022] POST /identity/v3/users => generated 288 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:24.774887 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-e9b81163-691f-40df-9354-86ca2d5d8276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:24.775279 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661cdff-6b50-40c5-8c2d-c29b7f7d8e0f None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.775569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661cdff-6b50-40c5-8c2d-c29b7f7d8e0f None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.775850 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661cdff-6b50-40c5-8c2d-c29b7f7d8e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.782751 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 788/1554] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:24.784043 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7c325-fe54-438f-9da4-525484904574 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.784325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7c325-fe54-438f-9da4-525484904574 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.784602 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7c325-fe54-438f-9da4-525484904574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.794473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-9661cdff-6b50-40c5-8c2d-c29b7f7d8e0f None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:24.795697 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-9661cdff-6b50-40c5-8c2d-c29b7f7d8e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:24.802455 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-15a7c325-fe54-438f-9da4-525484904574 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:24.803439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 767/1555] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:24.803631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-15a7c325-fe54-438f-9da4-525484904574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:24.804659 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda5223-f556-4a7e-abd5-69f644e1d10d None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.804945 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda5223-f556-4a7e-abd5-69f644e1d10d None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.805221 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda5223-f556-4a7e-abd5-69f644e1d10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.816444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 789/1556] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:24.817266 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7c325-fe54-438f-9da4-525484904574 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:24.826847 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7c325-fe54-438f-9da4-525484904574 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:24.828492 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-8bda5223-f556-4a7e-abd5-69f644e1d10d None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:24.829857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-8bda5223-f556-4a7e-abd5-69f644e1d10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:24.831502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3c32d-69ad-42aa-8920-c38ce038d038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:24.832176 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3c32d-69ad-42aa-8920-c38ce038d038 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.832463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3c32d-69ad-42aa-8920-c38ce038d038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.832738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3c32d-69ad-42aa-8920-c38ce038d038 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.833470 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3c32d-69ad-42aa-8920-c38ce038d038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:24.835109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3c32d-69ad-42aa-8920-c38ce038d038 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:24.837976 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 768/1557] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:24.839234 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e17323-8f73-4c43-88fa-cda0fe75c594 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.839526 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e17323-8f73-4c43-88fa-cda0fe75c594 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.839801 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e17323-8f73-4c43-88fa-cda0fe75c594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.848679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 790/1558] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:24.848679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad8dde-a589-4fda-990c-21ea717db748 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.848679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad8dde-a589-4fda-990c-21ea717db748 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.848679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad8dde-a589-4fda-990c-21ea717db748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.860425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-b9e17323-8f73-4c43-88fa-cda0fe75c594 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:24.861652 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b9e17323-8f73-4c43-88fa-cda0fe75c594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:24.865563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-05ad8dde-a589-4fda-990c-21ea717db748 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:24.866714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-05ad8dde-a589-4fda-990c-21ea717db748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:24.869443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 769/1559] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:24.870221 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e17323-8f73-4c43-88fa-cda0fe75c594 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:24.874510 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 791/1560] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:24.875322 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad8dde-a589-4fda-990c-21ea717db748 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:24.880434 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e17323-8f73-4c43-88fa-cda0fe75c594 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:24.884424 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad8dde-a589-4fda-990c-21ea717db748 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:24.885476 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aef789-2e5c-4132-87af-5d6bcec3f3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:24.886144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aef789-2e5c-4132-87af-5d6bcec3f3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.886420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aef789-2e5c-4132-87af-5d6bcec3f3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.886696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aef789-2e5c-4132-87af-5d6bcec3f3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.887461 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aef789-2e5c-4132-87af-5d6bcec3f3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:24.888986 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07d3fa-c907-4520-bc03-864939de1b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:24.889114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aef789-2e5c-4132-87af-5d6bcec3f3e4 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:24.889576 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07d3fa-c907-4520-bc03-864939de1b44 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.889874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07d3fa-c907-4520-bc03-864939de1b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.890139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07d3fa-c907-4520-bc03-864939de1b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.890860 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07d3fa-c907-4520-bc03-864939de1b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:46:24.891203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07d3fa-c907-4520-bc03-864939de1b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:24.892787 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07d3fa-c907-4520-bc03-864939de1b44 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:24.899295 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 770/1561] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:24.900600 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e1c8f-0b36-4090-a6b3-adda43bb5fe5 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.900886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e1c8f-0b36-4090-a6b3-adda43bb5fe5 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.901168 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e1c8f-0b36-4090-a6b3-adda43bb5fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.907854 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 792/1562] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:46:24.909192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1245a8-22ab-43f3-8737-a5acad30c500 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.909481 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1245a8-22ab-43f3-8737-a5acad30c500 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.909767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1245a8-22ab-43f3-8737-a5acad30c500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.920037 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-020e1c8f-0b36-4090-a6b3-adda43bb5fe5 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:24.921219 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-020e1c8f-0b36-4090-a6b3-adda43bb5fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:24.927913 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-9e1245a8-22ab-43f3-8737-a5acad30c500 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:24.929081 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-9e1245a8-22ab-43f3-8737-a5acad30c500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:24.929220 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 771/1563] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:24.930962 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b78da-e0ba-482a-9416-873534fb3ec3 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.931259 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b78da-e0ba-482a-9416-873534fb3ec3 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.931343 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b78da-e0ba-482a-9416-873534fb3ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.938960 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 793/1564] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:24.939825 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1245a8-22ab-43f3-8737-a5acad30c500 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:24.949350 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1245a8-22ab-43f3-8737-a5acad30c500 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:24.951227 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-610b78da-e0ba-482a-9416-873534fb3ec3 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:24.952419 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-610b78da-e0ba-482a-9416-873534fb3ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:24.953933 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6893394-ec83-4c41-b1b3-d61b6f392291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:24.954801 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6893394-ec83-4c41-b1b3-d61b6f392291 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.955179 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6893394-ec83-4c41-b1b3-d61b6f392291 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.955456 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6893394-ec83-4c41-b1b3-d61b6f392291 admin admin] PATH_INFO: `/v3/projects/0fcecc72d42e4bc58aff85d4fc332215/users/1177da2d74a5427492e15695896e725c/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.961275 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 772/1565] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:24.962337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b78da-e0ba-482a-9416-873534fb3ec3 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:24.969900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6893394-ec83-4c41-b1b3-d61b6f392291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fcecc72d42e4bc58aff85d4fc332215, user_id=1177da2d74a5427492e15695896e725c, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:24.970940 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: WARNING py.warnings [None req-e6893394-ec83-4c41-b1b3-d61b6f392291 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:46:24.970940 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: warnings.warn(msg) May 04 21:46:24.970940 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: May 04 21:46:24.972170 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b78da-e0ba-482a-9416-873534fb3ec3 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:24.972980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6893394-ec83-4c41-b1b3-d61b6f392291 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:24.977133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae8a2b-a2b3-408b-85f0-325b532f81a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:24.978197 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae8a2b-a2b3-408b-85f0-325b532f81a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:24.978513 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae8a2b-a2b3-408b-85f0-325b532f81a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:24.978827 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae8a2b-a2b3-408b-85f0-325b532f81a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:24.979876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae8a2b-a2b3-408b-85f0-325b532f81a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:46:24.980185 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae8a2b-a2b3-408b-85f0-325b532f81a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:24.981798 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae8a2b-a2b3-408b-85f0-325b532f81a8 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:24.986783 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 794/1566] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:24 2022] PUT /identity/v3/projects/0fcecc72d42e4bc58aff85d4fc332215/users/1177da2d74a5427492e15695896e725c/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:24.987625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6893394-ec83-4c41-b1b3-d61b6f392291 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:24.997565 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 773/1567] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:46:24.998387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae8a2b-a2b3-408b-85f0-325b532f81a8 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.008013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae8a2b-a2b3-408b-85f0-325b532f81a8 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.047433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6893394-ec83-4c41-b1b3-d61b6f392291 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.052310 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c936fd8-c66d-46af-9565-8ba0520055ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.052979 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c936fd8-c66d-46af-9565-8ba0520055ed admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.053287 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c936fd8-c66d-46af-9565-8ba0520055ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.053562 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c936fd8-c66d-46af-9565-8ba0520055ed admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.054335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c936fd8-c66d-46af-9565-8ba0520055ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:46:25.054648 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c936fd8-c66d-46af-9565-8ba0520055ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.056403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c936fd8-c66d-46af-9565-8ba0520055ed admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.067091 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7631db2-6641-4735-83ba-f3beb4d7a6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.067781 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7631db2-6641-4735-83ba-f3beb4d7a6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.068063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7631db2-6641-4735-83ba-f3beb4d7a6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.068334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7631db2-6641-4735-83ba-f3beb4d7a6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.069055 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7631db2-6641-4735-83ba-f3beb4d7a6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.077003 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 795/1568] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:46:25.077201 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7631db2-6641-4735-83ba-f3beb4d7a6b5 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.077295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c936fd8-c66d-46af-9565-8ba0520055ed admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.081401 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 774/1569] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:25.081973 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c936fd8-c66d-46af-9565-8ba0520055ed admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.082240 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7631db2-6641-4735-83ba-f3beb4d7a6b5 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.086548 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9cf13-35f7-4eda-8a22-4c86644167e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.087305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9cf13-35f7-4eda-8a22-4c86644167e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.087598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9cf13-35f7-4eda-8a22-4c86644167e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.087846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9cf13-35f7-4eda-8a22-4c86644167e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.088547 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9cf13-35f7-4eda-8a22-4c86644167e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.090468 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9cf13-35f7-4eda-8a22-4c86644167e0 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.091741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7631db2-6641-4735-83ba-f3beb4d7a6b5 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.097475 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58839e3-aca1-45e1-85d6-690f38763a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.098135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58839e3-aca1-45e1-85d6-690f38763a5a admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.098419 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58839e3-aca1-45e1-85d6-690f38763a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.098696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58839e3-aca1-45e1-85d6-690f38763a5a admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.099459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58839e3-aca1-45e1-85d6-690f38763a5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:46:25.099768 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58839e3-aca1-45e1-85d6-690f38763a5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.101356 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58839e3-aca1-45e1-85d6-690f38763a5a admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.118128 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 796/1571] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:25 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:25.119150 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9cf13-35f7-4eda-8a22-4c86644167e0 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.119391 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 775/1570] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:46:25.120550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58839e3-aca1-45e1-85d6-690f38763a5a admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.130364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58839e3-aca1-45e1-85d6-690f38763a5a admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.180612 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9cf13-35f7-4eda-8a22-4c86644167e0 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.182937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cddec7-6bed-43f2-9bd6-25a98b4c7c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.183639 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cddec7-6bed-43f2-9bd6-25a98b4c7c76 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.183921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cddec7-6bed-43f2-9bd6-25a98b4c7c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.184193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cddec7-6bed-43f2-9bd6-25a98b4c7c76 admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.184910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cddec7-6bed-43f2-9bd6-25a98b4c7c76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:46:25.185093 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaff9b-7af8-4aac-83ff-dc069b19fa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.185219 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cddec7-6bed-43f2-9bd6-25a98b4c7c76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.185760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaff9b-7af8-4aac-83ff-dc069b19fa54 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.186042 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaff9b-7af8-4aac-83ff-dc069b19fa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.186318 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaff9b-7af8-4aac-83ff-dc069b19fa54 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.186981 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cddec7-6bed-43f2-9bd6-25a98b4c7c76 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.187122 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaff9b-7af8-4aac-83ff-dc069b19fa54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:46:25.187355 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaff9b-7af8-4aac-83ff-dc069b19fa54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.188945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaff9b-7af8-4aac-83ff-dc069b19fa54 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.198245 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 776/1572] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:46:25.199652 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf82e0-070f-4f80-9a6b-ae65925977bb None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.199939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf82e0-070f-4f80-9a6b-ae65925977bb None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.200216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf82e0-070f-4f80-9a6b-ae65925977bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.208030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 797/1573] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:46:25.208030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaff9b-7af8-4aac-83ff-dc069b19fa54 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.211886 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaff9b-7af8-4aac-83ff-dc069b19fa54 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.216861 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed694dc-94f6-4848-8455-074def3f0609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.217524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed694dc-94f6-4848-8455-074def3f0609 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.217807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed694dc-94f6-4848-8455-074def3f0609 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.218089 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed694dc-94f6-4848-8455-074def3f0609 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.218785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed694dc-94f6-4848-8455-074def3f0609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.221141 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed694dc-94f6-4848-8455-074def3f0609 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.224895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-5dcf82e0-070f-4f80-9a6b-ae65925977bb None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:25.226078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-5dcf82e0-070f-4f80-9a6b-ae65925977bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:25.233735 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 777/1574] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:25.234556 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf82e0-070f-4f80-9a6b-ae65925977bb None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.244729 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf82e0-070f-4f80-9a6b-ae65925977bb None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.249249 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f8a9c-0e25-4761-91ac-54d9d82ed5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.249574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 798/1575] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:25 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:25.249902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f8a9c-0e25-4761-91ac-54d9d82ed5ff admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.250233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f8a9c-0e25-4761-91ac-54d9d82ed5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.250391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed694dc-94f6-4848-8455-074def3f0609 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.250521 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f8a9c-0e25-4761-91ac-54d9d82ed5ff admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.251217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f8a9c-0e25-4761-91ac-54d9d82ed5ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.253287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f8a9c-0e25-4761-91ac-54d9d82ed5ff admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.282385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 778/1576] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:25 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:25.282385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f8a9c-0e25-4761-91ac-54d9d82ed5ff admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.316773 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed694dc-94f6-4848-8455-074def3f0609 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.338463 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f8a9c-0e25-4761-91ac-54d9d82ed5ff admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.342941 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2a9c4-961a-4ac5-8497-3b7d607a0d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.343671 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2a9c4-961a-4ac5-8497-3b7d607a0d31 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.343918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2a9c4-961a-4ac5-8497-3b7d607a0d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.344540 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2a9c4-961a-4ac5-8497-3b7d607a0d31 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.345227 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2a9c4-961a-4ac5-8497-3b7d607a0d31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.347157 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2a9c4-961a-4ac5-8497-3b7d607a0d31 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.371034 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 779/1577] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:25 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:25.372092 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2a9c4-961a-4ac5-8497-3b7d607a0d31 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.377615 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a4b8e-8085-4e30-9372-4de1ba6f0b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.378517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a4b8e-8085-4e30-9372-4de1ba6f0b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.378795 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a4b8e-8085-4e30-9372-4de1ba6f0b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.379096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a4b8e-8085-4e30-9372-4de1ba6f0b96 admin admin] PATH_INFO: `/v3/projects/1f6fb9972fe0474ca47445634bcf06e0/users/49618ca42d8d43a4ac419c352f7d0042/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.381369 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2a9c4-961a-4ac5-8497-3b7d607a0d31 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.386312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f835a-5624-4cb4-bb53-259163971f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.386948 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f835a-5624-4cb4-bb53-259163971f6e admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.387259 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f835a-5624-4cb4-bb53-259163971f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.387532 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f835a-5624-4cb4-bb53-259163971f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.388202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f835a-5624-4cb4-bb53-259163971f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.390078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f835a-5624-4cb4-bb53-259163971f6e admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.393164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a4b8e-8085-4e30-9372-4de1ba6f0b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f6fb9972fe0474ca47445634bcf06e0, user_id=49618ca42d8d43a4ac419c352f7d0042, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.395884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a4b8e-8085-4e30-9372-4de1ba6f0b96 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.410714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 799/1578] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:25 2022] PUT /identity/v3/projects/1f6fb9972fe0474ca47445634bcf06e0/users/49618ca42d8d43a4ac419c352f7d0042/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:25.411604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a4b8e-8085-4e30-9372-4de1ba6f0b96 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.421633 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 780/1579] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:25 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:25.421633 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f835a-5624-4cb4-bb53-259163971f6e admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.469034 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a4b8e-8085-4e30-9372-4de1ba6f0b96 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.479551 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f835a-5624-4cb4-bb53-259163971f6e admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.484270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c081d-ae1b-4054-9793-0f3e6f11842a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.484912 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c081d-ae1b-4054-9793-0f3e6f11842a admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.485200 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c081d-ae1b-4054-9793-0f3e6f11842a admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.485476 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c081d-ae1b-4054-9793-0f3e6f11842a admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.486168 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c081d-ae1b-4054-9793-0f3e6f11842a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.488118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c081d-ae1b-4054-9793-0f3e6f11842a admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.516110 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 781/1580] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:25 2022] POST /identity/v3/projects => generated 391 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:25.517005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c081d-ae1b-4054-9793-0f3e6f11842a admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.524807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb4133-8bb9-406d-b7a9-1e60c8a4272f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.525490 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb4133-8bb9-406d-b7a9-1e60c8a4272f admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.525761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb4133-8bb9-406d-b7a9-1e60c8a4272f admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.526036 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb4133-8bb9-406d-b7a9-1e60c8a4272f admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.526727 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb4133-8bb9-406d-b7a9-1e60c8a4272f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.528684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb4133-8bb9-406d-b7a9-1e60c8a4272f admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.557927 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 800/1581] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:25 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:25.557927 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb4133-8bb9-406d-b7a9-1e60c8a4272f admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.576173 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c081d-ae1b-4054-9793-0f3e6f11842a admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.619608 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb4133-8bb9-406d-b7a9-1e60c8a4272f admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.624579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87fc0f-f629-46e9-86e5-6724c5895b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.624742 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d8674-f5f6-4994-a76f-7b597c4cf78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.625292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d8674-f5f6-4994-a76f-7b597c4cf78c admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.625402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87fc0f-f629-46e9-86e5-6724c5895b32 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.625579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87fc0f-f629-46e9-86e5-6724c5895b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.625696 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d8674-f5f6-4994-a76f-7b597c4cf78c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.625853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d8674-f5f6-4994-a76f-7b597c4cf78c admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.625948 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87fc0f-f629-46e9-86e5-6724c5895b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.626676 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d8674-f5f6-4994-a76f-7b597c4cf78c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.628723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d8674-f5f6-4994-a76f-7b597c4cf78c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.635286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87fc0f-f629-46e9-86e5-6724c5895b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.636737 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87fc0f-f629-46e9-86e5-6724c5895b32 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.646692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 782/1582] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:25.647622 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87fc0f-f629-46e9-86e5-6724c5895b32 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.655223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 801/1583] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:25 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:25.656109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d8674-f5f6-4994-a76f-7b597c4cf78c admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.659980 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87fc0f-f629-46e9-86e5-6724c5895b32 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.666379 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d8674-f5f6-4994-a76f-7b597c4cf78c admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.668653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbe1c1-94a6-46a7-a423-77e7798fd238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.669301 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbe1c1-94a6-46a7-a423-77e7798fd238 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.669546 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbe1c1-94a6-46a7-a423-77e7798fd238 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.669827 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbe1c1-94a6-46a7-a423-77e7798fd238 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.670496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbe1c1-94a6-46a7-a423-77e7798fd238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.672255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78838ddf-de2b-41d7-a8e5-bb11d5f43fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.672537 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbe1c1-94a6-46a7-a423-77e7798fd238 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.672942 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78838ddf-de2b-41d7-a8e5-bb11d5f43fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.673230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78838ddf-de2b-41d7-a8e5-bb11d5f43fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.673581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78838ddf-de2b-41d7-a8e5-bb11d5f43fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.674310 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78838ddf-de2b-41d7-a8e5-bb11d5f43fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.676184 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78838ddf-de2b-41d7-a8e5-bb11d5f43fb0 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.693357 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 802/1584] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:25.695142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc8203-4302-4d57-8781-749769ae5c38 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.695437 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc8203-4302-4d57-8781-749769ae5c38 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.695717 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc8203-4302-4d57-8781-749769ae5c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.699908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 783/1585] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:25 2022] POST /identity/v3/users => generated 295 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:25.704518 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbe1c1-94a6-46a7-a423-77e7798fd238 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.714964 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbe1c1-94a6-46a7-a423-77e7798fd238 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.715969 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-02bc8203-4302-4d57-8781-749769ae5c38 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:25.717194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-02bc8203-4302-4d57-8781-749769ae5c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:25.720147 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea02a4-9034-4154-956f-868e1b18fc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.720875 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea02a4-9034-4154-956f-868e1b18fc69 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.721114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea02a4-9034-4154-956f-868e1b18fc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.721403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea02a4-9034-4154-956f-868e1b18fc69 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.722106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea02a4-9034-4154-956f-868e1b18fc69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.724159 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea02a4-9034-4154-956f-868e1b18fc69 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.727965 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 803/1586] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:25.729547 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc8203-4302-4d57-8781-749769ae5c38 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.742495 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc8203-4302-4d57-8781-749769ae5c38 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.748133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 784/1587] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:25 2022] POST /identity/v3/users => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:25.748721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea02a4-9034-4154-956f-868e1b18fc69 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.751678 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da17b1-5a34-459f-af72-d1601f80d895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.752599 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da17b1-5a34-459f-af72-d1601f80d895 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.752894 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da17b1-5a34-459f-af72-d1601f80d895 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.753272 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da17b1-5a34-459f-af72-d1601f80d895 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.754063 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da17b1-5a34-459f-af72-d1601f80d895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.756387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da17b1-5a34-459f-af72-d1601f80d895 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.760436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea02a4-9034-4154-956f-868e1b18fc69 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.765123 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1c246-0a4e-4fe6-b3f4-429cccb6099b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.766010 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1c246-0a4e-4fe6-b3f4-429cccb6099b admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.766125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1c246-0a4e-4fe6-b3f4-429cccb6099b admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.766343 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1c246-0a4e-4fe6-b3f4-429cccb6099b admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.767070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1c246-0a4e-4fe6-b3f4-429cccb6099b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.769006 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1c246-0a4e-4fe6-b3f4-429cccb6099b admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.779346 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 804/1588] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:25 2022] POST /identity/v3/users => generated 296 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:25.780269 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da17b1-5a34-459f-af72-d1601f80d895 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.795070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 785/1589] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:25 2022] POST /identity/v3/users => generated 290 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:25.795277 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da17b1-5a34-459f-af72-d1601f80d895 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.795377 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1c246-0a4e-4fe6-b3f4-429cccb6099b admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.799709 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae5a4b-27ec-4111-b1f9-92518618b908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.800492 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae5a4b-27ec-4111-b1f9-92518618b908 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.800784 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae5a4b-27ec-4111-b1f9-92518618b908 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.801066 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae5a4b-27ec-4111-b1f9-92518618b908 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.801828 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae5a4b-27ec-4111-b1f9-92518618b908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.804132 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae5a4b-27ec-4111-b1f9-92518618b908 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.806981 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1c246-0a4e-4fe6-b3f4-429cccb6099b admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.819032 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf5431-23a9-47d4-b035-86c16aa3ed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.819996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf5431-23a9-47d4-b035-86c16aa3ed8c admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.820328 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf5431-23a9-47d4-b035-86c16aa3ed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.821354 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf5431-23a9-47d4-b035-86c16aa3ed8c admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.822284 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf5431-23a9-47d4-b035-86c16aa3ed8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.823122 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 805/1590] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:25.824224 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf5431-23a9-47d4-b035-86c16aa3ed8c admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.824451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae5a4b-27ec-4111-b1f9-92518618b908 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.836815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 786/1591] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:25.837680 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae5a4b-27ec-4111-b1f9-92518618b908 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.841007 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf5431-23a9-47d4-b035-86c16aa3ed8c admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.844910 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fb30f-4a5b-485b-8b6a-1f690c90e974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.845910 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fb30f-4a5b-485b-8b6a-1f690c90e974 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.846306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fb30f-4a5b-485b-8b6a-1f690c90e974 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.846916 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fb30f-4a5b-485b-8b6a-1f690c90e974 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.848305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fb30f-4a5b-485b-8b6a-1f690c90e974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.852549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fb30f-4a5b-485b-8b6a-1f690c90e974 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.854044 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf5431-23a9-47d4-b035-86c16aa3ed8c admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.858001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9d6b0-1100-4bfd-be67-d48fd7185993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.858838 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9d6b0-1100-4bfd-be67-d48fd7185993 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.859403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9d6b0-1100-4bfd-be67-d48fd7185993 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.859779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9d6b0-1100-4bfd-be67-d48fd7185993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.861497 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 806/1592] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:25.862307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fb30f-4a5b-485b-8b6a-1f690c90e974 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.873231 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fb30f-4a5b-485b-8b6a-1f690c90e974 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.875386 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9d6b0-1100-4bfd-be67-d48fd7185993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.876914 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9d6b0-1100-4bfd-be67-d48fd7185993 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.878036 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88550d-02ba-4bd4-b4d1-385c740a5482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.878734 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88550d-02ba-4bd4-b4d1-385c740a5482 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.879172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88550d-02ba-4bd4-b4d1-385c740a5482 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.879495 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88550d-02ba-4bd4-b4d1-385c740a5482 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.880344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88550d-02ba-4bd4-b4d1-385c740a5482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.882214 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88550d-02ba-4bd4-b4d1-385c740a5482 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.887958 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 787/1593] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:25.889531 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9d6b0-1100-4bfd-be67-d48fd7185993 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.900473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9d6b0-1100-4bfd-be67-d48fd7185993 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.905401 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 807/1594] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:25.907330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88550d-02ba-4bd4-b4d1-385c740a5482 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.911571 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ed901-9126-4cc3-b8cb-c2ce28da09c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.912586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ed901-9126-4cc3-b8cb-c2ce28da09c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.913113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ed901-9126-4cc3-b8cb-c2ce28da09c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.915683 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ed901-9126-4cc3-b8cb-c2ce28da09c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.916827 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ed901-9126-4cc3-b8cb-c2ce28da09c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.918683 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ed901-9126-4cc3-b8cb-c2ce28da09c1 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.925190 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88550d-02ba-4bd4-b4d1-385c740a5482 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.929608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 788/1595] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:25.930525 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ed901-9126-4cc3-b8cb-c2ce28da09c1 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.931231 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eeefd-cff9-4d24-a762-6cfe800448d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.932096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eeefd-cff9-4d24-a762-6cfe800448d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.932481 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eeefd-cff9-4d24-a762-6cfe800448d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.933076 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eeefd-cff9-4d24-a762-6cfe800448d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.934123 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934eeefd-cff9-4d24-a762-6cfe800448d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.936892 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934eeefd-cff9-4d24-a762-6cfe800448d9 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.951972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 808/1596] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:25.951972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eeefd-cff9-4d24-a762-6cfe800448d9 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:25.952323 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ed901-9126-4cc3-b8cb-c2ce28da09c1 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.964947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eeefd-cff9-4d24-a762-6cfe800448d9 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:25.969007 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207d15c-6857-4fa4-b43e-58e5a0ef1eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.970582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207d15c-6857-4fa4-b43e-58e5a0ef1eea admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.971368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207d15c-6857-4fa4-b43e-58e5a0ef1eea admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.972295 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207d15c-6857-4fa4-b43e-58e5a0ef1eea admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:25.973142 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207d15c-6857-4fa4-b43e-58e5a0ef1eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:25.976518 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207d15c-6857-4fa4-b43e-58e5a0ef1eea admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:25.979746 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037451cc-3fed-471d-a269-c7f90cb42312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:25.980768 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037451cc-3fed-471d-a269-c7f90cb42312 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:25.981087 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037451cc-3fed-471d-a269-c7f90cb42312 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:25.981477 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037451cc-3fed-471d-a269-c7f90cb42312 admin admin] PATH_INFO: `/v3/projects/be811f654d594012b02e46482d1138e9/users/b38352764e6645ea92b03bc2f4469706/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:26.000308 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 789/1597] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:26.005556 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207d15c-6857-4fa4-b43e-58e5a0ef1eea admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:26.010832 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037451cc-3fed-471d-a269-c7f90cb42312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be811f654d594012b02e46482d1138e9, user_id=b38352764e6645ea92b03bc2f4469706, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:26.017169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037451cc-3fed-471d-a269-c7f90cb42312 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:26.024970 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207d15c-6857-4fa4-b43e-58e5a0ef1eea admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:26.032539 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c639f6-a71b-474c-a48a-94035c4ac477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:26.033356 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c639f6-a71b-474c-a48a-94035c4ac477 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:26.033700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c639f6-a71b-474c-a48a-94035c4ac477 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:26.034047 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c639f6-a71b-474c-a48a-94035c4ac477 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:26.039966 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 809/1598] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:25 2022] PUT /identity/v3/projects/be811f654d594012b02e46482d1138e9/users/b38352764e6645ea92b03bc2f4469706/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:26.041305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037451cc-3fed-471d-a269-c7f90cb42312 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:26.044110 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c639f6-a71b-474c-a48a-94035c4ac477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:26.046005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c639f6-a71b-474c-a48a-94035c4ac477 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:26.065148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 790/1599] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:26.066182 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c639f6-a71b-474c-a48a-94035c4ac477 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:26.108775 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c639f6-a71b-474c-a48a-94035c4ac477 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:26.122883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037451cc-3fed-471d-a269-c7f90cb42312 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:26.124442 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e8a50-3210-484f-af2b-8e51f0c39ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:26.124824 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e8a50-3210-484f-af2b-8e51f0c39ada admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:26.125211 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e8a50-3210-484f-af2b-8e51f0c39ada admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:26.125617 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e8a50-3210-484f-af2b-8e51f0c39ada admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:26.126787 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e8a50-3210-484f-af2b-8e51f0c39ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:26.128111 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db4440-7120-4469-8fa6-5eb8daca22f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:26.128998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db4440-7120-4469-8fa6-5eb8daca22f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:26.129290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db4440-7120-4469-8fa6-5eb8daca22f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:26.129421 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e8a50-3210-484f-af2b-8e51f0c39ada admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:26.129569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db4440-7120-4469-8fa6-5eb8daca22f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:26.130304 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db4440-7120-4469-8fa6-5eb8daca22f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:26.132090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db4440-7120-4469-8fa6-5eb8daca22f1 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:26.143730 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 810/1600] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:26.144637 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db4440-7120-4469-8fa6-5eb8daca22f1 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:26.156232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 791/1601] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:26.158457 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e8a50-3210-484f-af2b-8e51f0c39ada admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:26.160105 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db4440-7120-4469-8fa6-5eb8daca22f1 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:26.166998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0b8ff-5084-4db7-8d57-cfb053eee8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:26.167915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0b8ff-5084-4db7-8d57-cfb053eee8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:26.168303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0b8ff-5084-4db7-8d57-cfb053eee8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:26.168470 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0b8ff-5084-4db7-8d57-cfb053eee8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:26.169209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0b8ff-5084-4db7-8d57-cfb053eee8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:26.171504 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0b8ff-5084-4db7-8d57-cfb053eee8c1 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:26.183906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e8a50-3210-484f-af2b-8e51f0c39ada admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:26.186659 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 811/1602] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:26.188685 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779b7c7-8826-4e4a-afce-9ada4d3a50ba None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:26.189454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779b7c7-8826-4e4a-afce-9ada4d3a50ba None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:26.189891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779b7c7-8826-4e4a-afce-9ada4d3a50ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:26.199359 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d513e-a33b-4964-9a8d-486ad8a1a35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:26.202180 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d513e-a33b-4964-9a8d-486ad8a1a35b admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:26.202668 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d513e-a33b-4964-9a8d-486ad8a1a35b admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:26.203823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d513e-a33b-4964-9a8d-486ad8a1a35b admin admin] PATH_INFO: `/v3/projects/11a325235325487fa356fd7d6597e5b4/users/d4266ab809814a8aa0fae6819d448b25/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:26.222206 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-2779b7c7-8826-4e4a-afce-9ada4d3a50ba None None] MFA Rules not processed for user `b38352764e6645ea92b03bc2f4469706`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:26.223777 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-2779b7c7-8826-4e4a-afce-9ada4d3a50ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:26.243374 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d513e-a33b-4964-9a8d-486ad8a1a35b admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a325235325487fa356fd7d6597e5b4, user_id=d4266ab809814a8aa0fae6819d448b25, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:26.247775 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d513e-a33b-4964-9a8d-486ad8a1a35b admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:26.275780 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 792/1603] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:26 2022] PUT /identity/v3/projects/11a325235325487fa356fd7d6597e5b4/users/d4266ab809814a8aa0fae6819d448b25/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:26.277082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d513e-a33b-4964-9a8d-486ad8a1a35b admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:26.347895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 812/1604] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:26.356333 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779b7c7-8826-4e4a-afce-9ada4d3a50ba None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:26.368317 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779b7c7-8826-4e4a-afce-9ada4d3a50ba None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:26.419591 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d513e-a33b-4964-9a8d-486ad8a1a35b admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:26.428100 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5d5d4-3bc3-4d25-b992-157c534d4dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:26.429955 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5d5d4-3bc3-4d25-b992-157c534d4dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:26.430824 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5d5d4-3bc3-4d25-b992-157c534d4dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:26.431305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5d5d4-3bc3-4d25-b992-157c534d4dcb admin admin] PATH_INFO: `/v3/projects/687babab97b84c10a284e7d92f939fcc/users/2bf26e013e10482fae90fd291b1b90b2/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:26.455620 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426605b-c2c7-4175-9e34-3028fc5b68cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:26.456354 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5d5d4-3bc3-4d25-b992-157c534d4dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=687babab97b84c10a284e7d92f939fcc, user_id=2bf26e013e10482fae90fd291b1b90b2, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:26.457357 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426605b-c2c7-4175-9e34-3028fc5b68cf admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:26.457853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426605b-c2c7-4175-9e34-3028fc5b68cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:26.458488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426605b-c2c7-4175-9e34-3028fc5b68cf admin admin] PATH_INFO: `/v3/projects/0abe3a61487a46b3bc87d7c47f80765d/users/e1dfa6d450a241159e159c16f3a30eec/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:26.459906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5d5d4-3bc3-4d25-b992-157c534d4dcb admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:26.481084 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426605b-c2c7-4175-9e34-3028fc5b68cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0abe3a61487a46b3bc87d7c47f80765d, user_id=e1dfa6d450a241159e159c16f3a30eec, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:26.482407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 793/1605] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:26 2022] PUT /identity/v3/projects/687babab97b84c10a284e7d92f939fcc/users/2bf26e013e10482fae90fd291b1b90b2/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:26.483927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5d5d4-3bc3-4d25-b992-157c534d4dcb admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:26.488601 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426605b-c2c7-4175-9e34-3028fc5b68cf admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:26.515241 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 813/1606] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:26 2022] PUT /identity/v3/projects/0abe3a61487a46b3bc87d7c47f80765d/users/e1dfa6d450a241159e159c16f3a30eec/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:26.515241 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426605b-c2c7-4175-9e34-3028fc5b68cf admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:26.573686 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5d5d4-3bc3-4d25-b992-157c534d4dcb admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:26.611455 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426605b-c2c7-4175-9e34-3028fc5b68cf admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:26.616650 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66cd2b-f315-4e9a-8fd3-5bc496b696d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:26.618425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66cd2b-f315-4e9a-8fd3-5bc496b696d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:26.618787 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66cd2b-f315-4e9a-8fd3-5bc496b696d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:26.619168 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66cd2b-f315-4e9a-8fd3-5bc496b696d5 admin admin] PATH_INFO: `/v3/projects/b5cf0b8941d84bdea4dbc29efa0779da/users/df875def6c844ab786be602d7b6d5086/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:26.654600 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66cd2b-f315-4e9a-8fd3-5bc496b696d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5cf0b8941d84bdea4dbc29efa0779da, user_id=df875def6c844ab786be602d7b6d5086, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:26.657524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66cd2b-f315-4e9a-8fd3-5bc496b696d5 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:26.687637 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca69b4-b1f0-486a-89b1-f32c7e08700a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:26.688144 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 814/1607] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:26 2022] PUT /identity/v3/projects/b5cf0b8941d84bdea4dbc29efa0779da/users/df875def6c844ab786be602d7b6d5086/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:26.689546 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca69b4-b1f0-486a-89b1-f32c7e08700a admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:26.689546 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca69b4-b1f0-486a-89b1-f32c7e08700a admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:26.689759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490dfbf6-ffa1-4ad3-8c67-31f82bbf8b07 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:26.689878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490dfbf6-ffa1-4ad3-8c67-31f82bbf8b07 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:26.690077 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490dfbf6-ffa1-4ad3-8c67-31f82bbf8b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:26.690180 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca69b4-b1f0-486a-89b1-f32c7e08700a admin admin] PATH_INFO: `/v3/projects/41ec8820e4eb4796a959c58da599f5df/users/440a9798bf914da4af0398483e23e33c/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:26.716363 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca69b4-b1f0-486a-89b1-f32c7e08700a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ec8820e4eb4796a959c58da599f5df, user_id=440a9798bf914da4af0398483e23e33c, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:26.721971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca69b4-b1f0-486a-89b1-f32c7e08700a admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:26.729009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-490dfbf6-ffa1-4ad3-8c67-31f82bbf8b07 None None] MFA Rules not processed for user `d4266ab809814a8aa0fae6819d448b25`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:26.730333 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-490dfbf6-ffa1-4ad3-8c67-31f82bbf8b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:26.744236 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 794/1608] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:26 2022] PUT /identity/v3/projects/41ec8820e4eb4796a959c58da599f5df/users/440a9798bf914da4af0398483e23e33c/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:26.745950 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f4127-9471-4085-811d-7f750de6da08 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:26.746363 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f4127-9471-4085-811d-7f750de6da08 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:26.746740 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f4127-9471-4085-811d-7f750de6da08 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:26.748334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 795/1609] 10.222.0.11 () {54 vars in 960 bytes} [Wed May 4 21:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:46:26.749662 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02615922-a954-4a5e-b85b-5ada47187652 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:26.750179 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02615922-a954-4a5e-b85b-5ada47187652 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:26.750555 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02615922-a954-4a5e-b85b-5ada47187652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:26.782938 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-02615922-a954-4a5e-b85b-5ada47187652 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:26.784556 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-02615922-a954-4a5e-b85b-5ada47187652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:26.842359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 815/1610] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:26 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:26.844667 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c0cc2-1ae9-4403-9b2d-29bec0c8a11a None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:26.845125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c0cc2-1ae9-4403-9b2d-29bec0c8a11a None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:26.845413 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c0cc2-1ae9-4403-9b2d-29bec0c8a11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:26.858406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 796/1611] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:26.869203 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be201c8-8184-45ce-84e8-ca726975717c None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:26.869497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be201c8-8184-45ce-84e8-ca726975717c None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:26.869771 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be201c8-8184-45ce-84e8-ca726975717c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:26.883613 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-5d7c0cc2-1ae9-4403-9b2d-29bec0c8a11a None None] MFA Rules not processed for user `e1dfa6d450a241159e159c16f3a30eec`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:26.885409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5d7c0cc2-1ae9-4403-9b2d-29bec0c8a11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:26.898246 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-8be201c8-8184-45ce-84e8-ca726975717c None None] MFA Rules not processed for user `1177da2d74a5427492e15695896e725c`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:26.899633 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-8be201c8-8184-45ce-84e8-ca726975717c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:26.976554 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 816/1612] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:26.978219 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b021a-2c80-447d-915b-fc9f625d1399 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:26.978699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b021a-2c80-447d-915b-fc9f625d1399 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:26.979894 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b021a-2c80-447d-915b-fc9f625d1399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:27.013715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-0a2b021a-2c80-447d-915b-fc9f625d1399 None None] MFA Rules not processed for user `df875def6c844ab786be602d7b6d5086`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:27.015272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 797/1613] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:27.015533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-0a2b021a-2c80-447d-915b-fc9f625d1399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:27.016820 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7e308-e520-43c8-9d58-7f0ace64fb37 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:27.017207 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7e308-e520-43c8-9d58-7f0ace64fb37 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:27.018066 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7e308-e520-43c8-9d58-7f0ace64fb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:27.043403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-b1b7e308-e520-43c8-9d58-7f0ace64fb37 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:27.044924 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b1b7e308-e520-43c8-9d58-7f0ace64fb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:27.056431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 798/1614] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:27.056431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb772a4-d438-4e9d-9f2c-2c97ba9c162b None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:27.056431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb772a4-d438-4e9d-9f2c-2c97ba9c162b None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:27.056431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb772a4-d438-4e9d-9f2c-2c97ba9c162b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:27.075837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-4eb772a4-d438-4e9d-9f2c-2c97ba9c162b None None] MFA Rules not processed for user `f4f207481ccb4cfcbbcffd9df73d2985`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:27.077242 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-4eb772a4-d438-4e9d-9f2c-2c97ba9c162b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:27.101829 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 817/1615] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:27.101829 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b021a-2c80-447d-915b-fc9f625d1399 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:27.112340 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b021a-2c80-447d-915b-fc9f625d1399 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:27.119348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caa545-aa0f-4eda-8b35-6856b85306fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:27.120038 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caa545-aa0f-4eda-8b35-6856b85306fa admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:27.120325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caa545-aa0f-4eda-8b35-6856b85306fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:27.120603 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caa545-aa0f-4eda-8b35-6856b85306fa admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:27.121306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caa545-aa0f-4eda-8b35-6856b85306fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:27.123345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caa545-aa0f-4eda-8b35-6856b85306fa admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:27.154641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 818/1616] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:27 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:27.155548 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caa545-aa0f-4eda-8b35-6856b85306fa admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:27.167683 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 799/1617] 10.222.0.11 () {58 vars in 1057 bytes} [Wed May 4 21:46:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:27.169706 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b8903-a7f3-4b07-a2ed-0bc430749552 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:27.169706 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b8903-a7f3-4b07-a2ed-0bc430749552 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:27.169975 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b8903-a7f3-4b07-a2ed-0bc430749552 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:27.171609 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 800/1618] 10.222.0.11 () {54 vars in 960 bytes} [Wed May 4 21:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:46:27.176861 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a3c49-e1f2-4513-a51c-595cc1e2baec None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:27.177267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a3c49-e1f2-4513-a51c-595cc1e2baec None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:27.177646 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a3c49-e1f2-4513-a51c-595cc1e2baec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:27.196959 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-3c0a3c49-e1f2-4513-a51c-595cc1e2baec None None] MFA Rules not processed for user `1177da2d74a5427492e15695896e725c`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:27.198312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-3c0a3c49-e1f2-4513-a51c-595cc1e2baec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:27.230100 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caa545-aa0f-4eda-8b35-6856b85306fa admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:27.235828 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878870b-d7f5-4ef4-b9b1-6ed4bf3e5c16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:27.236751 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878870b-d7f5-4ef4-b9b1-6ed4bf3e5c16 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:27.237208 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878870b-d7f5-4ef4-b9b1-6ed4bf3e5c16 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:27.237650 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878870b-d7f5-4ef4-b9b1-6ed4bf3e5c16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:27.260415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 801/1619] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:27.261645 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a3c49-e1f2-4513-a51c-595cc1e2baec None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:27.278105 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a3c49-e1f2-4513-a51c-595cc1e2baec None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:27.284104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f998d-a5a1-465a-879f-1ab3eea6d903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:27.284972 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f998d-a5a1-465a-879f-1ab3eea6d903 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:27.286060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f998d-a5a1-465a-879f-1ab3eea6d903 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:27.286498 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f998d-a5a1-465a-879f-1ab3eea6d903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:27.311908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878870b-d7f5-4ef4-b9b1-6ed4bf3e5c16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:27.313369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878870b-d7f5-4ef4-b9b1-6ed4bf3e5c16 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:27.324770 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 819/1620] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:27.325615 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878870b-d7f5-4ef4-b9b1-6ed4bf3e5c16 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:27.335516 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878870b-d7f5-4ef4-b9b1-6ed4bf3e5c16 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:27.346727 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e6bfa-0cf2-4ff3-9be7-cc972f364213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:27.347812 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e6bfa-0cf2-4ff3-9be7-cc972f364213 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:27.348117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e6bfa-0cf2-4ff3-9be7-cc972f364213 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:27.349093 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e6bfa-0cf2-4ff3-9be7-cc972f364213 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:27.350002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e6bfa-0cf2-4ff3-9be7-cc972f364213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:27.352981 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e6bfa-0cf2-4ff3-9be7-cc972f364213 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:27.367842 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f998d-a5a1-465a-879f-1ab3eea6d903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:27.369858 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f998d-a5a1-465a-879f-1ab3eea6d903 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:27.382441 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 802/1621] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:27.383517 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f998d-a5a1-465a-879f-1ab3eea6d903 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:27.387742 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 820/1622] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:27 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:27.388638 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e6bfa-0cf2-4ff3-9be7-cc972f364213 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:27.399620 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f998d-a5a1-465a-879f-1ab3eea6d903 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:27.473654 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983c586-71e6-445e-9bfa-0fb9ac1f83ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:27.474959 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983c586-71e6-445e-9bfa-0fb9ac1f83ff admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:27.475480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983c586-71e6-445e-9bfa-0fb9ac1f83ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:27.475961 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983c586-71e6-445e-9bfa-0fb9ac1f83ff admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:27.476867 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983c586-71e6-445e-9bfa-0fb9ac1f83ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:27.481033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983c586-71e6-445e-9bfa-0fb9ac1f83ff admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:27.488264 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e6bfa-0cf2-4ff3-9be7-cc972f364213 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:27.497154 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635000d7-6c0c-44f6-9ae7-99aee3949756 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:27.497938 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635000d7-6c0c-44f6-9ae7-99aee3949756 service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:27.498834 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635000d7-6c0c-44f6-9ae7-99aee3949756 service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:27.499468 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635000d7-6c0c-44f6-9ae7-99aee3949756 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:27.513184 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 803/1623] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:27 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:27.514837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255252ab-5f96-4b49-ac79-c99e6deb8c98 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:27.515242 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255252ab-5f96-4b49-ac79-c99e6deb8c98 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:27.515522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255252ab-5f96-4b49-ac79-c99e6deb8c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:27.539357 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-255252ab-5f96-4b49-ac79-c99e6deb8c98 None None] MFA Rules not processed for user `f4f207481ccb4cfcbbcffd9df73d2985`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:27.540661 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-255252ab-5f96-4b49-ac79-c99e6deb8c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:27.552691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 804/1624] 10.222.0.11 () {58 vars in 1057 bytes} [Wed May 4 21:46:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:27.553751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255252ab-5f96-4b49-ac79-c99e6deb8c98 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:27.571120 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255252ab-5f96-4b49-ac79-c99e6deb8c98 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:27.577423 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73a368-ff6f-4d00-bd5a-e3018601f40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:27.578171 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73a368-ff6f-4d00-bd5a-e3018601f40a admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:27.578459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73a368-ff6f-4d00-bd5a-e3018601f40a admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:27.578730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73a368-ff6f-4d00-bd5a-e3018601f40a admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:27.582276 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635000d7-6c0c-44f6-9ae7-99aee3949756 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:27.585334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635000d7-6c0c-44f6-9ae7-99aee3949756 service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:27.585876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73a368-ff6f-4d00-bd5a-e3018601f40a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:27.588735 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73a368-ff6f-4d00-bd5a-e3018601f40a admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:27.601837 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 821/1625] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:27.602787 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635000d7-6c0c-44f6-9ae7-99aee3949756 service nova] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:27.618303 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 805/1626] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:27 2022] POST /identity/v3/users => generated 297 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:27.622453 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73a368-ff6f-4d00-bd5a-e3018601f40a admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:27.626866 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635000d7-6c0c-44f6-9ae7-99aee3949756 service nova] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:27.637553 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6adc6d-2775-4403-8a4b-7e455c1dc905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:27.638684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6adc6d-2775-4403-8a4b-7e455c1dc905 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:27.639311 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6adc6d-2775-4403-8a4b-7e455c1dc905 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:27.639766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6adc6d-2775-4403-8a4b-7e455c1dc905 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:27.639968 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73a368-ff6f-4d00-bd5a-e3018601f40a admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:27.642339 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6adc6d-2775-4403-8a4b-7e455c1dc905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:27.645750 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6adc6d-2775-4403-8a4b-7e455c1dc905 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:27.647913 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf6d28-7f8c-4691-aaac-41bebd035540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:27.648588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf6d28-7f8c-4691-aaac-41bebd035540 service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:27.648917 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf6d28-7f8c-4691-aaac-41bebd035540 service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:27.649424 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf6d28-7f8c-4691-aaac-41bebd035540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:27.663256 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 822/1627] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:27.664140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6adc6d-2775-4403-8a4b-7e455c1dc905 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:27.686215 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6adc6d-2775-4403-8a4b-7e455c1dc905 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:27.693344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17220a40-c75e-43ec-bb53-18291e070d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:27.694220 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17220a40-c75e-43ec-bb53-18291e070d92 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:27.695346 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17220a40-c75e-43ec-bb53-18291e070d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:27.695639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17220a40-c75e-43ec-bb53-18291e070d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:27.696988 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17220a40-c75e-43ec-bb53-18291e070d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:27.699375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17220a40-c75e-43ec-bb53-18291e070d92 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:27.725902 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 823/1628] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:27.731385 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17220a40-c75e-43ec-bb53-18291e070d92 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:27.734582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf6d28-7f8c-4691-aaac-41bebd035540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:27.737612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf6d28-7f8c-4691-aaac-41bebd035540 service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:27.753136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17220a40-c75e-43ec-bb53-18291e070d92 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:27.758162 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 806/1629] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:27.761138 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf6d28-7f8c-4691-aaac-41bebd035540 service nova] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:27.764913 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7411790-da03-4dc2-bd3a-6ffa3d7a83fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:27.767323 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7411790-da03-4dc2-bd3a-6ffa3d7a83fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:27.767615 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7411790-da03-4dc2-bd3a-6ffa3d7a83fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:27.770100 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7411790-da03-4dc2-bd3a-6ffa3d7a83fc admin admin] PATH_INFO: `/v3/projects/af251ed945424487931aa58d2ea58f15/users/6bf0c5e8a4ec412a88d94f2eabdfc78c/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:27.785686 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf6d28-7f8c-4691-aaac-41bebd035540 service nova] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:27.795464 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d27521-9128-471f-b4ca-d37f38f101e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:27.796551 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d27521-9128-471f-b4ca-d37f38f101e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:27.797379 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d27521-9128-471f-b4ca-d37f38f101e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:27.797655 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d27521-9128-471f-b4ca-d37f38f101e3 admin admin] PATH_INFO: `/v3/projects/bd98d6e8d7424e599847bb1054134f52/users/c7c8c2a4eb4c423d894431308763ecea/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:27.801799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7411790-da03-4dc2-bd3a-6ffa3d7a83fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=af251ed945424487931aa58d2ea58f15, user_id=6bf0c5e8a4ec412a88d94f2eabdfc78c, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:27.804587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7411790-da03-4dc2-bd3a-6ffa3d7a83fc admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:27.833332 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 824/1630] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:27 2022] PUT /identity/v3/projects/af251ed945424487931aa58d2ea58f15/users/6bf0c5e8a4ec412a88d94f2eabdfc78c/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:27.839381 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d27521-9128-471f-b4ca-d37f38f101e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd98d6e8d7424e599847bb1054134f52, user_id=c7c8c2a4eb4c423d894431308763ecea, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:27.842031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7411790-da03-4dc2-bd3a-6ffa3d7a83fc admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:27.845905 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d27521-9128-471f-b4ca-d37f38f101e3 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:27.878441 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 807/1631] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:27 2022] PUT /identity/v3/projects/bd98d6e8d7424e599847bb1054134f52/users/c7c8c2a4eb4c423d894431308763ecea/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:27.886468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d27521-9128-471f-b4ca-d37f38f101e3 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:27.989265 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7411790-da03-4dc2-bd3a-6ffa3d7a83fc admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:28.006594 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d27521-9128-471f-b4ca-d37f38f101e3 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:28.013715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca5b6c-154f-4876-9663-6dc2e2c085e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:28.014431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca5b6c-154f-4876-9663-6dc2e2c085e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:28.014711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca5b6c-154f-4876-9663-6dc2e2c085e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:28.014989 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca5b6c-154f-4876-9663-6dc2e2c085e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:28.015916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca5b6c-154f-4876-9663-6dc2e2c085e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:28.017732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca5b6c-154f-4876-9663-6dc2e2c085e5 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:28.039277 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 808/1632] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:28.041132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca5b6c-154f-4876-9663-6dc2e2c085e5 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:28.057123 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca5b6c-154f-4876-9663-6dc2e2c085e5 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:28.090131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd97fe8-3d6b-4b12-9024-293822aa1160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:28.091204 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd97fe8-3d6b-4b12-9024-293822aa1160 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:28.091505 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd97fe8-3d6b-4b12-9024-293822aa1160 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:28.091791 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd97fe8-3d6b-4b12-9024-293822aa1160 admin admin] PATH_INFO: `/v3/projects/bd98d6e8d7424e599847bb1054134f52/users/c7c8c2a4eb4c423d894431308763ecea/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:28.096707 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd97fe8-3d6b-4b12-9024-293822aa1160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd98d6e8d7424e599847bb1054134f52, user_id=c7c8c2a4eb4c423d894431308763ecea, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:28.101295 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd97fe8-3d6b-4b12-9024-293822aa1160 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:28.146303 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 809/1633] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:28 2022] PUT /identity/v3/projects/bd98d6e8d7424e599847bb1054134f52/users/c7c8c2a4eb4c423d894431308763ecea/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:28.147854 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd97fe8-3d6b-4b12-9024-293822aa1160 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:28.152650 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69138968-a1ba-47b9-84bf-ea33a74fca79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:28.157050 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69138968-a1ba-47b9-84bf-ea33a74fca79 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:28.157388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69138968-a1ba-47b9-84bf-ea33a74fca79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:28.157670 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69138968-a1ba-47b9-84bf-ea33a74fca79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:28.160765 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69138968-a1ba-47b9-84bf-ea33a74fca79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:28.164514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69138968-a1ba-47b9-84bf-ea33a74fca79 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:28.193110 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 825/1634] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:28.194652 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771b241-0efa-438d-a634-ac4ddd74b162 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:28.200497 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771b241-0efa-438d-a634-ac4ddd74b162 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:28.200841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771b241-0efa-438d-a634-ac4ddd74b162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:28.263699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-3771b241-0efa-438d-a634-ac4ddd74b162 None None] MFA Rules not processed for user `c7c8c2a4eb4c423d894431308763ecea`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:28.265556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-3771b241-0efa-438d-a634-ac4ddd74b162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:28.282711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd97fe8-3d6b-4b12-9024-293822aa1160 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:28.308516 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666daa3-5459-4975-bb2f-6d3d6d80c7f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:28.310142 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666daa3-5459-4975-bb2f-6d3d6d80c7f2 service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:28.310725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666daa3-5459-4975-bb2f-6d3d6d80c7f2 service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:28.312571 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666daa3-5459-4975-bb2f-6d3d6d80c7f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:28.388949 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 826/1635] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:28.390068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771b241-0efa-438d-a634-ac4ddd74b162 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:28.477384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666daa3-5459-4975-bb2f-6d3d6d80c7f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:28.482717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666daa3-5459-4975-bb2f-6d3d6d80c7f2 service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:28.501806 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771b241-0efa-438d-a634-ac4ddd74b162 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:28.506093 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 810/1636] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:28.507492 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666daa3-5459-4975-bb2f-6d3d6d80c7f2 service nova] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:28.512350 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383b95c-5088-480d-b2ab-cb4ee8d76c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:28.513267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383b95c-5088-480d-b2ab-cb4ee8d76c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:28.513637 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383b95c-5088-480d-b2ab-cb4ee8d76c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:28.514140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383b95c-5088-480d-b2ab-cb4ee8d76c5c admin admin] PATH_INFO: `/v3/projects/af251ed945424487931aa58d2ea58f15/users/6bf0c5e8a4ec412a88d94f2eabdfc78c/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:28.516388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383b95c-5088-480d-b2ab-cb4ee8d76c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=af251ed945424487931aa58d2ea58f15, user_id=6bf0c5e8a4ec412a88d94f2eabdfc78c, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:28.519240 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383b95c-5088-480d-b2ab-cb4ee8d76c5c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:28.543500 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 827/1637] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:28 2022] PUT /identity/v3/projects/af251ed945424487931aa58d2ea58f15/users/6bf0c5e8a4ec412a88d94f2eabdfc78c/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:28.543500 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb7c72-8be9-4b0d-9c85-f460fc08592b None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:28.543500 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb7c72-8be9-4b0d-9c85-f460fc08592b None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:28.543500 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb7c72-8be9-4b0d-9c85-f460fc08592b None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:28.543500 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 828/1638] 10.222.0.11 () {54 vars in 912 bytes} [Wed May 4 21:46:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:46:28.543500 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64630b4-cf8d-47b0-9372-89841729d322 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:28.544161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64630b4-cf8d-47b0-9372-89841729d322 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:28.544161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64630b4-cf8d-47b0-9372-89841729d322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:28.572482 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-a64630b4-cf8d-47b0-9372-89841729d322 None None] MFA Rules not processed for user `f4f207481ccb4cfcbbcffd9df73d2985`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:28.574937 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a64630b4-cf8d-47b0-9372-89841729d322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:28.608132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666daa3-5459-4975-bb2f-6d3d6d80c7f2 service nova] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:28.695548 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 829/1639] 10.222.0.11 () {58 vars in 1009 bytes} [Wed May 4 21:46:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:28.699420 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1772b-b698-4c48-af48-e13ebc78073a None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:28.699714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1772b-b698-4c48-af48-e13ebc78073a None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:28.700021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1772b-b698-4c48-af48-e13ebc78073a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:28.725867 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fd766-450f-47ab-b5ff-bf8c380df684 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:28.727106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fd766-450f-47ab-b5ff-bf8c380df684 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:28.727106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fd766-450f-47ab-b5ff-bf8c380df684 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:28.727428 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fd766-450f-47ab-b5ff-bf8c380df684 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:28.735208 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-41c1772b-b698-4c48-af48-e13ebc78073a None None] MFA Rules not processed for user `6bf0c5e8a4ec412a88d94f2eabdfc78c`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:28.736417 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-41c1772b-b698-4c48-af48-e13ebc78073a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:28.814169 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fd766-450f-47ab-b5ff-bf8c380df684 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:28.819974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fd766-450f-47ab-b5ff-bf8c380df684 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:28.835865 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 830/1640] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:28 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:28.837687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e3b0e-de1b-45f2-8f67-f7d6e9c3f3d2 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:28.838041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e3b0e-de1b-45f2-8f67-f7d6e9c3f3d2 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:28.838390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e3b0e-de1b-45f2-8f67-f7d6e9c3f3d2 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:28.840292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 831/1641] 10.222.0.11 () {54 vars in 912 bytes} [Wed May 4 21:46:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:46:28.841006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e3b0e-de1b-45f2-8f67-f7d6e9c3f3d2 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:28.853439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 811/1642] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:28.855287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a735d34-1f0d-4a28-b84f-048f96b30a7c None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:28.855287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a735d34-1f0d-4a28-b84f-048f96b30a7c None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:28.855581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a735d34-1f0d-4a28-b84f-048f96b30a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:28.872467 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e3b0e-de1b-45f2-8f67-f7d6e9c3f3d2 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:28.887602 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45018692-8c4b-40d5-a33f-2528c9105110 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:28.888541 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45018692-8c4b-40d5-a33f-2528c9105110 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:28.888870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45018692-8c4b-40d5-a33f-2528c9105110 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:28.889241 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45018692-8c4b-40d5-a33f-2528c9105110 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:28.896201 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-1a735d34-1f0d-4a28-b84f-048f96b30a7c None None] MFA Rules not processed for user `f4f207481ccb4cfcbbcffd9df73d2985`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:28.899259 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-1a735d34-1f0d-4a28-b84f-048f96b30a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:28.909462 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45018692-8c4b-40d5-a33f-2528c9105110 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:28.911632 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45018692-8c4b-40d5-a33f-2528c9105110 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:28.914498 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 812/1643] 10.222.0.11 () {58 vars in 1009 bytes} [Wed May 4 21:46:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:28.920168 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a735d34-1f0d-4a28-b84f-048f96b30a7c None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:28.930262 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 832/1644] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:28.935833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a735d34-1f0d-4a28-b84f-048f96b30a7c None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:28.939624 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909799b4-dc55-43f1-8364-d15cd8c70299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:28.940291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909799b4-dc55-43f1-8364-d15cd8c70299 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:28.940578 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909799b4-dc55-43f1-8364-d15cd8c70299 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:28.941378 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909799b4-dc55-43f1-8364-d15cd8c70299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:28.944960 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45018692-8c4b-40d5-a33f-2528c9105110 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:28.946409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-45018692-8c4b-40d5-a33f-2528c9105110 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:28.969760 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909799b4-dc55-43f1-8364-d15cd8c70299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:28.973938 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909799b4-dc55-43f1-8364-d15cd8c70299 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:28.995539 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 813/1645] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:28 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:29.075391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45018692-8c4b-40d5-a33f-2528c9105110 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:29.088919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779a849-f4e6-4625-a013-bc23f798e1b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c61205d7e96f496ab9f8ca84ab9408b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:29.091257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779a849-f4e6-4625-a013-bc23f798e1b0 service glance] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:29.091834 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779a849-f4e6-4625-a013-bc23f798e1b0 service glance] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:29.092362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779a849-f4e6-4625-a013-bc23f798e1b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:29.116101 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779a849-f4e6-4625-a013-bc23f798e1b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:29.127128 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779a849-f4e6-4625-a013-bc23f798e1b0 service glance] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:29.141689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 833/1646] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:29.260964 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909799b4-dc55-43f1-8364-d15cd8c70299 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:29.271013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909799b4-dc55-43f1-8364-d15cd8c70299 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:29.284559 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0038b4-f65b-4299-a206-b395ab651159 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:29.285624 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0038b4-f65b-4299-a206-b395ab651159 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:29.285855 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0038b4-f65b-4299-a206-b395ab651159 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:29.286136 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0038b4-f65b-4299-a206-b395ab651159 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:29.418664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0038b4-f65b-4299-a206-b395ab651159 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:29.421072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0038b4-f65b-4299-a206-b395ab651159 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:29.439875 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 814/1647] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:29.912637 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779a849-f4e6-4625-a013-bc23f798e1b0 service glance] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:29.947579 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779a849-f4e6-4625-a013-bc23f798e1b0 service glance] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:29.954473 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c059aa-8ac5-4012-a476-1ee3670fb885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:29.956131 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c059aa-8ac5-4012-a476-1ee3670fb885 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:29.956698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c059aa-8ac5-4012-a476-1ee3670fb885 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:29.957229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c059aa-8ac5-4012-a476-1ee3670fb885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:30.037931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953a438-6ce5-4e65-8184-68ed43ce7f59 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:30.038286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953a438-6ce5-4e65-8184-68ed43ce7f59 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:30.038496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953a438-6ce5-4e65-8184-68ed43ce7f59 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:30.040118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 815/1648] 10.222.0.11 () {54 vars in 912 bytes} [Wed May 4 21:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:46:30.054853 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a50253-dba6-4317-9637-ad5a57e01451 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:30.055281 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a50253-dba6-4317-9637-ad5a57e01451 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:30.055561 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a50253-dba6-4317-9637-ad5a57e01451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:30.101367 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c059aa-8ac5-4012-a476-1ee3670fb885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:30.103473 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c059aa-8ac5-4012-a476-1ee3670fb885 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:30.125843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 834/1649] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:29 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:30.183185 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-64a50253-dba6-4317-9637-ad5a57e01451 None None] MFA Rules not processed for user `e4e5d4fe283447c59672398a26dea225`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:30.185078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-64a50253-dba6-4317-9637-ad5a57e01451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:30.317114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 816/1650] 10.222.0.11 () {58 vars in 1009 bytes} [Wed May 4 21:46:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:46:30.357928 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c059aa-8ac5-4012-a476-1ee3670fb885 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:30.369148 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c059aa-8ac5-4012-a476-1ee3670fb885 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:30.382513 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d97ca8-734b-4500-9437-035f27af874d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:30.383239 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d97ca8-734b-4500-9437-035f27af874d service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:30.383650 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d97ca8-734b-4500-9437-035f27af874d service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:30.386532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d97ca8-734b-4500-9437-035f27af874d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:30.414174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d97ca8-734b-4500-9437-035f27af874d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:30.415739 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d97ca8-734b-4500-9437-035f27af874d service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:30.452106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 835/1651] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:30.755682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a50253-dba6-4317-9637-ad5a57e01451 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:30.838940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a50253-dba6-4317-9637-ad5a57e01451 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:30.845199 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974872e-d060-4095-bf4c-42db24ba7760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:30.846673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974872e-d060-4095-bf4c-42db24ba7760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:30.847192 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974872e-d060-4095-bf4c-42db24ba7760 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:30.847962 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974872e-d060-4095-bf4c-42db24ba7760 admin admin] PATH_INFO: `/v3/users/b38352764e6645ea92b03bc2f4469706` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:30.849766 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974872e-d060-4095-bf4c-42db24ba7760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b38352764e6645ea92b03bc2f4469706)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:30.852699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974872e-d060-4095-bf4c-42db24ba7760 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:30.924658 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1974872e-d060-4095-bf4c-42db24ba7760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b38352764e6645ea92b03bc2f4469706'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:30.937942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1974872e-d060-4095-bf4c-42db24ba7760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b38352764e6645ea92b03bc2f4469706'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:30.953695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1974872e-d060-4095-bf4c-42db24ba7760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b38352764e6645ea92b03bc2f4469706'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:30.954779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1974872e-d060-4095-bf4c-42db24ba7760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b38352764e6645ea92b03bc2f4469706'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:30.955559 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1974872e-d060-4095-bf4c-42db24ba7760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b38352764e6645ea92b03bc2f4469706'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:30.983785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 817/1652] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:46:30 2022] DELETE /identity/v3/users/b38352764e6645ea92b03bc2f4469706 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:30.984889 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6dc82-341f-473c-a887-e2bb840e3ee7 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:30.985461 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6dc82-341f-473c-a887-e2bb840e3ee7 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:30.985461 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6dc82-341f-473c-a887-e2bb840e3ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:31.015837 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-51d6dc82-341f-473c-a887-e2bb840e3ee7 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:31.016909 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-51d6dc82-341f-473c-a887-e2bb840e3ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:31.107339 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 836/1653] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:31.129181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974872e-d060-4095-bf4c-42db24ba7760 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:31.132671 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-1974872e-d060-4095-bf4c-42db24ba7760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:31.266643 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974872e-d060-4095-bf4c-42db24ba7760 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:31.274147 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a12ff-b135-4cac-837e-e137e1662b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:31.275420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a12ff-b135-4cac-837e-e137e1662b99 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:31.275971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a12ff-b135-4cac-837e-e137e1662b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:31.277017 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a12ff-b135-4cac-837e-e137e1662b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:31.295445 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a12ff-b135-4cac-837e-e137e1662b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:31.297103 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a12ff-b135-4cac-837e-e137e1662b99 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:31.312625 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 818/1654] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:32.004026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18051eaf-562a-4916-b3d9-644284d9ef23 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:32.004624 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18051eaf-562a-4916-b3d9-644284d9ef23 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:32.005389 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18051eaf-562a-4916-b3d9-644284d9ef23 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:32.008008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 837/1655] 10.222.0.11 () {54 vars in 960 bytes} [Wed May 4 21:46:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:46:32.013407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012208a7-9c1f-435c-8936-f7d27932f6c6 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:32.014011 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012208a7-9c1f-435c-8936-f7d27932f6c6 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:32.014011 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012208a7-9c1f-435c-8936-f7d27932f6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:32.074436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-012208a7-9c1f-435c-8936-f7d27932f6c6 None None] MFA Rules not processed for user `e203d7077af54930a640b2334a1d8fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:32.076122 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-012208a7-9c1f-435c-8936-f7d27932f6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:32.301108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 819/1656] 10.222.0.11 () {58 vars in 1057 bytes} [Wed May 4 21:46:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:32.310811 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18051eaf-562a-4916-b3d9-644284d9ef23 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:32.347655 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18051eaf-562a-4916-b3d9-644284d9ef23 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:32.363872 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51514c80-612e-4349-8d79-1b214a12736f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e203d7077af54930a640b2334a1d8fa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:32.364761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51514c80-612e-4349-8d79-1b214a12736f service placement] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:32.365215 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51514c80-612e-4349-8d79-1b214a12736f service placement] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:32.365638 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51514c80-612e-4349-8d79-1b214a12736f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:32.374766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-51514c80-612e-4349-8d79-1b214a12736f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:32.406110 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51514c80-612e-4349-8d79-1b214a12736f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:32.408348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51514c80-612e-4349-8d79-1b214a12736f service placement] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:32.442291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 838/1657] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:33.135386 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012208a7-9c1f-435c-8936-f7d27932f6c6 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:33.138722 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-012208a7-9c1f-435c-8936-f7d27932f6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:33.168979 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012208a7-9c1f-435c-8936-f7d27932f6c6 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:33.185448 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302f726-4646-4b70-a07c-6c94b3eea27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:33.187980 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302f726-4646-4b70-a07c-6c94b3eea27e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:33.188454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302f726-4646-4b70-a07c-6c94b3eea27e admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:33.188892 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302f726-4646-4b70-a07c-6c94b3eea27e admin admin] PATH_INFO: `/v3/projects/be811f654d594012b02e46482d1138e9` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:33.190346 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302f726-4646-4b70-a07c-6c94b3eea27e admin admin] RBAC: Authorizing `identity:delete_project(project_id=be811f654d594012b02e46482d1138e9)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:33.193058 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: WARNING py.warnings [None req-7302f726-4646-4b70-a07c-6c94b3eea27e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:46:33.193058 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: warnings.warn(msg) May 04 21:46:33.193058 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: May 04 21:46:33.194211 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302f726-4646-4b70-a07c-6c94b3eea27e admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:33.366367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-7302f726-4646-4b70-a07c-6c94b3eea27e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be811f654d594012b02e46482d1138e9', 'request_id': 'req-7302f726-4646-4b70-a07c-6c94b3eea27e'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:33.429989 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-7302f726-4646-4b70-a07c-6c94b3eea27e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be811f654d594012b02e46482d1138e9', 'request_id': 'req-7302f726-4646-4b70-a07c-6c94b3eea27e'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:33.431077 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51514c80-612e-4349-8d79-1b214a12736f service placement] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:33.433308 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-51514c80-612e-4349-8d79-1b214a12736f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:33.447107 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-7302f726-4646-4b70-a07c-6c94b3eea27e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be811f654d594012b02e46482d1138e9', 'request_id': 'req-7302f726-4646-4b70-a07c-6c94b3eea27e'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:33.456248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51514c80-612e-4349-8d79-1b214a12736f service placement] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:33.484061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-7302f726-4646-4b70-a07c-6c94b3eea27e admin admin] The token cache is being invalidate because project be811f654d594012b02e46482d1138e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:46:33.484512 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-7302f726-4646-4b70-a07c-6c94b3eea27e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:33.485328 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-7302f726-4646-4b70-a07c-6c94b3eea27e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:33.494611 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 820/1658] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:46:33 2022] DELETE /identity/v3/projects/be811f654d594012b02e46482d1138e9 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:33.496340 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebff93-c1e1-4315-97e7-4be2b2f1512b None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:33.547110 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebff93-c1e1-4315-97e7-4be2b2f1512b None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:33.547110 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebff93-c1e1-4315-97e7-4be2b2f1512b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:33.553609 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35344e2-817d-426a-bce4-0396007aabd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:33.554602 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35344e2-817d-426a-bce4-0396007aabd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:33.554948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35344e2-817d-426a-bce4-0396007aabd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:33.555367 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35344e2-817d-426a-bce4-0396007aabd2 admin admin] PATH_INFO: `/v3/users/e1dfa6d450a241159e159c16f3a30eec` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:33.557200 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35344e2-817d-426a-bce4-0396007aabd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1dfa6d450a241159e159c16f3a30eec)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:33.558448 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: WARNING py.warnings [None req-c35344e2-817d-426a-bce4-0396007aabd2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:46:33.558448 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: warnings.warn(msg) May 04 21:46:33.558448 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: May 04 21:46:33.561741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35344e2-817d-426a-bce4-0396007aabd2 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:33.577328 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-f9ebff93-c1e1-4315-97e7-4be2b2f1512b None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:33.578605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f9ebff93-c1e1-4315-97e7-4be2b2f1512b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:33.605411 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 821/1659] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:33.615369 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e732c-623c-4b47-8b13-38aaf7d61994 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:33.615661 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e732c-623c-4b47-8b13-38aaf7d61994 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:33.615947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e732c-623c-4b47-8b13-38aaf7d61994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:33.648508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-019e732c-623c-4b47-8b13-38aaf7d61994 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:33.658699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-019e732c-623c-4b47-8b13-38aaf7d61994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:33.692023 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c35344e2-817d-426a-bce4-0396007aabd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1dfa6d450a241159e159c16f3a30eec'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:33.692211 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 822/1660] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:46:33.693617 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e732c-623c-4b47-8b13-38aaf7d61994 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:33.726930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e732c-623c-4b47-8b13-38aaf7d61994 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:33.737253 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c35344e2-817d-426a-bce4-0396007aabd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1dfa6d450a241159e159c16f3a30eec'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:33.738361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c35344e2-817d-426a-bce4-0396007aabd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1dfa6d450a241159e159c16f3a30eec'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:33.738980 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62271512-9ef5-41b2-a70a-c0d183d8b8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:33.740217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62271512-9ef5-41b2-a70a-c0d183d8b8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:33.740217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62271512-9ef5-41b2-a70a-c0d183d8b8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:33.740584 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62271512-9ef5-41b2-a70a-c0d183d8b8f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:33.741705 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62271512-9ef5-41b2-a70a-c0d183d8b8f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:46:33.742256 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62271512-9ef5-41b2-a70a-c0d183d8b8f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:33.746643 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62271512-9ef5-41b2-a70a-c0d183d8b8f7 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:33.773559 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 823/1661] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:46:33.778483 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62271512-9ef5-41b2-a70a-c0d183d8b8f7 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:33.782108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-62271512-9ef5-41b2-a70a-c0d183d8b8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:33.802187 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c35344e2-817d-426a-bce4-0396007aabd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1dfa6d450a241159e159c16f3a30eec'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:33.821630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62271512-9ef5-41b2-a70a-c0d183d8b8f7 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:33.822210 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c35344e2-817d-426a-bce4-0396007aabd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1dfa6d450a241159e159c16f3a30eec'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:33.836160 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 839/1662] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:46:33 2022] DELETE /identity/v3/users/e1dfa6d450a241159e159c16f3a30eec => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:46:33.842201 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79324a9-d8df-4024-ad59-f278c954a130 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:33.842306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79324a9-d8df-4024-ad59-f278c954a130 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:33.842540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79324a9-d8df-4024-ad59-f278c954a130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:33.850231 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb97c7-ce19-497f-8a40-d34a7ed884ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:33.852480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb97c7-ce19-497f-8a40-d34a7ed884ca admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:33.852859 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb97c7-ce19-497f-8a40-d34a7ed884ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:33.854551 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb97c7-ce19-497f-8a40-d34a7ed884ca admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:33.855707 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb97c7-ce19-497f-8a40-d34a7ed884ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:33.858144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb97c7-ce19-497f-8a40-d34a7ed884ca admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:33.901597 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-e79324a9-d8df-4024-ad59-f278c954a130 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:33.903032 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-e79324a9-d8df-4024-ad59-f278c954a130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:33.976165 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 824/1663] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:33 2022] POST /identity/v3/projects => generated 363 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:46:33.981022 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb97c7-ce19-497f-8a40-d34a7ed884ca admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:34.067630 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 840/1664] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:34.147587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb97c7-ce19-497f-8a40-d34a7ed884ca admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:34.161132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824250d-5426-4305-9102-b86b65df124e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:34.165024 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824250d-5426-4305-9102-b86b65df124e admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:34.166127 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824250d-5426-4305-9102-b86b65df124e admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:34.166733 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824250d-5426-4305-9102-b86b65df124e admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:34.169496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824250d-5426-4305-9102-b86b65df124e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:34.173730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824250d-5426-4305-9102-b86b65df124e admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:34.226525 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 825/1665] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:33 2022] POST /identity/v3/users => generated 282 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:46:34.231080 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79324a9-d8df-4024-ad59-f278c954a130 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:34.258336 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79324a9-d8df-4024-ad59-f278c954a130 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:34.277639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6a58c-9b5b-4227-88a2-4549d52cc491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:34.278594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6a58c-9b5b-4227-88a2-4549d52cc491 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:34.279012 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6a58c-9b5b-4227-88a2-4549d52cc491 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:34.282300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6a58c-9b5b-4227-88a2-4549d52cc491 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:34.283259 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6a58c-9b5b-4227-88a2-4549d52cc491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:34.285467 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6a58c-9b5b-4227-88a2-4549d52cc491 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:34.312648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824250d-5426-4305-9102-b86b65df124e admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:34.313709 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 841/1666] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:34.324646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6a58c-9b5b-4227-88a2-4549d52cc491 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:34.326571 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824250d-5426-4305-9102-b86b65df124e admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:34.331438 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-82b6a58c-9b5b-4227-88a2-4549d52cc491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:34.341313 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a91fca-9b78-48fb-8ff3-4b3e5f3868bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:34.351013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91fca-9b78-48fb-8ff3-4b3e5f3868bf admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:34.351692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91fca-9b78-48fb-8ff3-4b3e5f3868bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:34.353803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91fca-9b78-48fb-8ff3-4b3e5f3868bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:34.359319 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a91fca-9b78-48fb-8ff3-4b3e5f3868bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:34.364368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a91fca-9b78-48fb-8ff3-4b3e5f3868bf admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:34.405817 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 826/1667] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:34.412719 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a91fca-9b78-48fb-8ff3-4b3e5f3868bf admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:34.445534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a91fca-9b78-48fb-8ff3-4b3e5f3868bf admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:34.471090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36de9b-6be0-4feb-91e3-8043eac49f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:34.473089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36de9b-6be0-4feb-91e3-8043eac49f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:34.475114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36de9b-6be0-4feb-91e3-8043eac49f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:34.475404 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36de9b-6be0-4feb-91e3-8043eac49f8b admin admin] PATH_INFO: `/v3/projects/f8a3beff2018443092e3c1724768bd65/users/e24dab8b82a94065a87fb75421900fb8/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:34.539183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6a58c-9b5b-4227-88a2-4549d52cc491 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:34.540380 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36de9b-6be0-4feb-91e3-8043eac49f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a3beff2018443092e3c1724768bd65, user_id=e24dab8b82a94065a87fb75421900fb8, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:34.545315 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36de9b-6be0-4feb-91e3-8043eac49f8b admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:34.549766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69519a09-ee36-439e-b5e8-d5dc527e7f7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:34.550458 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519a09-ee36-439e-b5e8-d5dc527e7f7a service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:34.551541 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519a09-ee36-439e-b5e8-d5dc527e7f7a service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:34.551831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519a09-ee36-439e-b5e8-d5dc527e7f7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:34.582277 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 827/1668] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:34 2022] PUT /identity/v3/projects/f8a3beff2018443092e3c1724768bd65/users/e24dab8b82a94065a87fb75421900fb8/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:34.597099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb50746-e643-4d3f-bf89-aa58ffbfa45a None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:34.597751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb50746-e643-4d3f-bf89-aa58ffbfa45a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:34.597751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb50746-e643-4d3f-bf89-aa58ffbfa45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:34.600795 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69519a09-ee36-439e-b5e8-d5dc527e7f7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:34.602798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69519a09-ee36-439e-b5e8-d5dc527e7f7a service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:34.673505 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 842/1669] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:34.678397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69519a09-ee36-439e-b5e8-d5dc527e7f7a service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:34.686727 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-69519a09-ee36-439e-b5e8-d5dc527e7f7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:34.720326 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-deb50746-e643-4d3f-bf89-aa58ffbfa45a None None] MFA Rules not processed for user `e24dab8b82a94065a87fb75421900fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:34.721921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-deb50746-e643-4d3f-bf89-aa58ffbfa45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:34.731792 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69519a09-ee36-439e-b5e8-d5dc527e7f7a service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:34.897555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877aa994-bba1-449b-96fe-3d1b466e6203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:34.898515 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877aa994-bba1-449b-96fe-3d1b466e6203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:34.898855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877aa994-bba1-449b-96fe-3d1b466e6203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:34.899236 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877aa994-bba1-449b-96fe-3d1b466e6203 admin admin] PATH_INFO: `/v3/users/d4266ab809814a8aa0fae6819d448b25` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:34.902274 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877aa994-bba1-449b-96fe-3d1b466e6203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4266ab809814a8aa0fae6819d448b25)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:34.909232 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877aa994-bba1-449b-96fe-3d1b466e6203 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:34.992318 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 828/1670] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:34.994248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb50746-e643-4d3f-bf89-aa58ffbfa45a None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:35.021735 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb50746-e643-4d3f-bf89-aa58ffbfa45a None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:35.034443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17cedf-a7a4-4974-853c-c8da67b0c551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:35.038913 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17cedf-a7a4-4974-853c-c8da67b0c551 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:35.039262 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17cedf-a7a4-4974-853c-c8da67b0c551 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:35.039689 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17cedf-a7a4-4974-853c-c8da67b0c551 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:35.043723 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17cedf-a7a4-4974-853c-c8da67b0c551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:35.045692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17cedf-a7a4-4974-853c-c8da67b0c551 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:35.055474 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-877aa994-bba1-449b-96fe-3d1b466e6203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4266ab809814a8aa0fae6819d448b25'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:35.078949 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-877aa994-bba1-449b-96fe-3d1b466e6203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4266ab809814a8aa0fae6819d448b25'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:35.079897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-877aa994-bba1-449b-96fe-3d1b466e6203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4266ab809814a8aa0fae6819d448b25'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:35.091661 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 829/1671] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:34 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:35.097069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17cedf-a7a4-4974-853c-c8da67b0c551 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:35.103814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-877aa994-bba1-449b-96fe-3d1b466e6203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4266ab809814a8aa0fae6819d448b25'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:35.105265 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-6e17cedf-a7a4-4974-853c-c8da67b0c551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:35.117744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-877aa994-bba1-449b-96fe-3d1b466e6203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4266ab809814a8aa0fae6819d448b25'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:35.139598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 843/1672] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:46:34 2022] DELETE /identity/v3/users/d4266ab809814a8aa0fae6819d448b25 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:35.145726 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53020b-4595-48ba-8282-8d24fa6eaefb None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:35.146085 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53020b-4595-48ba-8282-8d24fa6eaefb None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:35.147254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53020b-4595-48ba-8282-8d24fa6eaefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:35.183711 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-cf53020b-4595-48ba-8282-8d24fa6eaefb None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:35.186821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-cf53020b-4595-48ba-8282-8d24fa6eaefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:35.259493 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17cedf-a7a4-4974-853c-c8da67b0c551 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:35.330865 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 844/1673] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:35.364114 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53020b-4595-48ba-8282-8d24fa6eaefb None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:35.366199 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-cf53020b-4595-48ba-8282-8d24fa6eaefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:35.420621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8ca36-8db5-4489-ad4d-ce48e2373da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:35.428753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8ca36-8db5-4489-ad4d-ce48e2373da0 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:35.432000 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8ca36-8db5-4489-ad4d-ce48e2373da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:35.432491 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8ca36-8db5-4489-ad4d-ce48e2373da0 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:35.433265 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8ca36-8db5-4489-ad4d-ce48e2373da0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:35.436777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8ca36-8db5-4489-ad4d-ce48e2373da0 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:35.516541 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 830/1674] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:35 2022] POST /identity/v3/users => generated 288 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:46:35.520915 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8ca36-8db5-4489-ad4d-ce48e2373da0 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:35.547578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53020b-4595-48ba-8282-8d24fa6eaefb None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:35.550582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8ca36-8db5-4489-ad4d-ce48e2373da0 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:35.557130 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcd518-6c4f-4d93-a35c-fee2eceb9c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:35.559127 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcd518-6c4f-4d93-a35c-fee2eceb9c5f service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:35.559927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ba0d1-dce4-45c7-9bd5-2fb1d9d5a4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:35.560397 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcd518-6c4f-4d93-a35c-fee2eceb9c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:35.560817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcd518-6c4f-4d93-a35c-fee2eceb9c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:35.561638 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ba0d1-dce4-45c7-9bd5-2fb1d9d5a4ed admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:35.563681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ba0d1-dce4-45c7-9bd5-2fb1d9d5a4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:35.564675 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ba0d1-dce4-45c7-9bd5-2fb1d9d5a4ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:35.566570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ba0d1-dce4-45c7-9bd5-2fb1d9d5a4ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:35.568408 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ba0d1-dce4-45c7-9bd5-2fb1d9d5a4ed admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:35.583426 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcd518-6c4f-4d93-a35c-fee2eceb9c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:35.587404 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcd518-6c4f-4d93-a35c-fee2eceb9c5f service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:35.600028 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 831/1675] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:35.607279 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ba0d1-dce4-45c7-9bd5-2fb1d9d5a4ed admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:35.631212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 845/1676] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:35.636721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ba0d1-dce4-45c7-9bd5-2fb1d9d5a4ed admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:35.643591 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afe3db-49c8-4d83-9bd3-a752955db135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:35.646622 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afe3db-49c8-4d83-9bd3-a752955db135 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:35.647120 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afe3db-49c8-4d83-9bd3-a752955db135 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:35.647537 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afe3db-49c8-4d83-9bd3-a752955db135 admin admin] PATH_INFO: `/v3/projects/7608a358d37d4dc8b6b34a93eb42a8be/users/a8aacc37acc748289192ce1bb58d3938/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:35.700431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afe3db-49c8-4d83-9bd3-a752955db135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7608a358d37d4dc8b6b34a93eb42a8be, user_id=a8aacc37acc748289192ce1bb58d3938, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:35.704181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afe3db-49c8-4d83-9bd3-a752955db135 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:35.725826 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 832/1677] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:35 2022] PUT /identity/v3/projects/7608a358d37d4dc8b6b34a93eb42a8be/users/a8aacc37acc748289192ce1bb58d3938/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:46:35.730702 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcd518-6c4f-4d93-a35c-fee2eceb9c5f service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:35.754071 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcd518-6c4f-4d93-a35c-fee2eceb9c5f service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:35.857334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61aa4a5-51f0-44ab-b716-99973f30ef45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:35.858261 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61aa4a5-51f0-44ab-b716-99973f30ef45 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:35.861688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61aa4a5-51f0-44ab-b716-99973f30ef45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:35.863640 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61aa4a5-51f0-44ab-b716-99973f30ef45 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:35.866693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61aa4a5-51f0-44ab-b716-99973f30ef45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:35.868755 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61aa4a5-51f0-44ab-b716-99973f30ef45 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:35.896689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 846/1678] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:35.901228 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afe3db-49c8-4d83-9bd3-a752955db135 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:35.916424 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afe3db-49c8-4d83-9bd3-a752955db135 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:35.923373 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8553a-d88c-44ed-8ea7-339b58129ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:35.924554 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8553a-d88c-44ed-8ea7-339b58129ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:35.928910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8553a-d88c-44ed-8ea7-339b58129ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:35.929544 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8553a-d88c-44ed-8ea7-339b58129ff9 admin admin] PATH_INFO: `/v3/projects/7608a358d37d4dc8b6b34a93eb42a8be/users/a8aacc37acc748289192ce1bb58d3938/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:35.932389 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8553a-d88c-44ed-8ea7-339b58129ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7608a358d37d4dc8b6b34a93eb42a8be, user_id=a8aacc37acc748289192ce1bb58d3938, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:35.945079 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8553a-d88c-44ed-8ea7-339b58129ff9 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:35.977579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 833/1679] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:35 2022] PUT /identity/v3/projects/7608a358d37d4dc8b6b34a93eb42a8be/users/a8aacc37acc748289192ce1bb58d3938/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:46:35.988778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79217134-f616-4275-afdd-72df8b8f8461 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:35.989245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79217134-f616-4275-afdd-72df8b8f8461 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:35.989690 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79217134-f616-4275-afdd-72df8b8f8461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:36.034402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-79217134-f616-4275-afdd-72df8b8f8461 None None] MFA Rules not processed for user `a8aacc37acc748289192ce1bb58d3938`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:36.036094 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-79217134-f616-4275-afdd-72df8b8f8461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:36.171255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 847/1680] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:35 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:36.191357 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8553a-d88c-44ed-8ea7-339b58129ff9 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:36.195957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a0d8553a-d88c-44ed-8ea7-339b58129ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:36.335019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79217134-f616-4275-afdd-72df8b8f8461 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:36.340764 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-79217134-f616-4275-afdd-72df8b8f8461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:36.348737 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8553a-d88c-44ed-8ea7-339b58129ff9 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:36.360754 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c09bf3-0e23-4f29-851d-314a13861ea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:36.362083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c09bf3-0e23-4f29-851d-314a13861ea4 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:36.362474 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c09bf3-0e23-4f29-851d-314a13861ea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:36.363172 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c09bf3-0e23-4f29-851d-314a13861ea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:36.392323 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c09bf3-0e23-4f29-851d-314a13861ea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:36.394974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c09bf3-0e23-4f29-851d-314a13861ea4 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:36.457915 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 834/1681] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:36 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:36.895315 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79217134-f616-4275-afdd-72df8b8f8461 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:36.904268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc0bf1-cdda-4a19-a6d6-c1aaca109e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:36.905094 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc0bf1-cdda-4a19-a6d6-c1aaca109e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:36.905375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc0bf1-cdda-4a19-a6d6-c1aaca109e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:36.908899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc0bf1-cdda-4a19-a6d6-c1aaca109e48 admin admin] PATH_INFO: `/v3/projects/0abe3a61487a46b3bc87d7c47f80765d` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:36.912053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc0bf1-cdda-4a19-a6d6-c1aaca109e48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0abe3a61487a46b3bc87d7c47f80765d)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:36.916895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc0bf1-cdda-4a19-a6d6-c1aaca109e48 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:37.023312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c09bf3-0e23-4f29-851d-314a13861ea4 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:37.024986 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c8c09bf3-0e23-4f29-851d-314a13861ea4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:37.041723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-65cc0bf1-cdda-4a19-a6d6-c1aaca109e48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0abe3a61487a46b3bc87d7c47f80765d', 'request_id': 'req-65cc0bf1-cdda-4a19-a6d6-c1aaca109e48'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:37.053337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c09bf3-0e23-4f29-851d-314a13861ea4 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:37.056843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-65cc0bf1-cdda-4a19-a6d6-c1aaca109e48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0abe3a61487a46b3bc87d7c47f80765d', 'request_id': 'req-65cc0bf1-cdda-4a19-a6d6-c1aaca109e48'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:37.068226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-65cc0bf1-cdda-4a19-a6d6-c1aaca109e48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0abe3a61487a46b3bc87d7c47f80765d', 'request_id': 'req-65cc0bf1-cdda-4a19-a6d6-c1aaca109e48'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:37.081571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-65cc0bf1-cdda-4a19-a6d6-c1aaca109e48 admin admin] The token cache is being invalidate because project 0abe3a61487a46b3bc87d7c47f80765d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:46:37.081730 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-65cc0bf1-cdda-4a19-a6d6-c1aaca109e48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:37.082466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-65cc0bf1-cdda-4a19-a6d6-c1aaca109e48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:37.084629 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 848/1682] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:46:36 2022] DELETE /identity/v3/projects/0abe3a61487a46b3bc87d7c47f80765d => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:37.090509 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d766b9-8457-49a6-8a89-00a022413a98 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:37.090761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d766b9-8457-49a6-8a89-00a022413a98 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:37.091593 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d766b9-8457-49a6-8a89-00a022413a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:37.120847 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-21d766b9-8457-49a6-8a89-00a022413a98 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:37.122485 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-21d766b9-8457-49a6-8a89-00a022413a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:37.224223 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd70875-3ef3-4d26-86a1-914d71b62c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:37.225158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd70875-3ef3-4d26-86a1-914d71b62c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:37.225444 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd70875-3ef3-4d26-86a1-914d71b62c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:37.225860 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd70875-3ef3-4d26-86a1-914d71b62c46 admin admin] PATH_INFO: `/v3/projects/11a325235325487fa356fd7d6597e5b4` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:37.228346 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd70875-3ef3-4d26-86a1-914d71b62c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11a325235325487fa356fd7d6597e5b4)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:37.230405 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd70875-3ef3-4d26-86a1-914d71b62c46 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:37.284233 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 849/1683] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:37.285338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d766b9-8457-49a6-8a89-00a022413a98 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:37.290617 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-21d766b9-8457-49a6-8a89-00a022413a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:37.323824 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d766b9-8457-49a6-8a89-00a022413a98 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:37.330769 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8dd70875-3ef3-4d26-86a1-914d71b62c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a325235325487fa356fd7d6597e5b4', 'request_id': 'req-8dd70875-3ef3-4d26-86a1-914d71b62c46'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:37.352408 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8dd70875-3ef3-4d26-86a1-914d71b62c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a325235325487fa356fd7d6597e5b4', 'request_id': 'req-8dd70875-3ef3-4d26-86a1-914d71b62c46'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:37.375405 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8dd70875-3ef3-4d26-86a1-914d71b62c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a325235325487fa356fd7d6597e5b4', 'request_id': 'req-8dd70875-3ef3-4d26-86a1-914d71b62c46'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:37.393886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8dd70875-3ef3-4d26-86a1-914d71b62c46 admin admin] The token cache is being invalidate because project 11a325235325487fa356fd7d6597e5b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:46:37.394411 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8dd70875-3ef3-4d26-86a1-914d71b62c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:37.395307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8dd70875-3ef3-4d26-86a1-914d71b62c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:37.399231 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 835/1684] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:46:37 2022] DELETE /identity/v3/projects/11a325235325487fa356fd7d6597e5b4 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:46:37.400999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5813f-611f-4533-a848-a7a3f692aa51 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:37.403664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5813f-611f-4533-a848-a7a3f692aa51 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:37.404193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5813f-611f-4533-a848-a7a3f692aa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:37.443521 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-f0b5813f-611f-4533-a848-a7a3f692aa51 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:37.445092 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f0b5813f-611f-4533-a848-a7a3f692aa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:37.468657 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335853ff-84dd-4322-af6f-8a99b9066020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:37.469911 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335853ff-84dd-4322-af6f-8a99b9066020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:37.470204 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335853ff-84dd-4322-af6f-8a99b9066020 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:37.470474 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335853ff-84dd-4322-af6f-8a99b9066020 admin admin] PATH_INFO: `/v3/users/e24dab8b82a94065a87fb75421900fb8` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:37.478824 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335853ff-84dd-4322-af6f-8a99b9066020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24dab8b82a94065a87fb75421900fb8)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:37.481678 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335853ff-84dd-4322-af6f-8a99b9066020 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:37.609657 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-335853ff-84dd-4322-af6f-8a99b9066020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24dab8b82a94065a87fb75421900fb8'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:37.616642 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-335853ff-84dd-4322-af6f-8a99b9066020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24dab8b82a94065a87fb75421900fb8'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:37.617311 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-335853ff-84dd-4322-af6f-8a99b9066020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24dab8b82a94065a87fb75421900fb8'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:37.619501 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 836/1685] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:37.620682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5813f-611f-4533-a848-a7a3f692aa51 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:37.626526 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f0b5813f-611f-4533-a848-a7a3f692aa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:37.640486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-335853ff-84dd-4322-af6f-8a99b9066020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24dab8b82a94065a87fb75421900fb8'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:37.657339 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-335853ff-84dd-4322-af6f-8a99b9066020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24dab8b82a94065a87fb75421900fb8'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:37.660863 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5813f-611f-4533-a848-a7a3f692aa51 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:37.668434 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 850/1686] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:46:37 2022] DELETE /identity/v3/users/e24dab8b82a94065a87fb75421900fb8 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:37.669568 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335853ff-84dd-4322-af6f-8a99b9066020 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:37.671027 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-335853ff-84dd-4322-af6f-8a99b9066020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:37.681878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3ffbc-e3f4-44f7-b584-3b4f61bf0ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:37.684015 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3ffbc-e3f4-44f7-b584-3b4f61bf0ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:37.685571 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3ffbc-e3f4-44f7-b584-3b4f61bf0ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:37.686403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3ffbc-e3f4-44f7-b584-3b4f61bf0ff5 admin admin] PATH_INFO: `/v3/users/6bf0c5e8a4ec412a88d94f2eabdfc78c` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:37.689260 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3ffbc-e3f4-44f7-b584-3b4f61bf0ff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf0c5e8a4ec412a88d94f2eabdfc78c)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:37.696636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3ffbc-e3f4-44f7-b584-3b4f61bf0ff5 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:37.803056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335853ff-84dd-4322-af6f-8a99b9066020 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:37.812958 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-eed3ffbc-e3f4-44f7-b584-3b4f61bf0ff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf0c5e8a4ec412a88d94f2eabdfc78c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:37.821413 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73ec8-78cc-493b-bc1f-672e2634b5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:37.823402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73ec8-78cc-493b-bc1f-672e2634b5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:37.823725 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73ec8-78cc-493b-bc1f-672e2634b5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:37.823974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73ec8-78cc-493b-bc1f-672e2634b5f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:37.824743 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f73ec8-78cc-493b-bc1f-672e2634b5f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:46:37.828988 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-eed3ffbc-e3f4-44f7-b584-3b4f61bf0ff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf0c5e8a4ec412a88d94f2eabdfc78c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:37.830629 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f73ec8-78cc-493b-bc1f-672e2634b5f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:37.835790 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f73ec8-78cc-493b-bc1f-672e2634b5f4 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:37.839834 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-eed3ffbc-e3f4-44f7-b584-3b4f61bf0ff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf0c5e8a4ec412a88d94f2eabdfc78c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:37.840875 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-eed3ffbc-e3f4-44f7-b584-3b4f61bf0ff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf0c5e8a4ec412a88d94f2eabdfc78c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:37.842454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-eed3ffbc-e3f4-44f7-b584-3b4f61bf0ff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf0c5e8a4ec412a88d94f2eabdfc78c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:37.883360 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 837/1687] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:46:37 2022] DELETE /identity/v3/users/6bf0c5e8a4ec412a88d94f2eabdfc78c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:37.885278 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927aa2b-2f5d-4f98-997c-3a00fda3c87b None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:37.885759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927aa2b-2f5d-4f98-997c-3a00fda3c87b None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:37.886160 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927aa2b-2f5d-4f98-997c-3a00fda3c87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:37.890868 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 851/1688] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:46:37.891874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73ec8-78cc-493b-bc1f-672e2634b5f4 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:37.904192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-02f73ec8-78cc-493b-bc1f-672e2634b5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:37.913292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-5927aa2b-2f5d-4f98-997c-3a00fda3c87b None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:37.916201 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-5927aa2b-2f5d-4f98-997c-3a00fda3c87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:37.972888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73ec8-78cc-493b-bc1f-672e2634b5f4 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:38.007577 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 838/1689] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:38.034942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e9f8d-9df2-4cb3-a1e0-3a53248371df None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:38.036687 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e9f8d-9df2-4cb3-a1e0-3a53248371df None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:38.037185 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e9f8d-9df2-4cb3-a1e0-3a53248371df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:38.079329 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-e71e9f8d-9df2-4cb3-a1e0-3a53248371df None None] MFA Rules not processed for user `49618ca42d8d43a4ac419c352f7d0042`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:38.083902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e71e9f8d-9df2-4cb3-a1e0-3a53248371df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:38.202202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25a5fc-8f41-4f6a-8a35-fde567297dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:38.202407 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a5fc-8f41-4f6a-8a35-fde567297dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:38.202692 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a5fc-8f41-4f6a-8a35-fde567297dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:38.202919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a5fc-8f41-4f6a-8a35-fde567297dd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:38.203671 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25a5fc-8f41-4f6a-8a35-fde567297dd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:38.206191 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25a5fc-8f41-4f6a-8a35-fde567297dd7 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:38.230792 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 839/1690] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:46:38.230792 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e9f8d-9df2-4cb3-a1e0-3a53248371df None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:38.230792 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e71e9f8d-9df2-4cb3-a1e0-3a53248371df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:38.306195 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 852/1691] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:37 2022] POST /identity/v3/projects => generated 385 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:38.307341 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25a5fc-8f41-4f6a-8a35-fde567297dd7 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:38.312040 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-1d25a5fc-8f41-4f6a-8a35-fde567297dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:38.338813 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e9f8d-9df2-4cb3-a1e0-3a53248371df None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:38.463269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f5323-b89c-4ed5-b69a-67b06393d50f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:38.463933 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f5323-b89c-4ed5-b69a-67b06393d50f service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:38.464215 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f5323-b89c-4ed5-b69a-67b06393d50f service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:38.464491 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f5323-b89c-4ed5-b69a-67b06393d50f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:38.525350 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25a5fc-8f41-4f6a-8a35-fde567297dd7 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:38.534373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a7f2a-db20-4380-a9ed-3417e0a8f16f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:38.535633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a7f2a-db20-4380-a9ed-3417e0a8f16f service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:38.536634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a7f2a-db20-4380-a9ed-3417e0a8f16f service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:38.537065 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a7f2a-db20-4380-a9ed-3417e0a8f16f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:38.585869 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f5323-b89c-4ed5-b69a-67b06393d50f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:38.586055 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f5323-b89c-4ed5-b69a-67b06393d50f service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:38.613387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 840/1692] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:38.614340 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f5323-b89c-4ed5-b69a-67b06393d50f service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:38.630401 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f5323-b89c-4ed5-b69a-67b06393d50f service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:38.636666 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45870b8d-1108-49f5-abd8-1a7df3ecec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:38.637359 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45870b8d-1108-49f5-abd8-1a7df3ecec73 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:38.637695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45870b8d-1108-49f5-abd8-1a7df3ecec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:38.637971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45870b8d-1108-49f5-abd8-1a7df3ecec73 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:38.638609 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45870b8d-1108-49f5-abd8-1a7df3ecec73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:38.640834 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45870b8d-1108-49f5-abd8-1a7df3ecec73 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:38.683098 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 841/1693] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:38 2022] POST /identity/v3/users => generated 293 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:38.684495 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057cd9b-9cec-4525-9ca9-37669847fcbf None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:38.684676 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057cd9b-9cec-4525-9ca9-37669847fcbf None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:38.684970 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057cd9b-9cec-4525-9ca9-37669847fcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:38.697350 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a7f2a-db20-4380-a9ed-3417e0a8f16f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:38.699011 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a7f2a-db20-4380-a9ed-3417e0a8f16f service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:38.723671 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-a057cd9b-9cec-4525-9ca9-37669847fcbf None None] MFA Rules not processed for user `2bf26e013e10482fae90fd291b1b90b2`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:38.724900 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a057cd9b-9cec-4525-9ca9-37669847fcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:38.726429 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 853/1694] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:38.736998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf2ba0-4b7f-4fc0-ad60-34578ee34b4b None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:38.736998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf2ba0-4b7f-4fc0-ad60-34578ee34b4b None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:38.737187 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf2ba0-4b7f-4fc0-ad60-34578ee34b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:38.785455 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-9edf2ba0-4b7f-4fc0-ad60-34578ee34b4b None None] MFA Rules not processed for user `82b2e79995f94ab880f5d798ddd649b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:38.785455 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-9edf2ba0-4b7f-4fc0-ad60-34578ee34b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:38.870249 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 842/1695] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:38.873384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057cd9b-9cec-4525-9ca9-37669847fcbf None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:38.900513 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057cd9b-9cec-4525-9ca9-37669847fcbf None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:38.912318 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63b769-82dc-4226-a8bd-ee6788abb6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:38.913152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63b769-82dc-4226-a8bd-ee6788abb6cc admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:38.913499 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63b769-82dc-4226-a8bd-ee6788abb6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:38.913767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63b769-82dc-4226-a8bd-ee6788abb6cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:38.915996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63b769-82dc-4226-a8bd-ee6788abb6cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:38.919483 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63b769-82dc-4226-a8bd-ee6788abb6cc admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:38.953506 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 843/1696] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:38.954438 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63b769-82dc-4226-a8bd-ee6788abb6cc admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:38.960434 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-1a63b769-82dc-4226-a8bd-ee6788abb6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:38.975067 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 854/1697] 10.222.0.11 () {58 vars in 1009 bytes} [Wed May 4 21:46:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:38.976090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf2ba0-4b7f-4fc0-ad60-34578ee34b4b None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:38.994042 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63b769-82dc-4226-a8bd-ee6788abb6cc admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:38.997837 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf2ba0-4b7f-4fc0-ad60-34578ee34b4b None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:39.002200 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e18f75-cd95-40c9-8847-15e0222ca167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:39.003614 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e18f75-cd95-40c9-8847-15e0222ca167 service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:39.007479 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e18f75-cd95-40c9-8847-15e0222ca167 service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:39.007747 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e18f75-cd95-40c9-8847-15e0222ca167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:39.010865 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb997d-80a3-4909-b691-cad453050337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:39.011605 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb997d-80a3-4909-b691-cad453050337 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:39.011968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb997d-80a3-4909-b691-cad453050337 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:39.012524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb997d-80a3-4909-b691-cad453050337 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:39.013406 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb997d-80a3-4909-b691-cad453050337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:39.014826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb997d-80a3-4909-b691-cad453050337 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:39.026987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e18f75-cd95-40c9-8847-15e0222ca167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:39.028671 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e18f75-cd95-40c9-8847-15e0222ca167 service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:39.037028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 855/1698] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:39.047428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb997d-80a3-4909-b691-cad453050337 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:39.049267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 844/1699] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:39.081687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb997d-80a3-4909-b691-cad453050337 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:39.083272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e18f75-cd95-40c9-8847-15e0222ca167 service nova] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:39.085474 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-54e18f75-cd95-40c9-8847-15e0222ca167 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:39.108490 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57db17d-3dfa-46fd-a298-4bfa1daeebb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:39.109665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57db17d-3dfa-46fd-a298-4bfa1daeebb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:39.110164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57db17d-3dfa-46fd-a298-4bfa1daeebb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:39.110652 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57db17d-3dfa-46fd-a298-4bfa1daeebb0 admin admin] PATH_INFO: `/v3/projects/f9e782fc2fa541b3951cb5a26b1c47f3/users/ccced023aee046588c571d42f9c19685/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:39.122294 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e18f75-cd95-40c9-8847-15e0222ca167 service nova] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:39.134587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8eef57-1e9d-4d70-834a-6328d297dda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:39.135553 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8eef57-1e9d-4d70-834a-6328d297dda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:39.135832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8eef57-1e9d-4d70-834a-6328d297dda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:39.136103 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8eef57-1e9d-4d70-834a-6328d297dda1 admin admin] PATH_INFO: `/v3/projects/af251ed945424487931aa58d2ea58f15` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:39.137305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8eef57-1e9d-4d70-834a-6328d297dda1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af251ed945424487931aa58d2ea58f15)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:39.142073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8eef57-1e9d-4d70-834a-6328d297dda1 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:39.146781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57db17d-3dfa-46fd-a298-4bfa1daeebb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e782fc2fa541b3951cb5a26b1c47f3, user_id=ccced023aee046588c571d42f9c19685, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:39.150686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57db17d-3dfa-46fd-a298-4bfa1daeebb0 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:39.177246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 856/1700] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:39 2022] PUT /identity/v3/projects/f9e782fc2fa541b3951cb5a26b1c47f3/users/ccced023aee046588c571d42f9c19685/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:39.188727 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351d6d5-d117-4425-a77c-912e697166d1 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:39.189291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351d6d5-d117-4425-a77c-912e697166d1 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:39.189765 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351d6d5-d117-4425-a77c-912e697166d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:39.266656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-1351d6d5-d117-4425-a77c-912e697166d1 None None] MFA Rules not processed for user `ccced023aee046588c571d42f9c19685`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:39.268260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-1351d6d5-d117-4425-a77c-912e697166d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:39.306294 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5f8eef57-1e9d-4d70-834a-6328d297dda1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af251ed945424487931aa58d2ea58f15', 'request_id': 'req-5f8eef57-1e9d-4d70-834a-6328d297dda1'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:39.328196 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5f8eef57-1e9d-4d70-834a-6328d297dda1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af251ed945424487931aa58d2ea58f15', 'request_id': 'req-5f8eef57-1e9d-4d70-834a-6328d297dda1'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:39.344537 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5f8eef57-1e9d-4d70-834a-6328d297dda1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af251ed945424487931aa58d2ea58f15', 'request_id': 'req-5f8eef57-1e9d-4d70-834a-6328d297dda1'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:39.373946 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5f8eef57-1e9d-4d70-834a-6328d297dda1 admin admin] The token cache is being invalidate because project af251ed945424487931aa58d2ea58f15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:46:39.374616 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5f8eef57-1e9d-4d70-834a-6328d297dda1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:39.375563 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5f8eef57-1e9d-4d70-834a-6328d297dda1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:39.379534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 845/1701] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:46:39 2022] DELETE /identity/v3/projects/af251ed945424487931aa58d2ea58f15 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:46:39.385185 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b542cb-8470-4136-bc12-635aedb839a7 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:39.385740 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b542cb-8470-4136-bc12-635aedb839a7 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:39.386262 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b542cb-8470-4136-bc12-635aedb839a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:39.421342 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 857/1702] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:46:39.422323 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351d6d5-d117-4425-a77c-912e697166d1 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:39.425888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-1351d6d5-d117-4425-a77c-912e697166d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:39.428196 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-e7b542cb-8470-4136-bc12-635aedb839a7 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:39.429590 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e7b542cb-8470-4136-bc12-635aedb839a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:39.571512 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351d6d5-d117-4425-a77c-912e697166d1 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:39.585709 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d305c-4d27-470c-9f2f-cbcb4389380e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8358da535a104873ad9f5676989a9e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:39.586779 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d305c-4d27-470c-9f2f-cbcb4389380e service swift] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:39.587519 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d305c-4d27-470c-9f2f-cbcb4389380e service swift] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:39.588341 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d305c-4d27-470c-9f2f-cbcb4389380e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:39.604337 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-673d305c-4d27-470c-9f2f-cbcb4389380e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:39.657320 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 846/1703] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:39.665222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b542cb-8470-4136-bc12-635aedb839a7 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:39.667327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e7b542cb-8470-4136-bc12-635aedb839a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:39.681680 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b542cb-8470-4136-bc12-635aedb839a7 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:39.689996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f35957-fc79-491f-9e9b-72031d1ee7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:39.690931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f35957-fc79-491f-9e9b-72031d1ee7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:39.691504 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f35957-fc79-491f-9e9b-72031d1ee7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:39.692163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f35957-fc79-491f-9e9b-72031d1ee7f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:39.693169 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f35957-fc79-491f-9e9b-72031d1ee7f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:39.698042 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f35957-fc79-491f-9e9b-72031d1ee7f8 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:39.765233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 847/1704] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:39 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:39.767761 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0015a87-2fa4-4fad-ab2e-0d703bd1e230 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:39.768593 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0015a87-2fa4-4fad-ab2e-0d703bd1e230 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:39.771711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0015a87-2fa4-4fad-ab2e-0d703bd1e230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:39.797098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d305c-4d27-470c-9f2f-cbcb4389380e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:39.801551 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d305c-4d27-470c-9f2f-cbcb4389380e service swift] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:39.818533 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-c0015a87-2fa4-4fad-ab2e-0d703bd1e230 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:39.820703 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c0015a87-2fa4-4fad-ab2e-0d703bd1e230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:39.829094 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 858/1705] 10.222.0.11 () {60 vars in 1384 bytes} [Wed May 4 21:46:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:46:39.830817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d305c-4d27-470c-9f2f-cbcb4389380e service swift] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:39.858517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d305c-4d27-470c-9f2f-cbcb4389380e service swift] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:40.078061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1690c7-16af-4b48-bf6b-b04ad5e1a433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:40.079246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1690c7-16af-4b48-bf6b-b04ad5e1a433 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:40.081951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1690c7-16af-4b48-bf6b-b04ad5e1a433 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:40.084578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1690c7-16af-4b48-bf6b-b04ad5e1a433 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:40.085751 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1690c7-16af-4b48-bf6b-b04ad5e1a433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:40.103889 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1690c7-16af-4b48-bf6b-b04ad5e1a433 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:40.162701 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 848/1706] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:40.164175 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0015a87-2fa4-4fad-ab2e-0d703bd1e230 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:40.179232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0015a87-2fa4-4fad-ab2e-0d703bd1e230 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:40.197060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f3075-a29e-4160-ad38-2d207e0e441c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:40.197811 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 859/1707] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:39 2022] POST /identity/v3/users => generated 299 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:40.198207 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f3075-a29e-4160-ad38-2d207e0e441c admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:40.198624 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f3075-a29e-4160-ad38-2d207e0e441c admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:40.199239 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f3075-a29e-4160-ad38-2d207e0e441c admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:40.212905 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1690c7-16af-4b48-bf6b-b04ad5e1a433 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:40.217915 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f3075-a29e-4160-ad38-2d207e0e441c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:46:40.220271 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f3075-a29e-4160-ad38-2d207e0e441c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:40.232229 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f3075-a29e-4160-ad38-2d207e0e441c admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:40.258354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1690c7-16af-4b48-bf6b-b04ad5e1a433 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:40.280093 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91f3d5-67ac-4099-88cc-9b2137fc482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:40.281264 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91f3d5-67ac-4099-88cc-9b2137fc482f admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:40.287472 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 849/1708] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:46:40.288021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91f3d5-67ac-4099-88cc-9b2137fc482f admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:40.289562 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91f3d5-67ac-4099-88cc-9b2137fc482f admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:40.290376 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f3075-a29e-4160-ad38-2d207e0e441c admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:40.292535 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91f3d5-67ac-4099-88cc-9b2137fc482f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:40.296249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91f3d5-67ac-4099-88cc-9b2137fc482f admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:40.320549 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f3075-a29e-4160-ad38-2d207e0e441c admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:40.333166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 860/1709] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:40.337499 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394b698-e772-42dc-934a-974981dc97f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:40.339581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91f3d5-67ac-4099-88cc-9b2137fc482f admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:40.340317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394b698-e772-42dc-934a-974981dc97f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:40.341302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394b698-e772-42dc-934a-974981dc97f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:40.342618 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394b698-e772-42dc-934a-974981dc97f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:40.343675 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394b698-e772-42dc-934a-974981dc97f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:40.352386 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394b698-e772-42dc-934a-974981dc97f5 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:40.370706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91f3d5-67ac-4099-88cc-9b2137fc482f admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:40.387278 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2601ba-5264-4a1f-a740-0a808eb74815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:40.391782 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2601ba-5264-4a1f-a740-0a808eb74815 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:40.392240 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2601ba-5264-4a1f-a740-0a808eb74815 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:40.393366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2601ba-5264-4a1f-a740-0a808eb74815 admin admin] PATH_INFO: `/v3/projects/25f1a45f503e43118c0a738d1c73f4a6/users/af416ab8cfe94ae3b905d5fa2364f5d1/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:40.439498 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 850/1710] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:40 2022] POST /identity/v3/projects => generated 369 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:40.440876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394b698-e772-42dc-934a-974981dc97f5 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:40.447844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2601ba-5264-4a1f-a740-0a808eb74815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f1a45f503e43118c0a738d1c73f4a6, user_id=af416ab8cfe94ae3b905d5fa2364f5d1, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:40.458726 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2601ba-5264-4a1f-a740-0a808eb74815 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:40.516457 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 861/1711] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:40 2022] PUT /identity/v3/projects/25f1a45f503e43118c0a738d1c73f4a6/users/af416ab8cfe94ae3b905d5fa2364f5d1/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:40.520954 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2601ba-5264-4a1f-a740-0a808eb74815 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:40.747976 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394b698-e772-42dc-934a-974981dc97f5 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:40.823522 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2601ba-5264-4a1f-a740-0a808eb74815 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:40.843120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9bd44-cdb9-4363-a893-a368fdf959b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:40.844530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9bd44-cdb9-4363-a893-a368fdf959b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:40.844978 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9bd44-cdb9-4363-a893-a368fdf959b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:40.845425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9bd44-cdb9-4363-a893-a368fdf959b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:40.847569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9bd44-cdb9-4363-a893-a368fdf959b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:40.852643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9bd44-cdb9-4363-a893-a368fdf959b2 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:40.865542 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 862/1712] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:40.874293 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9bd44-cdb9-4363-a893-a368fdf959b2 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:40.926952 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35b07e-94fd-4848-92f4-a0201d7610f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:40.931147 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35b07e-94fd-4848-92f4-a0201d7610f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:40.932864 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35b07e-94fd-4848-92f4-a0201d7610f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:40.933332 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35b07e-94fd-4848-92f4-a0201d7610f7 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:40.934175 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35b07e-94fd-4848-92f4-a0201d7610f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:40.940335 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35b07e-94fd-4848-92f4-a0201d7610f7 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:40.944976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9bd44-cdb9-4363-a893-a368fdf959b2 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:40.984312 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd4181-a600-484a-b7b5-f8633d67d28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:40.986047 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd4181-a600-484a-b7b5-f8633d67d28f admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:40.986535 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd4181-a600-484a-b7b5-f8633d67d28f admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:40.991375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 851/1713] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:40 2022] POST /identity/v3/users => generated 285 bytes in 551 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:40.992181 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd4181-a600-484a-b7b5-f8633d67d28f admin admin] PATH_INFO: `/v3/projects/25f1a45f503e43118c0a738d1c73f4a6/users/af416ab8cfe94ae3b905d5fa2364f5d1/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:41.002482 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd4181-a600-484a-b7b5-f8633d67d28f admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f1a45f503e43118c0a738d1c73f4a6, user_id=af416ab8cfe94ae3b905d5fa2364f5d1, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:41.002654 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35b07e-94fd-4848-92f4-a0201d7610f7 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:41.007343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd4181-a600-484a-b7b5-f8633d67d28f admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:41.044924 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35b07e-94fd-4848-92f4-a0201d7610f7 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:41.068721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2052d-57ca-4793-9ea8-0a7f601714e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:41.073612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2052d-57ca-4793-9ea8-0a7f601714e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:41.076036 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2052d-57ca-4793-9ea8-0a7f601714e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:41.077088 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2052d-57ca-4793-9ea8-0a7f601714e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:41.085979 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2052d-57ca-4793-9ea8-0a7f601714e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:41.088120 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2052d-57ca-4793-9ea8-0a7f601714e7 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:41.091205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 863/1714] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:40 2022] PUT /identity/v3/projects/25f1a45f503e43118c0a738d1c73f4a6/users/af416ab8cfe94ae3b905d5fa2364f5d1/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:41.106356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d5b00-e008-4d19-8dac-e56b39a20e7d None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:41.108609 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d5b00-e008-4d19-8dac-e56b39a20e7d None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:41.109218 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d5b00-e008-4d19-8dac-e56b39a20e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:41.134732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 852/1715] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:41.138535 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2052d-57ca-4793-9ea8-0a7f601714e7 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:41.163466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2052d-57ca-4793-9ea8-0a7f601714e7 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:41.227635 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-089d5b00-e008-4d19-8dac-e56b39a20e7d None None] MFA Rules not processed for user `af416ab8cfe94ae3b905d5fa2364f5d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:41.229882 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-089d5b00-e008-4d19-8dac-e56b39a20e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:41.302786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ab13d-21e6-455b-ab97-6f89fee256b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:41.304074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ab13d-21e6-455b-ab97-6f89fee256b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:41.304509 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ab13d-21e6-455b-ab97-6f89fee256b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:41.305118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ab13d-21e6-455b-ab97-6f89fee256b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:41.306245 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ab13d-21e6-455b-ab97-6f89fee256b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:41.311818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ab13d-21e6-455b-ab97-6f89fee256b1 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:41.337239 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 853/1716] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:46:41.341155 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ab13d-21e6-455b-ab97-6f89fee256b1 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:41.363699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ab13d-21e6-455b-ab97-6f89fee256b1 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:41.375983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413a590-acb8-4d40-a4f8-e465250e71e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:41.377833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413a590-acb8-4d40-a4f8-e465250e71e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:41.380237 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413a590-acb8-4d40-a4f8-e465250e71e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:41.380779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413a590-acb8-4d40-a4f8-e465250e71e1 admin admin] PATH_INFO: `/v3/projects/598582fd35064ff9acabce9c861d39e4/users/abc856d35fd84ef487cb9ec0f2a56d40/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:41.436771 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413a590-acb8-4d40-a4f8-e465250e71e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=598582fd35064ff9acabce9c861d39e4, user_id=abc856d35fd84ef487cb9ec0f2a56d40, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:41.444340 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413a590-acb8-4d40-a4f8-e465250e71e1 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:41.481102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 854/1717] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:41 2022] PUT /identity/v3/projects/598582fd35064ff9acabce9c861d39e4/users/abc856d35fd84ef487cb9ec0f2a56d40/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:41.491723 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7e559-49ae-40ec-95bf-0525ea495d5c None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:41.492351 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7e559-49ae-40ec-95bf-0525ea495d5c None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:41.492877 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7e559-49ae-40ec-95bf-0525ea495d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:41.569490 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 864/1718] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:41.582342 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d5b00-e008-4d19-8dac-e56b39a20e7d None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:41.585928 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-089d5b00-e008-4d19-8dac-e56b39a20e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:41.615849 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-73d7e559-49ae-40ec-95bf-0525ea495d5c None None] MFA Rules not processed for user `abc856d35fd84ef487cb9ec0f2a56d40`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:41.621786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-73d7e559-49ae-40ec-95bf-0525ea495d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:41.847591 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d5b00-e008-4d19-8dac-e56b39a20e7d None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:41.903524 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 855/1719] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:46:41.907865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7e559-49ae-40ec-95bf-0525ea495d5c None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:42.085081 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13ad25-99d3-4026-b95f-5cba36dc3566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:42.087845 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13ad25-99d3-4026-b95f-5cba36dc3566 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:42.091398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13ad25-99d3-4026-b95f-5cba36dc3566 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:42.092354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13ad25-99d3-4026-b95f-5cba36dc3566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:42.210135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7e559-49ae-40ec-95bf-0525ea495d5c None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:42.228475 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afba629-efc8-489d-aaef-51ed47c7e040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:42.237318 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afba629-efc8-489d-aaef-51ed47c7e040 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:42.239318 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afba629-efc8-489d-aaef-51ed47c7e040 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:42.241050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afba629-efc8-489d-aaef-51ed47c7e040 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:42.245827 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afba629-efc8-489d-aaef-51ed47c7e040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:42.258711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afba629-efc8-489d-aaef-51ed47c7e040 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:42.389130 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 856/1720] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:41 2022] POST /identity/v3/projects => generated 369 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:42.389130 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afba629-efc8-489d-aaef-51ed47c7e040 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:42.392033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-5afba629-efc8-489d-aaef-51ed47c7e040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:42.396385 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13ad25-99d3-4026-b95f-5cba36dc3566 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:42.415245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13ad25-99d3-4026-b95f-5cba36dc3566 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:42.469686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 865/1721] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 888 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:42.471361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13ad25-99d3-4026-b95f-5cba36dc3566 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:42.478747 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ed13ad25-99d3-4026-b95f-5cba36dc3566 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:42.547731 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13ad25-99d3-4026-b95f-5cba36dc3566 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:42.668288 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afba629-efc8-489d-aaef-51ed47c7e040 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:42.685144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581a218-aa67-4ba7-bb39-bce9a3187758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:42.686565 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581a218-aa67-4ba7-bb39-bce9a3187758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:42.687090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581a218-aa67-4ba7-bb39-bce9a3187758 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:42.687576 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581a218-aa67-4ba7-bb39-bce9a3187758 admin admin] PATH_INFO: `/v3/users/df875def6c844ab786be602d7b6d5086` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:42.691149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581a218-aa67-4ba7-bb39-bce9a3187758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df875def6c844ab786be602d7b6d5086)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:42.693390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581a218-aa67-4ba7-bb39-bce9a3187758 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:42.729982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76a1eb-3dd0-4ad8-b8b6-cc601503fd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:42.731939 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76a1eb-3dd0-4ad8-b8b6-cc601503fd57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:42.733971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76a1eb-3dd0-4ad8-b8b6-cc601503fd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:42.734660 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76a1eb-3dd0-4ad8-b8b6-cc601503fd57 admin admin] PATH_INFO: `/v3/projects/f8a3beff2018443092e3c1724768bd65` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:42.737174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76a1eb-3dd0-4ad8-b8b6-cc601503fd57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a3beff2018443092e3c1724768bd65)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:42.744883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76a1eb-3dd0-4ad8-b8b6-cc601503fd57 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:42.803819 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-d581a218-aa67-4ba7-bb39-bce9a3187758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df875def6c844ab786be602d7b6d5086'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:42.823221 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-d581a218-aa67-4ba7-bb39-bce9a3187758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df875def6c844ab786be602d7b6d5086'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:42.840970 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-d581a218-aa67-4ba7-bb39-bce9a3187758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df875def6c844ab786be602d7b6d5086'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:42.842546 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-d581a218-aa67-4ba7-bb39-bce9a3187758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df875def6c844ab786be602d7b6d5086'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:42.843531 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-d581a218-aa67-4ba7-bb39-bce9a3187758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df875def6c844ab786be602d7b6d5086'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:42.879481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 857/1722] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:46:42 2022] DELETE /identity/v3/users/df875def6c844ab786be602d7b6d5086 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:42.881117 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581a218-aa67-4ba7-bb39-bce9a3187758 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:42.883654 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-d581a218-aa67-4ba7-bb39-bce9a3187758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:42.928608 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-0c76a1eb-3dd0-4ad8-b8b6-cc601503fd57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a3beff2018443092e3c1724768bd65', 'request_id': 'req-0c76a1eb-3dd0-4ad8-b8b6-cc601503fd57'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:42.956658 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-0c76a1eb-3dd0-4ad8-b8b6-cc601503fd57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a3beff2018443092e3c1724768bd65', 'request_id': 'req-0c76a1eb-3dd0-4ad8-b8b6-cc601503fd57'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:42.973331 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581a218-aa67-4ba7-bb39-bce9a3187758 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:42.979716 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a75b6-0292-481c-911c-b395d587c107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:42.982443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a75b6-0292-481c-911c-b395d587c107 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:42.982443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a75b6-0292-481c-911c-b395d587c107 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:42.982443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a75b6-0292-481c-911c-b395d587c107 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:42.982443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a75b6-0292-481c-911c-b395d587c107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:42.986071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a75b6-0292-481c-911c-b395d587c107 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:42.998244 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-0c76a1eb-3dd0-4ad8-b8b6-cc601503fd57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a3beff2018443092e3c1724768bd65', 'request_id': 'req-0c76a1eb-3dd0-4ad8-b8b6-cc601503fd57'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.015361 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 858/1723] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:42 2022] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:43.016623 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a75b6-0292-481c-911c-b395d587c107 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:43.018793 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-199a75b6-0292-481c-911c-b395d587c107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:43.033818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a75b6-0292-481c-911c-b395d587c107 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:43.040138 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386a79d-a284-4e98-a7cf-42c5474c8832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:43.041341 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386a79d-a284-4e98-a7cf-42c5474c8832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:43.041807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386a79d-a284-4e98-a7cf-42c5474c8832 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:43.042320 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386a79d-a284-4e98-a7cf-42c5474c8832 admin admin] PATH_INFO: `/v3/users/ccced023aee046588c571d42f9c19685` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:43.043738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386a79d-a284-4e98-a7cf-42c5474c8832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccced023aee046588c571d42f9c19685)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:43.045879 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386a79d-a284-4e98-a7cf-42c5474c8832 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:43.058617 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-0c76a1eb-3dd0-4ad8-b8b6-cc601503fd57 admin admin] The token cache is being invalidate because project f8a3beff2018443092e3c1724768bd65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:46:43.058912 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-0c76a1eb-3dd0-4ad8-b8b6-cc601503fd57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.062169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-0c76a1eb-3dd0-4ad8-b8b6-cc601503fd57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.067217 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 866/1724] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:46:42 2022] DELETE /identity/v3/projects/f8a3beff2018443092e3c1724768bd65 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:43.068594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c7b41-a058-4937-be3d-65123c28281e None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:43.068891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c7b41-a058-4937-be3d-65123c28281e None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:43.069172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c7b41-a058-4937-be3d-65123c28281e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:43.152893 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-3386a79d-a284-4e98-a7cf-42c5474c8832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccced023aee046588c571d42f9c19685'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.163183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-6a2c7b41-a058-4937-be3d-65123c28281e None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:43.166386 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-6a2c7b41-a058-4937-be3d-65123c28281e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:43.171205 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-3386a79d-a284-4e98-a7cf-42c5474c8832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccced023aee046588c571d42f9c19685'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.184304 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 867/1725] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:43.185126 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-3386a79d-a284-4e98-a7cf-42c5474c8832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccced023aee046588c571d42f9c19685'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.185664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c7b41-a058-4937-be3d-65123c28281e None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:43.187429 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-3386a79d-a284-4e98-a7cf-42c5474c8832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccced023aee046588c571d42f9c19685'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.188021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-6a2c7b41-a058-4937-be3d-65123c28281e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:43.189997 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-3386a79d-a284-4e98-a7cf-42c5474c8832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccced023aee046588c571d42f9c19685'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.244865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 859/1726] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:46:43 2022] DELETE /identity/v3/users/ccced023aee046588c571d42f9c19685 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:43.244865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386a79d-a284-4e98-a7cf-42c5474c8832 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:43.244865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-3386a79d-a284-4e98-a7cf-42c5474c8832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:43.248087 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c7b41-a058-4937-be3d-65123c28281e None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:43.421008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2c265-1a36-4c69-818c-16b2efd25042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:43.421778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2c265-1a36-4c69-818c-16b2efd25042 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:43.422070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2c265-1a36-4c69-818c-16b2efd25042 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:43.422351 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2c265-1a36-4c69-818c-16b2efd25042 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:43.425563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2c265-1a36-4c69-818c-16b2efd25042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:43.431328 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2c265-1a36-4c69-818c-16b2efd25042 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:43.462272 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 868/1727] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:43.463634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10617a-5b9f-4fd4-b504-2e1f0fe33e4a None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:43.463932 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10617a-5b9f-4fd4-b504-2e1f0fe33e4a None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:43.464220 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10617a-5b9f-4fd4-b504-2e1f0fe33e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:43.504994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386a79d-a284-4e98-a7cf-42c5474c8832 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:43.531154 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434966c3-35c7-4410-b889-0fe9a5a55888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:43.532244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434966c3-35c7-4410-b889-0fe9a5a55888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:43.532534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434966c3-35c7-4410-b889-0fe9a5a55888 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:43.532814 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434966c3-35c7-4410-b889-0fe9a5a55888 admin admin] PATH_INFO: `/v3/users/a8aacc37acc748289192ce1bb58d3938` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:43.538693 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434966c3-35c7-4410-b889-0fe9a5a55888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8aacc37acc748289192ce1bb58d3938)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:43.541649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-ff10617a-5b9f-4fd4-b504-2e1f0fe33e4a None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:43.548732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434966c3-35c7-4410-b889-0fe9a5a55888 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:43.562790 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ff10617a-5b9f-4fd4-b504-2e1f0fe33e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:43.595173 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 869/1728] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:43.597706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10617a-5b9f-4fd4-b504-2e1f0fe33e4a None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:43.600374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ff10617a-5b9f-4fd4-b504-2e1f0fe33e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:43.724274 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-434966c3-35c7-4410-b889-0fe9a5a55888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8aacc37acc748289192ce1bb58d3938'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.749672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-434966c3-35c7-4410-b889-0fe9a5a55888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8aacc37acc748289192ce1bb58d3938'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.820556 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-434966c3-35c7-4410-b889-0fe9a5a55888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8aacc37acc748289192ce1bb58d3938'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.824426 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-434966c3-35c7-4410-b889-0fe9a5a55888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8aacc37acc748289192ce1bb58d3938'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.825282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-434966c3-35c7-4410-b889-0fe9a5a55888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8aacc37acc748289192ce1bb58d3938'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.886138 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 860/1729] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:46:43 2022] DELETE /identity/v3/users/a8aacc37acc748289192ce1bb58d3938 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:43.893430 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434966c3-35c7-4410-b889-0fe9a5a55888 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:43.896051 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-434966c3-35c7-4410-b889-0fe9a5a55888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:43.947347 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10617a-5b9f-4fd4-b504-2e1f0fe33e4a None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:44.094682 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77980a2-285c-4286-b2e0-e92cd98957b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:44.096011 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77980a2-285c-4286-b2e0-e92cd98957b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:44.097042 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77980a2-285c-4286-b2e0-e92cd98957b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:44.098021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77980a2-285c-4286-b2e0-e92cd98957b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:44.110243 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a77980a2-285c-4286-b2e0-e92cd98957b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:44.120981 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434966c3-35c7-4410-b889-0fe9a5a55888 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:44.134042 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb0f49-778c-4862-8cb1-1b06ad845ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:44.136359 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb0f49-778c-4862-8cb1-1b06ad845ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:44.137470 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb0f49-778c-4862-8cb1-1b06ad845ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:44.137470 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb0f49-778c-4862-8cb1-1b06ad845ed2 admin admin] PATH_INFO: `/v3/projects/3bf42ddcbd6f4e7c85ba1d014494d651/users/e4d485fdaed4471a940d9a7f1bd389c7/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:44.154851 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77980a2-285c-4286-b2e0-e92cd98957b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:44.159298 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77980a2-285c-4286-b2e0-e92cd98957b0 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:44.211272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb0f49-778c-4862-8cb1-1b06ad845ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf42ddcbd6f4e7c85ba1d014494d651, user_id=e4d485fdaed4471a940d9a7f1bd389c7, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:44.217554 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 870/1730] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:44.219697 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77980a2-285c-4286-b2e0-e92cd98957b0 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:44.220108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb0f49-778c-4862-8cb1-1b06ad845ed2 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:44.224179 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a77980a2-285c-4286-b2e0-e92cd98957b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:44.251407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 861/1731] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:43 2022] PUT /identity/v3/projects/3bf42ddcbd6f4e7c85ba1d014494d651/users/e4d485fdaed4471a940d9a7f1bd389c7/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:44.255855 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb0f49-778c-4862-8cb1-1b06ad845ed2 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:44.261048 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77980a2-285c-4286-b2e0-e92cd98957b0 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:44.465378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b876418-5191-4e50-9ad4-89ae65e43bce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:44.466554 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b876418-5191-4e50-9ad4-89ae65e43bce service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:44.475491 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb0f49-778c-4862-8cb1-1b06ad845ed2 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:44.480892 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b876418-5191-4e50-9ad4-89ae65e43bce service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:44.482513 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b876418-5191-4e50-9ad4-89ae65e43bce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:44.486748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-3b876418-5191-4e50-9ad4-89ae65e43bce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:44.532542 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51518a4-63ef-4dc0-9511-3f47ff5939a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:44.533248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51518a4-63ef-4dc0-9511-3f47ff5939a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:44.533529 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51518a4-63ef-4dc0-9511-3f47ff5939a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:44.533928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51518a4-63ef-4dc0-9511-3f47ff5939a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:44.534784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51518a4-63ef-4dc0-9511-3f47ff5939a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:44.536648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51518a4-63ef-4dc0-9511-3f47ff5939a5 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:44.540174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b876418-5191-4e50-9ad4-89ae65e43bce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:44.545722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b876418-5191-4e50-9ad4-89ae65e43bce service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:44.573174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 862/1732] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:44.574482 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51518a4-63ef-4dc0-9511-3f47ff5939a5 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:44.611934 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 871/1733] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:44.613996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51518a4-63ef-4dc0-9511-3f47ff5939a5 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:44.643200 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cc98b-a2af-44a1-af1f-9f8df0e9a9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:44.646167 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cc98b-a2af-44a1-af1f-9f8df0e9a9f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:44.646588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cc98b-a2af-44a1-af1f-9f8df0e9a9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:44.646927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cc98b-a2af-44a1-af1f-9f8df0e9a9f1 admin admin] PATH_INFO: `/v3/projects/3bf42ddcbd6f4e7c85ba1d014494d651/users/e4d485fdaed4471a940d9a7f1bd389c7/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:44.655246 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5cc98b-a2af-44a1-af1f-9f8df0e9a9f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf42ddcbd6f4e7c85ba1d014494d651, user_id=e4d485fdaed4471a940d9a7f1bd389c7, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:44.674747 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5cc98b-a2af-44a1-af1f-9f8df0e9a9f1 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:44.750942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 863/1734] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:44 2022] PUT /identity/v3/projects/3bf42ddcbd6f4e7c85ba1d014494d651/users/e4d485fdaed4471a940d9a7f1bd389c7/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:44.762852 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ac740-46a8-4d16-ab9e-441d5e171206 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:44.763709 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ac740-46a8-4d16-ab9e-441d5e171206 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:44.764153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ac740-46a8-4d16-ab9e-441d5e171206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:44.828034 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-1b6ac740-46a8-4d16-ab9e-441d5e171206 None None] MFA Rules not processed for user `e4d485fdaed4471a940d9a7f1bd389c7`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:44.829556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-1b6ac740-46a8-4d16-ab9e-441d5e171206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:44.884494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6a449-45cc-4275-9897-f5f2e3b44522 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:44.885635 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6a449-45cc-4275-9897-f5f2e3b44522 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:44.888636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6a449-45cc-4275-9897-f5f2e3b44522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:44.949603 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-ecb6a449-45cc-4275-9897-f5f2e3b44522 None None] MFA Rules not processed for user `e4e5d4fe283447c59672398a26dea225`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:44.956539 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ecb6a449-45cc-4275-9897-f5f2e3b44522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:45.074458 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 872/1735] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:44 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:45.094639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ac740-46a8-4d16-ab9e-441d5e171206 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:45.101686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-1b6ac740-46a8-4d16-ab9e-441d5e171206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:45.121817 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 864/1736] 10.222.0.48 () {58 vars in 1015 bytes} [Wed May 4 21:46:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:46:45.143312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0085641-216c-4fe5-ae08-d6fa5bff4c9c None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:45.143312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0085641-216c-4fe5-ae08-d6fa5bff4c9c None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:45.143312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0085641-216c-4fe5-ae08-d6fa5bff4c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:45.196981 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-e0085641-216c-4fe5-ae08-d6fa5bff4c9c None None] MFA Rules not processed for user `49618ca42d8d43a4ac419c352f7d0042`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:45.196981 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e0085641-216c-4fe5-ae08-d6fa5bff4c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:45.343390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 865/1737] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:45.344997 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0085641-216c-4fe5-ae08-d6fa5bff4c9c None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:45.352066 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e0085641-216c-4fe5-ae08-d6fa5bff4c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:45.353248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ac740-46a8-4d16-ab9e-441d5e171206 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:45.369417 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25e150-dd46-466e-beee-cb043fea65d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:45.372879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25e150-dd46-466e-beee-cb043fea65d7 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:45.373210 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25e150-dd46-466e-beee-cb043fea65d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:45.375195 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25e150-dd46-466e-beee-cb043fea65d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:45.436293 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25e150-dd46-466e-beee-cb043fea65d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:45.446114 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25e150-dd46-466e-beee-cb043fea65d7 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:45.497823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 873/1738] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:45 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:45.498743 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25e150-dd46-466e-beee-cb043fea65d7 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:45.504943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-af25e150-dd46-466e-beee-cb043fea65d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:45.542094 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25e150-dd46-466e-beee-cb043fea65d7 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:45.552461 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0085641-216c-4fe5-ae08-d6fa5bff4c9c None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:45.557217 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c97641-c34a-4539-8204-e14e37a1c297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:45.558326 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c97641-c34a-4539-8204-e14e37a1c297 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:45.558753 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c97641-c34a-4539-8204-e14e37a1c297 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:45.559202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c97641-c34a-4539-8204-e14e37a1c297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:45.575665 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190314f-66bc-4036-b268-939e15fc6078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:45.584472 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190314f-66bc-4036-b268-939e15fc6078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:45.585053 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190314f-66bc-4036-b268-939e15fc6078 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:45.585575 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190314f-66bc-4036-b268-939e15fc6078 admin admin] PATH_INFO: `/v3/projects/7608a358d37d4dc8b6b34a93eb42a8be` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:45.591539 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190314f-66bc-4036-b268-939e15fc6078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7608a358d37d4dc8b6b34a93eb42a8be)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:45.596123 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c97641-c34a-4539-8204-e14e37a1c297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:45.597747 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c97641-c34a-4539-8204-e14e37a1c297 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:45.602050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190314f-66bc-4036-b268-939e15fc6078 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:45.630125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 874/1739] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:45.811314 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-a190314f-66bc-4036-b268-939e15fc6078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7608a358d37d4dc8b6b34a93eb42a8be', 'request_id': 'req-a190314f-66bc-4036-b268-939e15fc6078'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:45.828899 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-a190314f-66bc-4036-b268-939e15fc6078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7608a358d37d4dc8b6b34a93eb42a8be', 'request_id': 'req-a190314f-66bc-4036-b268-939e15fc6078'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:45.848105 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-a190314f-66bc-4036-b268-939e15fc6078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7608a358d37d4dc8b6b34a93eb42a8be', 'request_id': 'req-a190314f-66bc-4036-b268-939e15fc6078'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:45.880887 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-a190314f-66bc-4036-b268-939e15fc6078 admin admin] The token cache is being invalidate because project 7608a358d37d4dc8b6b34a93eb42a8be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:46:45.881635 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-a190314f-66bc-4036-b268-939e15fc6078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:45.882154 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-a190314f-66bc-4036-b268-939e15fc6078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:45.903605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 866/1740] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:46:45 2022] DELETE /identity/v3/projects/7608a358d37d4dc8b6b34a93eb42a8be => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:45.909183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a672b-89ae-40fc-b522-083f383d0ec1 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:45.909902 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a672b-89ae-40fc-b522-083f383d0ec1 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:45.910406 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a672b-89ae-40fc-b522-083f383d0ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:45.958314 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-ae4a672b-89ae-40fc-b522-083f383d0ec1 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:45.959781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ae4a672b-89ae-40fc-b522-083f383d0ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:46.003343 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190314f-66bc-4036-b268-939e15fc6078 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:46.004806 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a190314f-66bc-4036-b268-939e15fc6078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:46.065137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 875/1741] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:46.081031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ee9ec-7a5f-4649-bda0-ae42b5ad45b0 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:46.081316 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ee9ec-7a5f-4649-bda0-ae42b5ad45b0 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:46.081630 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ee9ec-7a5f-4649-bda0-ae42b5ad45b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:46.139923 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-439ee9ec-7a5f-4649-bda0-ae42b5ad45b0 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:46.141434 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-439ee9ec-7a5f-4649-bda0-ae42b5ad45b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:46.174593 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 876/1742] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:46.176106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ee9ec-7a5f-4649-bda0-ae42b5ad45b0 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:46.183344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-439ee9ec-7a5f-4649-bda0-ae42b5ad45b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:46.197275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ee9ec-7a5f-4649-bda0-ae42b5ad45b0 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:46.204147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e8bf9-39a3-46a0-930e-7ec813eb7871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:46.214289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e8bf9-39a3-46a0-930e-7ec813eb7871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:46.214593 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e8bf9-39a3-46a0-930e-7ec813eb7871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:46.214878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e8bf9-39a3-46a0-930e-7ec813eb7871 admin admin] PATH_INFO: `/v3/projects/b5cf0b8941d84bdea4dbc29efa0779da` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:46.217059 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e8bf9-39a3-46a0-930e-7ec813eb7871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5cf0b8941d84bdea4dbc29efa0779da)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:46.222953 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e8bf9-39a3-46a0-930e-7ec813eb7871 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:46.264262 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190314f-66bc-4036-b268-939e15fc6078 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:46.289342 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0890c3d-3094-401c-9c28-178e231f55ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:46.290457 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0890c3d-3094-401c-9c28-178e231f55ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:46.290660 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0890c3d-3094-401c-9c28-178e231f55ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:46.291464 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0890c3d-3094-401c-9c28-178e231f55ac admin admin] PATH_INFO: `/v3/projects/f9e782fc2fa541b3951cb5a26b1c47f3` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:46.292858 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0890c3d-3094-401c-9c28-178e231f55ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e782fc2fa541b3951cb5a26b1c47f3)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:46.295416 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0890c3d-3094-401c-9c28-178e231f55ac admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:46.408103 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-127e8bf9-39a3-46a0-930e-7ec813eb7871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5cf0b8941d84bdea4dbc29efa0779da', 'request_id': 'req-127e8bf9-39a3-46a0-930e-7ec813eb7871'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:46.423623 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-127e8bf9-39a3-46a0-930e-7ec813eb7871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5cf0b8941d84bdea4dbc29efa0779da', 'request_id': 'req-127e8bf9-39a3-46a0-930e-7ec813eb7871'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:46.435371 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e0890c3d-3094-401c-9c28-178e231f55ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e782fc2fa541b3951cb5a26b1c47f3', 'request_id': 'req-e0890c3d-3094-401c-9c28-178e231f55ac'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:46.440769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-127e8bf9-39a3-46a0-930e-7ec813eb7871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5cf0b8941d84bdea4dbc29efa0779da', 'request_id': 'req-127e8bf9-39a3-46a0-930e-7ec813eb7871'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:46.463869 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e0890c3d-3094-401c-9c28-178e231f55ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e782fc2fa541b3951cb5a26b1c47f3', 'request_id': 'req-e0890c3d-3094-401c-9c28-178e231f55ac'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:46.479489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e0890c3d-3094-401c-9c28-178e231f55ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e782fc2fa541b3951cb5a26b1c47f3', 'request_id': 'req-e0890c3d-3094-401c-9c28-178e231f55ac'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:46.484909 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-127e8bf9-39a3-46a0-930e-7ec813eb7871 admin admin] The token cache is being invalidate because project b5cf0b8941d84bdea4dbc29efa0779da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:46:46.493164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-127e8bf9-39a3-46a0-930e-7ec813eb7871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:46.493821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-127e8bf9-39a3-46a0-930e-7ec813eb7871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:46.496866 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 877/1743] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:46:46 2022] DELETE /identity/v3/projects/b5cf0b8941d84bdea4dbc29efa0779da => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:46.499905 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e8bf9-39a3-46a0-930e-7ec813eb7871 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:46.508170 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-127e8bf9-39a3-46a0-930e-7ec813eb7871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:46.515244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e0890c3d-3094-401c-9c28-178e231f55ac admin admin] The token cache is being invalidate because project f9e782fc2fa541b3951cb5a26b1c47f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:46:46.515921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e0890c3d-3094-401c-9c28-178e231f55ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:46.524331 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e0890c3d-3094-401c-9c28-178e231f55ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:46.527196 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 867/1744] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:46:46 2022] DELETE /identity/v3/projects/f9e782fc2fa541b3951cb5a26b1c47f3 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:46.528520 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0890c3d-3094-401c-9c28-178e231f55ac admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:46.530713 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e0890c3d-3094-401c-9c28-178e231f55ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:46.719521 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e8bf9-39a3-46a0-930e-7ec813eb7871 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:46.766282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0890c3d-3094-401c-9c28-178e231f55ac admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:46.781936 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3c73c-d993-4fc1-a2ba-9757cdf58021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:46.783185 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3c73c-d993-4fc1-a2ba-9757cdf58021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:46.783697 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3c73c-d993-4fc1-a2ba-9757cdf58021 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:46.784185 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3c73c-d993-4fc1-a2ba-9757cdf58021 admin admin] PATH_INFO: `/v3/users/c7c8c2a4eb4c423d894431308763ecea` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:46.788246 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3c73c-d993-4fc1-a2ba-9757cdf58021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7c8c2a4eb4c423d894431308763ecea)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:46.795375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3c73c-d993-4fc1-a2ba-9757cdf58021 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:46.884562 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8986ab2-e5d1-4b22-b593-6cebf0c87428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:46.885278 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8986ab2-e5d1-4b22-b593-6cebf0c87428 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:46.885573 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8986ab2-e5d1-4b22-b593-6cebf0c87428 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:46.885805 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8986ab2-e5d1-4b22-b593-6cebf0c87428 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:46.886536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8986ab2-e5d1-4b22-b593-6cebf0c87428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:46:46.886847 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8986ab2-e5d1-4b22-b593-6cebf0c87428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:46.888510 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8986ab2-e5d1-4b22-b593-6cebf0c87428 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:46.923644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b9d3c73c-d993-4fc1-a2ba-9757cdf58021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7c8c2a4eb4c423d894431308763ecea'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:46.934584 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 878/1745] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:46:46.942398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8986ab2-e5d1-4b22-b593-6cebf0c87428 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:46.945399 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-d8986ab2-e5d1-4b22-b593-6cebf0c87428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:46.951394 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b9d3c73c-d993-4fc1-a2ba-9757cdf58021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7c8c2a4eb4c423d894431308763ecea'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:46.989005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b9d3c73c-d993-4fc1-a2ba-9757cdf58021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7c8c2a4eb4c423d894431308763ecea'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:46.991405 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b9d3c73c-d993-4fc1-a2ba-9757cdf58021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7c8c2a4eb4c423d894431308763ecea'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:46.995558 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b9d3c73c-d993-4fc1-a2ba-9757cdf58021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7c8c2a4eb4c423d894431308763ecea'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:47.004653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8986ab2-e5d1-4b22-b593-6cebf0c87428 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:47.020102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1428422-7de0-4506-9470-f3c54a69b5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:47.021032 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1428422-7de0-4506-9470-f3c54a69b5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:47.021309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1428422-7de0-4506-9470-f3c54a69b5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:47.021591 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1428422-7de0-4506-9470-f3c54a69b5fd admin admin] PATH_INFO: `/v3/users/af416ab8cfe94ae3b905d5fa2364f5d1` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:47.025495 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1428422-7de0-4506-9470-f3c54a69b5fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=af416ab8cfe94ae3b905d5fa2364f5d1)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:47.027662 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1428422-7de0-4506-9470-f3c54a69b5fd admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:47.089724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 868/1746] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:46:46 2022] DELETE /identity/v3/users/c7c8c2a4eb4c423d894431308763ecea => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:47.113372 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3c73c-d993-4fc1-a2ba-9757cdf58021 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:47.122053 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b9d3c73c-d993-4fc1-a2ba-9757cdf58021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:47.158961 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e1428422-7de0-4506-9470-f3c54a69b5fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af416ab8cfe94ae3b905d5fa2364f5d1'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:47.193461 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e1428422-7de0-4506-9470-f3c54a69b5fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af416ab8cfe94ae3b905d5fa2364f5d1'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:47.196815 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e1428422-7de0-4506-9470-f3c54a69b5fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af416ab8cfe94ae3b905d5fa2364f5d1'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:47.236769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e1428422-7de0-4506-9470-f3c54a69b5fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af416ab8cfe94ae3b905d5fa2364f5d1'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:47.260300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e1428422-7de0-4506-9470-f3c54a69b5fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af416ab8cfe94ae3b905d5fa2364f5d1'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:47.280966 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 879/1747] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:46:46 2022] DELETE /identity/v3/users/af416ab8cfe94ae3b905d5fa2364f5d1 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:47.288152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8dfad-63b8-49f9-9904-d891d06c7078 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:47.288446 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8dfad-63b8-49f9-9904-d891d06c7078 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:47.288732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8dfad-63b8-49f9-9904-d891d06c7078 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:47.296415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 880/1748] 10.222.0.11 () {54 vars in 912 bytes} [Wed May 4 21:46:47 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:46:47.297840 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd92a0-2a41-4ad4-887b-2a8c9ed39477 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:47.298139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd92a0-2a41-4ad4-887b-2a8c9ed39477 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:47.298427 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd92a0-2a41-4ad4-887b-2a8c9ed39477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:47.350394 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-82dd92a0-2a41-4ad4-887b-2a8c9ed39477 None None] MFA Rules not processed for user `e4e5d4fe283447c59672398a26dea225`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:47.353185 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-82dd92a0-2a41-4ad4-887b-2a8c9ed39477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:47.468454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3c73c-d993-4fc1-a2ba-9757cdf58021 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:47.616736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 881/1749] 10.222.0.11 () {58 vars in 1009 bytes} [Wed May 4 21:46:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:47.640358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd92a0-2a41-4ad4-887b-2a8c9ed39477 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:47.641883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-82dd92a0-2a41-4ad4-887b-2a8c9ed39477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:47.674599 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd92a0-2a41-4ad4-887b-2a8c9ed39477 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:47.692282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928b5bc-4c91-4fd4-bd72-a3a565e5dec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:47.693487 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928b5bc-4c91-4fd4-bd72-a3a565e5dec6 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:47.694160 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928b5bc-4c91-4fd4-bd72-a3a565e5dec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:47.694802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928b5bc-4c91-4fd4-bd72-a3a565e5dec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:47.695876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928b5bc-4c91-4fd4-bd72-a3a565e5dec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:47.696259 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d1520-cbcf-4108-b388-d3cad80b2210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:47.696968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d1520-cbcf-4108-b388-d3cad80b2210 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:47.697252 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d1520-cbcf-4108-b388-d3cad80b2210 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:47.697529 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d1520-cbcf-4108-b388-d3cad80b2210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:47.699290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928b5bc-4c91-4fd4-bd72-a3a565e5dec6 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:47.735703 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d1520-cbcf-4108-b388-d3cad80b2210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:47.740437 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d1520-cbcf-4108-b388-d3cad80b2210 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:47.783920 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 882/1750] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:47.841123 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 869/1751] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:47 2022] POST /identity/v3/projects => generated 377 bytes in 750 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:47.842219 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d1520-cbcf-4108-b388-d3cad80b2210 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:47.843649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-1e0d1520-cbcf-4108-b388-d3cad80b2210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:47.880337 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d1520-cbcf-4108-b388-d3cad80b2210 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:48.172056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef1617-deb1-4dcf-a265-d0bba61de579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:48.172830 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef1617-deb1-4dcf-a265-d0bba61de579 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:48.173323 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef1617-deb1-4dcf-a265-d0bba61de579 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:48.173457 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef1617-deb1-4dcf-a265-d0bba61de579 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:48.174175 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef1617-deb1-4dcf-a265-d0bba61de579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:48.185715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef1617-deb1-4dcf-a265-d0bba61de579 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:48.254746 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 883/1752] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:47 2022] POST /identity/v3/users => generated 289 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:48.260318 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928b5bc-4c91-4fd4-bd72-a3a565e5dec6 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:48.279300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928b5bc-4c91-4fd4-bd72-a3a565e5dec6 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:48.320953 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f71a37-a604-416a-a9d0-d840d34db33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:48.325099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71a37-a604-416a-a9d0-d840d34db33f admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:48.327953 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71a37-a604-416a-a9d0-d840d34db33f admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:48.330587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71a37-a604-416a-a9d0-d840d34db33f admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:48.333303 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f71a37-a604-416a-a9d0-d840d34db33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:48.335630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f71a37-a604-416a-a9d0-d840d34db33f admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:48.384089 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef1617-deb1-4dcf-a265-d0bba61de579 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:48.384320 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 870/1753] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:48.413087 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef1617-deb1-4dcf-a265-d0bba61de579 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:48.428261 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1fbe5c-1eda-422d-9dd3-4563af38aff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:48.429022 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fbe5c-1eda-422d-9dd3-4563af38aff7 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:48.429304 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fbe5c-1eda-422d-9dd3-4563af38aff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:48.429636 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fbe5c-1eda-422d-9dd3-4563af38aff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:48.432044 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1fbe5c-1eda-422d-9dd3-4563af38aff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:48.434214 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1fbe5c-1eda-422d-9dd3-4563af38aff7 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:48.476391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 884/1754] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:48.484350 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f71a37-a604-416a-a9d0-d840d34db33f admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:48.497284 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f71a37-a604-416a-a9d0-d840d34db33f admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:48.523078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e6d1a-66d8-41a8-9c5c-32863d671209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:48.524673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e6d1a-66d8-41a8-9c5c-32863d671209 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:48.525180 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e6d1a-66d8-41a8-9c5c-32863d671209 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:48.525866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e6d1a-66d8-41a8-9c5c-32863d671209 admin admin] PATH_INFO: `/v3/projects/bd17f503418e4c3b8d368f334b8444a1/users/6952cb65b5cd4e8dae10ca61e33d1846/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:48.590099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e6d1a-66d8-41a8-9c5c-32863d671209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd17f503418e4c3b8d368f334b8444a1, user_id=6952cb65b5cd4e8dae10ca61e33d1846, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:48.603834 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e6d1a-66d8-41a8-9c5c-32863d671209 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:48.646147 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 871/1755] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:48 2022] PUT /identity/v3/projects/bd17f503418e4c3b8d368f334b8444a1/users/6952cb65b5cd4e8dae10ca61e33d1846/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:48.661278 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737c455-7a13-4f6b-8480-ab370005f266 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:48.661869 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737c455-7a13-4f6b-8480-ab370005f266 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:48.661869 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737c455-7a13-4f6b-8480-ab370005f266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:48.740181 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-c737c455-7a13-4f6b-8480-ab370005f266 None None] MFA Rules not processed for user `6952cb65b5cd4e8dae10ca61e33d1846`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:48.744896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c737c455-7a13-4f6b-8480-ab370005f266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:48.994519 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 885/1756] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:49.002548 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e6d1a-66d8-41a8-9c5c-32863d671209 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:49.034412 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737c455-7a13-4f6b-8480-ab370005f266 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:49.038206 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c737c455-7a13-4f6b-8480-ab370005f266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:49.175729 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e6d1a-66d8-41a8-9c5c-32863d671209 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:49.197893 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b082943-6638-4a6b-af3a-2bd769aad0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:49.198694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b082943-6638-4a6b-af3a-2bd769aad0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:49.199119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b082943-6638-4a6b-af3a-2bd769aad0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:49.199552 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b082943-6638-4a6b-af3a-2bd769aad0f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:49.200386 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b082943-6638-4a6b-af3a-2bd769aad0f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:49.202491 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b082943-6638-4a6b-af3a-2bd769aad0f1 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:49.258870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 872/1757] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:49 2022] POST /identity/v3/projects => generated 377 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:49.267809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b082943-6638-4a6b-af3a-2bd769aad0f1 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:49.285577 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737c455-7a13-4f6b-8480-ab370005f266 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:49.439095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b082943-6638-4a6b-af3a-2bd769aad0f1 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:49.453831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38187-41a2-4d80-82a1-1bca2ffb70c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:49.465364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38187-41a2-4d80-82a1-1bca2ffb70c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:49.466206 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38187-41a2-4d80-82a1-1bca2ffb70c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:49.467567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38187-41a2-4d80-82a1-1bca2ffb70c4 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:49.470169 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b38187-41a2-4d80-82a1-1bca2ffb70c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:49.473154 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b38187-41a2-4d80-82a1-1bca2ffb70c4 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:49.500513 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3d79e-1b70-4d49-9deb-a93bcc8b074b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:49.501547 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3d79e-1b70-4d49-9deb-a93bcc8b074b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:49.503522 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3d79e-1b70-4d49-9deb-a93bcc8b074b admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:49.504623 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3d79e-1b70-4d49-9deb-a93bcc8b074b admin admin] PATH_INFO: `/v3/users/abc856d35fd84ef487cb9ec0f2a56d40` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:49.511428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3d79e-1b70-4d49-9deb-a93bcc8b074b admin admin] RBAC: Authorizing `identity:delete_user(user_id=abc856d35fd84ef487cb9ec0f2a56d40)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:49.517969 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3d79e-1b70-4d49-9deb-a93bcc8b074b admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:49.540072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 873/1758] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:49 2022] POST /identity/v3/users => generated 289 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:49.544799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38187-41a2-4d80-82a1-1bca2ffb70c4 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:49.599674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38187-41a2-4d80-82a1-1bca2ffb70c4 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:49.645936 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad570a-c423-423b-9ebb-9c2668536544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:49.657045 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad570a-c423-423b-9ebb-9c2668536544 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:49.657439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad570a-c423-423b-9ebb-9c2668536544 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:49.663532 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad570a-c423-423b-9ebb-9c2668536544 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:49.667020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-41c3d79e-1b70-4d49-9deb-a93bcc8b074b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abc856d35fd84ef487cb9ec0f2a56d40'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:49.687999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad570a-c423-423b-9ebb-9c2668536544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:49.689775 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad570a-c423-423b-9ebb-9c2668536544 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:49.690890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-41c3d79e-1b70-4d49-9deb-a93bcc8b074b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abc856d35fd84ef487cb9ec0f2a56d40'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:49.692223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-41c3d79e-1b70-4d49-9deb-a93bcc8b074b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abc856d35fd84ef487cb9ec0f2a56d40'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:49.727970 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-41c3d79e-1b70-4d49-9deb-a93bcc8b074b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abc856d35fd84ef487cb9ec0f2a56d40'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:49.739415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-41c3d79e-1b70-4d49-9deb-a93bcc8b074b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abc856d35fd84ef487cb9ec0f2a56d40'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:49.753971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 886/1759] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:46:49 2022] DELETE /identity/v3/users/abc856d35fd84ef487cb9ec0f2a56d40 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:49.756190 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3d79e-1b70-4d49-9deb-a93bcc8b074b admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:49.757420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 874/1760] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:46:49.764036 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-41c3d79e-1b70-4d49-9deb-a93bcc8b074b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:49.769911 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59e0be-eb3c-44c0-9c5a-325e66813b74 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:49.770201 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59e0be-eb3c-44c0-9c5a-325e66813b74 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:49.774330 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59e0be-eb3c-44c0-9c5a-325e66813b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:49.840204 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-ae59e0be-eb3c-44c0-9c5a-325e66813b74 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:49.846156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ae59e0be-eb3c-44c0-9c5a-325e66813b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:49.910562 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3d79e-1b70-4d49-9deb-a93bcc8b074b admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:49.917502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4f035-6a76-40f3-915d-7279d3a604bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:49.918822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4f035-6a76-40f3-915d-7279d3a604bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:49.919347 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4f035-6a76-40f3-915d-7279d3a604bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:49.919734 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4f035-6a76-40f3-915d-7279d3a604bb admin admin] PATH_INFO: `/v3/projects/bd98d6e8d7424e599847bb1054134f52` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:49.921907 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4f035-6a76-40f3-915d-7279d3a604bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd98d6e8d7424e599847bb1054134f52)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:49.924211 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4f035-6a76-40f3-915d-7279d3a604bb admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:50.003069 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-f9d4f035-6a76-40f3-915d-7279d3a604bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd98d6e8d7424e599847bb1054134f52', 'request_id': 'req-f9d4f035-6a76-40f3-915d-7279d3a604bb'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:50.031960 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-f9d4f035-6a76-40f3-915d-7279d3a604bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd98d6e8d7424e599847bb1054134f52', 'request_id': 'req-f9d4f035-6a76-40f3-915d-7279d3a604bb'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:50.047663 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-f9d4f035-6a76-40f3-915d-7279d3a604bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd98d6e8d7424e599847bb1054134f52', 'request_id': 'req-f9d4f035-6a76-40f3-915d-7279d3a604bb'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:50.068341 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 875/1761] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:50.069460 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59e0be-eb3c-44c0-9c5a-325e66813b74 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:50.075566 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ae59e0be-eb3c-44c0-9c5a-325e66813b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:50.079483 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-f9d4f035-6a76-40f3-915d-7279d3a604bb admin admin] The token cache is being invalidate because project bd98d6e8d7424e599847bb1054134f52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:46:50.080035 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-f9d4f035-6a76-40f3-915d-7279d3a604bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:50.080904 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-f9d4f035-6a76-40f3-915d-7279d3a604bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:50.101393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 887/1762] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:46:49 2022] DELETE /identity/v3/projects/bd98d6e8d7424e599847bb1054134f52 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:50.104628 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4f035-6a76-40f3-915d-7279d3a604bb admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:50.104960 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59e0be-eb3c-44c0-9c5a-325e66813b74 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:50.109936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-f9d4f035-6a76-40f3-915d-7279d3a604bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:50.276676 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8710cb-9c8f-4c9c-8434-ad69bbd0cf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:50.277375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8710cb-9c8f-4c9c-8434-ad69bbd0cf13 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:50.277656 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8710cb-9c8f-4c9c-8434-ad69bbd0cf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:50.277936 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8710cb-9c8f-4c9c-8434-ad69bbd0cf13 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:50.280715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8710cb-9c8f-4c9c-8434-ad69bbd0cf13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:50.285187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8710cb-9c8f-4c9c-8434-ad69bbd0cf13 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:50.321158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 876/1763] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:50.328628 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8710cb-9c8f-4c9c-8434-ad69bbd0cf13 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:50.342264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-aa8710cb-9c8f-4c9c-8434-ad69bbd0cf13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:50.354524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4f035-6a76-40f3-915d-7279d3a604bb admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:50.370840 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06024181-766e-4044-9780-8c8293ed5db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:50.371859 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06024181-766e-4044-9780-8c8293ed5db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:50.372097 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06024181-766e-4044-9780-8c8293ed5db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:50.379425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06024181-766e-4044-9780-8c8293ed5db6 admin admin] PATH_INFO: `/v3/projects/25f1a45f503e43118c0a738d1c73f4a6` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:50.383726 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06024181-766e-4044-9780-8c8293ed5db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f1a45f503e43118c0a738d1c73f4a6)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:50.385729 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06024181-766e-4044-9780-8c8293ed5db6 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:50.534682 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-06024181-766e-4044-9780-8c8293ed5db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f1a45f503e43118c0a738d1c73f4a6', 'request_id': 'req-06024181-766e-4044-9780-8c8293ed5db6'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:50.537961 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8710cb-9c8f-4c9c-8434-ad69bbd0cf13 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:50.556749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-06024181-766e-4044-9780-8c8293ed5db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f1a45f503e43118c0a738d1c73f4a6', 'request_id': 'req-06024181-766e-4044-9780-8c8293ed5db6'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:50.582881 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-06024181-766e-4044-9780-8c8293ed5db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f1a45f503e43118c0a738d1c73f4a6', 'request_id': 'req-06024181-766e-4044-9780-8c8293ed5db6'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:50.621943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-06024181-766e-4044-9780-8c8293ed5db6 admin admin] The token cache is being invalidate because project 25f1a45f503e43118c0a738d1c73f4a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:46:50.622733 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-06024181-766e-4044-9780-8c8293ed5db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:50.625594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-06024181-766e-4044-9780-8c8293ed5db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:50.633501 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e223ba-d536-4e3e-b613-6b6cb1cfdb63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:50.635310 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e223ba-d536-4e3e-b613-6b6cb1cfdb63 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:50.635921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e223ba-d536-4e3e-b613-6b6cb1cfdb63 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:50.636646 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e223ba-d536-4e3e-b613-6b6cb1cfdb63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:50.648840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c8e223ba-d536-4e3e-b613-6b6cb1cfdb63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:50.649607 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 888/1764] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:46:50 2022] DELETE /identity/v3/projects/25f1a45f503e43118c0a738d1c73f4a6 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:50.658581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da8e24-dfaa-41fe-b2ff-a766d0108bbe None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:50.659509 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da8e24-dfaa-41fe-b2ff-a766d0108bbe None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:50.661142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da8e24-dfaa-41fe-b2ff-a766d0108bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:50.741633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-29da8e24-dfaa-41fe-b2ff-a766d0108bbe None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:50.745226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-29da8e24-dfaa-41fe-b2ff-a766d0108bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:50.817526 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e223ba-d536-4e3e-b613-6b6cb1cfdb63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:50.820141 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e223ba-d536-4e3e-b613-6b6cb1cfdb63 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:50.861505 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 877/1765] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:50.862533 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e223ba-d536-4e3e-b613-6b6cb1cfdb63 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:50.875730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c8e223ba-d536-4e3e-b613-6b6cb1cfdb63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:50.910943 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e223ba-d536-4e3e-b613-6b6cb1cfdb63 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:50.923231 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 889/1766] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:50.925038 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2096954-9914-4d4b-8a62-923149608347 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:50.925341 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2096954-9914-4d4b-8a62-923149608347 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:50.925622 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2096954-9914-4d4b-8a62-923149608347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:50.927532 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015bb57-8cb1-4199-b740-851cfdf538de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:50.928990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015bb57-8cb1-4199-b740-851cfdf538de admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:50.930318 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015bb57-8cb1-4199-b740-851cfdf538de admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:50.931092 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015bb57-8cb1-4199-b740-851cfdf538de admin admin] PATH_INFO: `/v3/projects/62d2f02f88a4460cb276a9a9008071b3/users/54cdafc7b14d4197ad0d23959d6502e7/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:50.949916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015bb57-8cb1-4199-b740-851cfdf538de admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d2f02f88a4460cb276a9a9008071b3, user_id=54cdafc7b14d4197ad0d23959d6502e7, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:50.952657 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015bb57-8cb1-4199-b740-851cfdf538de admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:50.964781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-c2096954-9914-4d4b-8a62-923149608347 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:50.968685 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c2096954-9914-4d4b-8a62-923149608347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:50.985506 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 878/1767] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:50 2022] PUT /identity/v3/projects/62d2f02f88a4460cb276a9a9008071b3/users/54cdafc7b14d4197ad0d23959d6502e7/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:51.002168 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68143f5f-2a33-46e8-b2ca-a7241c9b4fbc None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:51.002501 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68143f5f-2a33-46e8-b2ca-a7241c9b4fbc None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:51.002789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68143f5f-2a33-46e8-b2ca-a7241c9b4fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:51.054856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-68143f5f-2a33-46e8-b2ca-a7241c9b4fbc None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:51.056935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-68143f5f-2a33-46e8-b2ca-a7241c9b4fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:51.170908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 890/1768] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:51.173623 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cac534-075c-4845-83a8-f18eefaaa8d5 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:51.173926 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cac534-075c-4845-83a8-f18eefaaa8d5 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:51.174216 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cac534-075c-4845-83a8-f18eefaaa8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:51.237708 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-60cac534-075c-4845-83a8-f18eefaaa8d5 None None] MFA Rules not processed for user `54cdafc7b14d4197ad0d23959d6502e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:51.242562 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-60cac534-075c-4845-83a8-f18eefaaa8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:51.252588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 879/1769] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:51.255617 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67b1c6-7c40-48f9-8b52-feb4134349cb None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:51.256109 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67b1c6-7c40-48f9-8b52-feb4134349cb None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:51.256539 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67b1c6-7c40-48f9-8b52-feb4134349cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:51.300831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-ca67b1c6-7c40-48f9-8b52-feb4134349cb None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:51.302340 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ca67b1c6-7c40-48f9-8b52-feb4134349cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:51.324266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 880/1770] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:51.325274 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67b1c6-7c40-48f9-8b52-feb4134349cb None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:51.347239 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67b1c6-7c40-48f9-8b52-feb4134349cb None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:51.368323 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f7c71-6690-457f-8073-0ffc2215b90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:51.369189 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f7c71-6690-457f-8073-0ffc2215b90d admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:51.369534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f7c71-6690-457f-8073-0ffc2215b90d admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:51.369878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f7c71-6690-457f-8073-0ffc2215b90d admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:51.370817 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f7c71-6690-457f-8073-0ffc2215b90d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:46:51.371181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f7c71-6690-457f-8073-0ffc2215b90d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:51.377488 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f7c71-6690-457f-8073-0ffc2215b90d admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:51.415374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 891/1771] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:51.416293 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cac534-075c-4845-83a8-f18eefaaa8d5 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:51.426219 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 881/1772] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:46:51.427298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f7c71-6690-457f-8073-0ffc2215b90d admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:51.452074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f7c71-6690-457f-8073-0ffc2215b90d admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:51.455617 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cac534-075c-4845-83a8-f18eefaaa8d5 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:51.465414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b6c4a-40d7-4f4b-a643-1f8b5105375e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:51.466250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b6c4a-40d7-4f4b-a643-1f8b5105375e admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:51.466697 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b6c4a-40d7-4f4b-a643-1f8b5105375e admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:51.467080 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b6c4a-40d7-4f4b-a643-1f8b5105375e admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:51.467793 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b6c4a-40d7-4f4b-a643-1f8b5105375e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:51.470809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b6c4a-40d7-4f4b-a643-1f8b5105375e admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:51.478576 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15192c43-8c8e-4d12-a402-07b790a8898c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:51.479479 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15192c43-8c8e-4d12-a402-07b790a8898c admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:51.479757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15192c43-8c8e-4d12-a402-07b790a8898c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:51.480046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15192c43-8c8e-4d12-a402-07b790a8898c admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:51.480782 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15192c43-8c8e-4d12-a402-07b790a8898c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:46:51.481256 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15192c43-8c8e-4d12-a402-07b790a8898c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:51.482923 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15192c43-8c8e-4d12-a402-07b790a8898c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:51.544981 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 892/1773] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:46:51.545917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15192c43-8c8e-4d12-a402-07b790a8898c admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:51.558159 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 882/1774] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:51 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:51.560400 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b6c4a-40d7-4f4b-a643-1f8b5105375e admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:51.564673 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15192c43-8c8e-4d12-a402-07b790a8898c admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:51.739205 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b6c4a-40d7-4f4b-a643-1f8b5105375e admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:51.741752 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a20ac-cb07-412d-bd87-46f12b27decc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:51.743134 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a20ac-cb07-412d-bd87-46f12b27decc admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:51.743531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a20ac-cb07-412d-bd87-46f12b27decc admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:51.743913 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a20ac-cb07-412d-bd87-46f12b27decc admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:51.744733 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a20ac-cb07-412d-bd87-46f12b27decc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:51.748239 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a20ac-cb07-412d-bd87-46f12b27decc admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:51.759853 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce90f3-c0cd-4c92-9433-2e6689024d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:51.760554 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce90f3-c0cd-4c92-9433-2e6689024d0b admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:51.760943 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce90f3-c0cd-4c92-9433-2e6689024d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:51.761329 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce90f3-c0cd-4c92-9433-2e6689024d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:51.763590 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce90f3-c0cd-4c92-9433-2e6689024d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:51.769604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce90f3-c0cd-4c92-9433-2e6689024d0b admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:51.832287 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 893/1775] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:51 2022] POST /identity/v3/projects => generated 373 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:51.834159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a20ac-cb07-412d-bd87-46f12b27decc admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:51.864784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 883/1776] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:51 2022] POST /identity/v3/projects => generated 381 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:51.864784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce90f3-c0cd-4c92-9433-2e6689024d0b admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:52.062187 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a20ac-cb07-412d-bd87-46f12b27decc admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:52.072523 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191be4f-304b-45de-b82a-5642db6c56dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:52.073271 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191be4f-304b-45de-b82a-5642db6c56dd admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:52.073673 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191be4f-304b-45de-b82a-5642db6c56dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:52.073901 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191be4f-304b-45de-b82a-5642db6c56dd admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:52.076647 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191be4f-304b-45de-b82a-5642db6c56dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:52.086201 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce90f3-c0cd-4c92-9433-2e6689024d0b admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:52.087390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191be4f-304b-45de-b82a-5642db6c56dd admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:52.100857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cda1d-4756-40fe-8f25-4b4eecc52729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:52.101628 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cda1d-4756-40fe-8f25-4b4eecc52729 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:52.101985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cda1d-4756-40fe-8f25-4b4eecc52729 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:52.102275 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cda1d-4756-40fe-8f25-4b4eecc52729 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:52.107953 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29cda1d-4756-40fe-8f25-4b4eecc52729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:52.113629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29cda1d-4756-40fe-8f25-4b4eecc52729 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:52.137925 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 894/1777] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:51 2022] POST /identity/v3/users => generated 296 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:52.142451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191be4f-304b-45de-b82a-5642db6c56dd admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:52.161281 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 884/1778] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:51 2022] POST /identity/v3/users => generated 287 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:52.162943 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad360f1-402e-4856-a2cc-10f7455016c3 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:52.163383 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad360f1-402e-4856-a2cc-10f7455016c3 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:52.163596 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad360f1-402e-4856-a2cc-10f7455016c3 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:52.165808 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 885/1779] 10.222.0.11 () {54 vars in 921 bytes} [Wed May 4 21:46:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:46:52.166992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad360f1-402e-4856-a2cc-10f7455016c3 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:52.177425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191be4f-304b-45de-b82a-5642db6c56dd admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:52.189694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309ac67-f632-4c19-9f58-e49fb5151658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:52.190463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309ac67-f632-4c19-9f58-e49fb5151658 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:52.191531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309ac67-f632-4c19-9f58-e49fb5151658 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:52.191884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309ac67-f632-4c19-9f58-e49fb5151658 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:52.193490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad360f1-402e-4856-a2cc-10f7455016c3 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:52.194107 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309ac67-f632-4c19-9f58-e49fb5151658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:52.199657 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309ac67-f632-4c19-9f58-e49fb5151658 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:52.210209 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3b4d8-cb4d-468f-8d8f-e009041a6d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:52.211626 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3b4d8-cb4d-468f-8d8f-e009041a6d51 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:52.211965 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3b4d8-cb4d-468f-8d8f-e009041a6d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:52.212486 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3b4d8-cb4d-468f-8d8f-e009041a6d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:52.213545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3b4d8-cb4d-468f-8d8f-e009041a6d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:52.215914 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3b4d8-cb4d-468f-8d8f-e009041a6d51 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:52.253811 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 886/1781] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:52.253811 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3b4d8-cb4d-468f-8d8f-e009041a6d51 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:52.254117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 895/1781] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:52 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:52.254117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309ac67-f632-4c19-9f58-e49fb5151658 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:52.277844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3b4d8-cb4d-468f-8d8f-e009041a6d51 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:52.278928 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309ac67-f632-4c19-9f58-e49fb5151658 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:52.290785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602f87e-7ce6-485a-9094-2493e3788967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:52.292518 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602f87e-7ce6-485a-9094-2493e3788967 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:52.292854 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec47cfb-c4a0-444f-828e-7ed0966291ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:52.294000 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec47cfb-c4a0-444f-828e-7ed0966291ee admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:52.295611 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602f87e-7ce6-485a-9094-2493e3788967 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:52.296153 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec47cfb-c4a0-444f-828e-7ed0966291ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:52.296491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602f87e-7ce6-485a-9094-2493e3788967 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:52.297803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602f87e-7ce6-485a-9094-2493e3788967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:52.298218 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec47cfb-c4a0-444f-828e-7ed0966291ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:52.301360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602f87e-7ce6-485a-9094-2493e3788967 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:52.301618 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec47cfb-c4a0-444f-828e-7ed0966291ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:52.303938 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec47cfb-c4a0-444f-828e-7ed0966291ee admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:52.333904 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 887/1782] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:52.335231 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec47cfb-c4a0-444f-828e-7ed0966291ee admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:52.340716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 896/1783] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:52.340716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602f87e-7ce6-485a-9094-2493e3788967 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:52.355145 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec47cfb-c4a0-444f-828e-7ed0966291ee admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:52.362486 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19456d0-7ad9-4360-9bc1-b664d6aa28de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:52.364486 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19456d0-7ad9-4360-9bc1-b664d6aa28de admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:52.365203 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19456d0-7ad9-4360-9bc1-b664d6aa28de admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:52.365571 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19456d0-7ad9-4360-9bc1-b664d6aa28de admin admin] PATH_INFO: `/v3/projects/5ed13595f6e94d1d823dc8a61a41c2de/users/4962d29d73bc457eb4f5abd3104f4e4f/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:52.379650 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602f87e-7ce6-485a-9094-2493e3788967 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:52.395478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19456d0-7ad9-4360-9bc1-b664d6aa28de admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed13595f6e94d1d823dc8a61a41c2de, user_id=4962d29d73bc457eb4f5abd3104f4e4f, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:52.398263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb423a-1189-42da-aa8e-fb21b654840d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:52.398962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb423a-1189-42da-aa8e-fb21b654840d admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:52.399301 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb423a-1189-42da-aa8e-fb21b654840d admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:52.399656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb423a-1189-42da-aa8e-fb21b654840d admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:52.400520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb423a-1189-42da-aa8e-fb21b654840d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:52.402129 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb423a-1189-42da-aa8e-fb21b654840d admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:52.402520 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19456d0-7ad9-4360-9bc1-b664d6aa28de admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:52.431372 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 897/1784] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:52.431699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 888/1785] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:52 2022] PUT /identity/v3/projects/5ed13595f6e94d1d823dc8a61a41c2de/users/4962d29d73bc457eb4f5abd3104f4e4f/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:52.434692 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb423a-1189-42da-aa8e-fb21b654840d admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:52.434824 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19456d0-7ad9-4360-9bc1-b664d6aa28de admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:52.452543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb423a-1189-42da-aa8e-fb21b654840d admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:52.589968 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19456d0-7ad9-4360-9bc1-b664d6aa28de admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:52.604223 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbf331-6d82-41de-a6ab-890429e51276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:52.605677 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbf331-6d82-41de-a6ab-890429e51276 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:52.605677 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbf331-6d82-41de-a6ab-890429e51276 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:52.611536 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbf331-6d82-41de-a6ab-890429e51276 admin admin] PATH_INFO: `/v3/projects/00ccdf2f64b840b6a000977f8bb3c2db/users/441c2bb144e142d78d0930941bfb0781/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:52.622061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66f022-6171-4b72-83a9-6151cfe5746e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:52.622859 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66f022-6171-4b72-83a9-6151cfe5746e admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:52.623236 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66f022-6171-4b72-83a9-6151cfe5746e admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:52.623934 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66f022-6171-4b72-83a9-6151cfe5746e admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:52.624475 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66f022-6171-4b72-83a9-6151cfe5746e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:52.626151 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66f022-6171-4b72-83a9-6151cfe5746e admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:52.641002 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbf331-6d82-41de-a6ab-890429e51276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ccdf2f64b840b6a000977f8bb3c2db, user_id=441c2bb144e142d78d0930941bfb0781, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:52.644420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbf331-6d82-41de-a6ab-890429e51276 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:52.697760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 898/1786] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:52.698467 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66f022-6171-4b72-83a9-6151cfe5746e admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:52.707382 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 889/1787] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:52 2022] PUT /identity/v3/projects/00ccdf2f64b840b6a000977f8bb3c2db/users/441c2bb144e142d78d0930941bfb0781/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:52.723590 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4ad3e-f7bc-4348-ba72-2d066d1bd7aa None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:52.723866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4ad3e-f7bc-4348-ba72-2d066d1bd7aa None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:52.724149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4ad3e-f7bc-4348-ba72-2d066d1bd7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:52.749496 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66f022-6171-4b72-83a9-6151cfe5746e admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:52.785678 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-2fb4ad3e-f7bc-4348-ba72-2d066d1bd7aa None None] MFA Rules not processed for user `f4f207481ccb4cfcbbcffd9df73d2985`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:52.792642 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-2fb4ad3e-f7bc-4348-ba72-2d066d1bd7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:52.904127 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd592f-d3ae-4ddc-896e-8cbe76b37489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:52.904836 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd592f-d3ae-4ddc-896e-8cbe76b37489 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:52.905125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd592f-d3ae-4ddc-896e-8cbe76b37489 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:52.905488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd592f-d3ae-4ddc-896e-8cbe76b37489 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:52.906383 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd592f-d3ae-4ddc-896e-8cbe76b37489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:52.908057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd592f-d3ae-4ddc-896e-8cbe76b37489 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:52.947612 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 899/1788] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:52.950869 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd592f-d3ae-4ddc-896e-8cbe76b37489 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:52.970748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd592f-d3ae-4ddc-896e-8cbe76b37489 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:52.976908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 890/1789] 10.222.0.11 () {58 vars in 1018 bytes} [Wed May 4 21:46:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:52.978267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44562b0-dd94-410b-84bb-c05df0013d1d None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:52.978558 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44562b0-dd94-410b-84bb-c05df0013d1d None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:52.978842 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44562b0-dd94-410b-84bb-c05df0013d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:52.984044 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304f37b-d179-4516-aded-eaf06722f6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:52.985457 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304f37b-d179-4516-aded-eaf06722f6cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:52.985829 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304f37b-d179-4516-aded-eaf06722f6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:52.986183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304f37b-d179-4516-aded-eaf06722f6cd admin admin] PATH_INFO: `/v3/projects/a5ae2ad8cbb14c2198432bde6ab159de/users/795a7ca387654bf7820df45e76318686/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:53.003799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304f37b-d179-4516-aded-eaf06722f6cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ae2ad8cbb14c2198432bde6ab159de, user_id=795a7ca387654bf7820df45e76318686, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:53.007308 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304f37b-d179-4516-aded-eaf06722f6cd admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:53.010379 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-b44562b0-dd94-410b-84bb-c05df0013d1d None None] MFA Rules not processed for user `441c2bb144e142d78d0930941bfb0781`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:53.011964 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b44562b0-dd94-410b-84bb-c05df0013d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:53.034757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 900/1790] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:52 2022] PUT /identity/v3/projects/a5ae2ad8cbb14c2198432bde6ab159de/users/795a7ca387654bf7820df45e76318686/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:53.046274 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304f37b-d179-4516-aded-eaf06722f6cd admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:53.132152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304f37b-d179-4516-aded-eaf06722f6cd admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:53.141101 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e01d39-9916-4317-823b-070b21b5961a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:53.142182 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e01d39-9916-4317-823b-070b21b5961a admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:53.142537 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e01d39-9916-4317-823b-070b21b5961a admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:53.142997 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e01d39-9916-4317-823b-070b21b5961a admin admin] PATH_INFO: `/v3/projects/5ed13595f6e94d1d823dc8a61a41c2de/users/4962d29d73bc457eb4f5abd3104f4e4f/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:53.145310 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e01d39-9916-4317-823b-070b21b5961a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed13595f6e94d1d823dc8a61a41c2de, user_id=4962d29d73bc457eb4f5abd3104f4e4f, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:53.149658 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e01d39-9916-4317-823b-070b21b5961a admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:53.153125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 891/1791] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:53.157922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44562b0-dd94-410b-84bb-c05df0013d1d None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:53.160047 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b44562b0-dd94-410b-84bb-c05df0013d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:53.163530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 901/1792] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:53 2022] PUT /identity/v3/projects/5ed13595f6e94d1d823dc8a61a41c2de/users/4962d29d73bc457eb4f5abd3104f4e4f/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:53.166145 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb1c5d-a38a-47a6-9d60-595203ac2364 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:53.166513 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb1c5d-a38a-47a6-9d60-595203ac2364 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:53.166884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb1c5d-a38a-47a6-9d60-595203ac2364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:53.206856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44562b0-dd94-410b-84bb-c05df0013d1d None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:53.230516 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-25bb1c5d-a38a-47a6-9d60-595203ac2364 None None] MFA Rules not processed for user `795a7ca387654bf7820df45e76318686`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:53.232765 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-25bb1c5d-a38a-47a6-9d60-595203ac2364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:53.340832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82197a-b3c3-4e5d-9b0a-020ae76ac47e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:53.341771 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82197a-b3c3-4e5d-9b0a-020ae76ac47e service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:53.342135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82197a-b3c3-4e5d-9b0a-020ae76ac47e service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:53.342482 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82197a-b3c3-4e5d-9b0a-020ae76ac47e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:53.376977 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82197a-b3c3-4e5d-9b0a-020ae76ac47e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:53.380286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82197a-b3c3-4e5d-9b0a-020ae76ac47e service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:53.411138 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 892/1793] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:53.412096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82197a-b3c3-4e5d-9b0a-020ae76ac47e service nova] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:53.417395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-df82197a-b3c3-4e5d-9b0a-020ae76ac47e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:53.451778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 902/1794] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:53.456584 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb1c5d-a38a-47a6-9d60-595203ac2364 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:53.613826 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82197a-b3c3-4e5d-9b0a-020ae76ac47e service nova] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:53.622603 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496e959-154b-4997-bfa4-aa7035685462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:53.623607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496e959-154b-4997-bfa4-aa7035685462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:53.625250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496e959-154b-4997-bfa4-aa7035685462 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:53.625580 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496e959-154b-4997-bfa4-aa7035685462 admin admin] PATH_INFO: `/v3/projects/598582fd35064ff9acabce9c861d39e4` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:53.631767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496e959-154b-4997-bfa4-aa7035685462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=598582fd35064ff9acabce9c861d39e4)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:53.643389 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496e959-154b-4997-bfa4-aa7035685462 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:53.674132 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb1c5d-a38a-47a6-9d60-595203ac2364 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:53.688011 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82d77c-421c-427f-bfb7-43f9b91298c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:53.689234 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82d77c-421c-427f-bfb7-43f9b91298c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:53.689912 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82d77c-421c-427f-bfb7-43f9b91298c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:53.690403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82d77c-421c-427f-bfb7-43f9b91298c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:53.691407 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82d77c-421c-427f-bfb7-43f9b91298c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:53.698309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82d77c-421c-427f-bfb7-43f9b91298c4 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:53.799774 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 903/1795] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:53 2022] POST /identity/v3/projects => generated 371 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:53.807693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007303e5-34f6-4802-9bd1-b7d3e2920dae None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:53.808000 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007303e5-34f6-4802-9bd1-b7d3e2920dae None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:53.808263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007303e5-34f6-4802-9bd1-b7d3e2920dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:53.824886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c496e959-154b-4997-bfa4-aa7035685462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '598582fd35064ff9acabce9c861d39e4', 'request_id': 'req-c496e959-154b-4997-bfa4-aa7035685462'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:53.854990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c496e959-154b-4997-bfa4-aa7035685462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '598582fd35064ff9acabce9c861d39e4', 'request_id': 'req-c496e959-154b-4997-bfa4-aa7035685462'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:53.888542 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c496e959-154b-4997-bfa4-aa7035685462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '598582fd35064ff9acabce9c861d39e4', 'request_id': 'req-c496e959-154b-4997-bfa4-aa7035685462'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:53.933528 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-007303e5-34f6-4802-9bd1-b7d3e2920dae None None] MFA Rules not processed for user `4962d29d73bc457eb4f5abd3104f4e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:53.937356 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c496e959-154b-4997-bfa4-aa7035685462 admin admin] The token cache is being invalidate because project 598582fd35064ff9acabce9c861d39e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:46:53.937815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c496e959-154b-4997-bfa4-aa7035685462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:53.942033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-007303e5-34f6-4802-9bd1-b7d3e2920dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:53.942975 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c496e959-154b-4997-bfa4-aa7035685462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:53.949466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 893/1796] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:46:53 2022] DELETE /identity/v3/projects/598582fd35064ff9acabce9c861d39e4 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:53.955442 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d958e-74b5-4661-9495-a38246a87d9e None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:53.973728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d958e-74b5-4661-9495-a38246a87d9e None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:53.980108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d958e-74b5-4661-9495-a38246a87d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:54.080557 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-672d958e-74b5-4661-9495-a38246a87d9e None None] MFA Rules not processed for user `440a9798bf914da4af0398483e23e33c`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:54.084597 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-672d958e-74b5-4661-9495-a38246a87d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:54.222741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 904/1797] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:54.235117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007303e5-34f6-4802-9bd1-b7d3e2920dae None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:54.236584 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-007303e5-34f6-4802-9bd1-b7d3e2920dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:54.316675 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 894/1798] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:54.331179 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d958e-74b5-4661-9495-a38246a87d9e None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:54.336787 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-672d958e-74b5-4661-9495-a38246a87d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:54.469427 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007303e5-34f6-4802-9bd1-b7d3e2920dae None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:54.479283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3431de6-d70e-4a77-9174-f7e0929ec3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:54.480075 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3431de6-d70e-4a77-9174-f7e0929ec3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:54.480380 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3431de6-d70e-4a77-9174-f7e0929ec3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:54.480678 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3431de6-d70e-4a77-9174-f7e0929ec3c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:54.481330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3431de6-d70e-4a77-9174-f7e0929ec3c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:54.487978 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3431de6-d70e-4a77-9174-f7e0929ec3c3 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:54.517392 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d958e-74b5-4661-9495-a38246a87d9e None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:54.533049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4b56a-e6a7-407d-af1d-65219390b269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:54.535925 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4b56a-e6a7-407d-af1d-65219390b269 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:54.538523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4b56a-e6a7-407d-af1d-65219390b269 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:54.540788 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 905/1799] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:54 2022] POST /identity/v3/projects => generated 381 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:54.540992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4b56a-e6a7-407d-af1d-65219390b269 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:54.541752 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3431de6-d70e-4a77-9174-f7e0929ec3c3 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:54.542896 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4b56a-e6a7-407d-af1d-65219390b269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:54.547897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c3431de6-d70e-4a77-9174-f7e0929ec3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:54.550029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4b56a-e6a7-407d-af1d-65219390b269 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:54.600133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 895/1800] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:54 2022] POST /identity/v3/users => generated 292 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:54.604929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84836e5-f3cb-4cda-8198-3840c2b36d36 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:54.605259 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84836e5-f3cb-4cda-8198-3840c2b36d36 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:54.605507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84836e5-f3cb-4cda-8198-3840c2b36d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:54.649323 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-e84836e5-f3cb-4cda-8198-3840c2b36d36 None None] MFA Rules not processed for user `2bf26e013e10482fae90fd291b1b90b2`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:54.652391 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e84836e5-f3cb-4cda-8198-3840c2b36d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:54.712843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3431de6-d70e-4a77-9174-f7e0929ec3c3 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:54.731628 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f033c-6dec-40e1-b9e5-19ed9a2e884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:54.732338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f033c-6dec-40e1-b9e5-19ed9a2e884e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:54.732709 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f033c-6dec-40e1-b9e5-19ed9a2e884e admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:54.732880 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f033c-6dec-40e1-b9e5-19ed9a2e884e admin admin] PATH_INFO: `/v3/users/e4d485fdaed4471a940d9a7f1bd389c7` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:54.737131 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f033c-6dec-40e1-b9e5-19ed9a2e884e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d485fdaed4471a940d9a7f1bd389c7)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:54.739127 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f033c-6dec-40e1-b9e5-19ed9a2e884e admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:54.806029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 896/1801] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:54.807603 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84836e5-f3cb-4cda-8198-3840c2b36d36 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:54.810232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e84836e5-f3cb-4cda-8198-3840c2b36d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:54.858234 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-586f033c-6dec-40e1-b9e5-19ed9a2e884e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d485fdaed4471a940d9a7f1bd389c7'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:54.877205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-586f033c-6dec-40e1-b9e5-19ed9a2e884e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d485fdaed4471a940d9a7f1bd389c7'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:54.878484 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-586f033c-6dec-40e1-b9e5-19ed9a2e884e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d485fdaed4471a940d9a7f1bd389c7'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:54.919929 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-586f033c-6dec-40e1-b9e5-19ed9a2e884e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d485fdaed4471a940d9a7f1bd389c7'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:54.931091 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-586f033c-6dec-40e1-b9e5-19ed9a2e884e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d485fdaed4471a940d9a7f1bd389c7'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:54.940319 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 906/1802] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:46:54 2022] DELETE /identity/v3/users/e4d485fdaed4471a940d9a7f1bd389c7 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:54.941599 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fedc95-70d8-4e36-a144-cb493341699b None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:54.941889 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fedc95-70d8-4e36-a144-cb493341699b None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:54.942162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fedc95-70d8-4e36-a144-cb493341699b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:54.963420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84836e5-f3cb-4cda-8198-3840c2b36d36 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:54.979646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-a7fedc95-70d8-4e36-a144-cb493341699b None None] MFA Rules not processed for user `440a9798bf914da4af0398483e23e33c`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:54.980875 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a7fedc95-70d8-4e36-a144-cb493341699b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:55.079707 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89650381-b681-49d4-aae0-f846780472c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:55.080732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89650381-b681-49d4-aae0-f846780472c3 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:55.081122 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89650381-b681-49d4-aae0-f846780472c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:55.081699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89650381-b681-49d4-aae0-f846780472c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:55.085259 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 907/1803] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:55.086252 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-89650381-b681-49d4-aae0-f846780472c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:55.086654 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fedc95-70d8-4e36-a144-cb493341699b None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:55.088515 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a7fedc95-70d8-4e36-a144-cb493341699b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:55.174499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fedc95-70d8-4e36-a144-cb493341699b None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:55.180916 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867949c-8168-4b10-a070-17c73c1baa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:55.181619 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867949c-8168-4b10-a070-17c73c1baa3a admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:55.181910 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867949c-8168-4b10-a070-17c73c1baa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:55.182193 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867949c-8168-4b10-a070-17c73c1baa3a admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:55.183526 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867949c-8168-4b10-a070-17c73c1baa3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:55.185498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867949c-8168-4b10-a070-17c73c1baa3a admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:55.221992 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 908/1804] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:55 2022] POST /identity/v3/users => generated 297 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:55.223232 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867949c-8168-4b10-a070-17c73c1baa3a admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:55.225140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-2867949c-8168-4b10-a070-17c73c1baa3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:55.232940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89650381-b681-49d4-aae0-f846780472c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:55.237036 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89650381-b681-49d4-aae0-f846780472c3 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:55.238437 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867949c-8168-4b10-a070-17c73c1baa3a admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:55.243697 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c102a3-3f87-4271-b5e3-7781f4a08b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:55.244564 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c102a3-3f87-4271-b5e3-7781f4a08b6c admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:55.245015 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c102a3-3f87-4271-b5e3-7781f4a08b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:55.245472 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c102a3-3f87-4271-b5e3-7781f4a08b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:55.246378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c102a3-3f87-4271-b5e3-7781f4a08b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:55.248242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c102a3-3f87-4271-b5e3-7781f4a08b6c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:55.263994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 897/1805] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:55.265195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89650381-b681-49d4-aae0-f846780472c3 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:55.270094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-89650381-b681-49d4-aae0-f846780472c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:55.301699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 909/1806] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:55.307205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c102a3-3f87-4271-b5e3-7781f4a08b6c admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:55.338165 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c102a3-3f87-4271-b5e3-7781f4a08b6c admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:55.350637 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4d020-ebb5-4de5-85d4-2f3618fc70e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:55.353787 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4d020-ebb5-4de5-85d4-2f3618fc70e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:55.354469 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4d020-ebb5-4de5-85d4-2f3618fc70e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:55.354755 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4d020-ebb5-4de5-85d4-2f3618fc70e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:55.355610 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4d020-ebb5-4de5-85d4-2f3618fc70e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:55.358285 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4d020-ebb5-4de5-85d4-2f3618fc70e2 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:55.382352 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 910/1807] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:55.382352 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4d020-ebb5-4de5-85d4-2f3618fc70e2 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:55.392025 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4d020-ebb5-4de5-85d4-2f3618fc70e2 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:55.400454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26e457-45b8-490a-92bd-fb51f3a35545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:55.401361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26e457-45b8-490a-92bd-fb51f3a35545 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:55.401645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26e457-45b8-490a-92bd-fb51f3a35545 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:55.402062 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26e457-45b8-490a-92bd-fb51f3a35545 admin admin] PATH_INFO: `/v3/projects/54e2a572ff93428db3e9d3ef4b2adea8/users/41f87e35a5d4493ba654eb0a84554e0e/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:55.412453 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89650381-b681-49d4-aae0-f846780472c3 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:55.420261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd7ce7-4850-4bc8-a3c9-c19cf7a6bd3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:55.421433 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd7ce7-4850-4bc8-a3c9-c19cf7a6bd3a service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:55.421814 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd7ce7-4850-4bc8-a3c9-c19cf7a6bd3a service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:55.422723 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd7ce7-4850-4bc8-a3c9-c19cf7a6bd3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:55.425398 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-65cd7ce7-4850-4bc8-a3c9-c19cf7a6bd3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:55.428243 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26e457-45b8-490a-92bd-fb51f3a35545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e2a572ff93428db3e9d3ef4b2adea8, user_id=41f87e35a5d4493ba654eb0a84554e0e, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:55.431532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26e457-45b8-490a-92bd-fb51f3a35545 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:55.439429 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd7ce7-4850-4bc8-a3c9-c19cf7a6bd3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:55.441340 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd7ce7-4850-4bc8-a3c9-c19cf7a6bd3a service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:55.460416 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 898/1808] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:55.461423 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd7ce7-4850-4bc8-a3c9-c19cf7a6bd3a service nova] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:55.461596 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 911/1809] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:55 2022] PUT /identity/v3/projects/54e2a572ff93428db3e9d3ef4b2adea8/users/41f87e35a5d4493ba654eb0a84554e0e/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:55.462690 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26e457-45b8-490a-92bd-fb51f3a35545 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:55.471442 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-65cd7ce7-4850-4bc8-a3c9-c19cf7a6bd3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:55.499289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd7ce7-4850-4bc8-a3c9-c19cf7a6bd3a service nova] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:55.591406 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26e457-45b8-490a-92bd-fb51f3a35545 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:55.597413 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e5430-ce28-44b0-a7d7-83d29a7cfd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:55.598812 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e5430-ce28-44b0-a7d7-83d29a7cfd67 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:55.599263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e5430-ce28-44b0-a7d7-83d29a7cfd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:55.599857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e5430-ce28-44b0-a7d7-83d29a7cfd67 admin admin] PATH_INFO: `/v3/projects/77c2c6a32563414b98c6c7ce5efc76d5/users/9b7bf7398f884c2481c235e778a872b1/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:55.601316 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f21e2-4c46-47bc-a017-7dc7e6420d76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:55.603271 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f21e2-4c46-47bc-a017-7dc7e6420d76 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:55.605909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f21e2-4c46-47bc-a017-7dc7e6420d76 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:55.606322 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f21e2-4c46-47bc-a017-7dc7e6420d76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:55.620503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e5430-ce28-44b0-a7d7-83d29a7cfd67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77c2c6a32563414b98c6c7ce5efc76d5, user_id=9b7bf7398f884c2481c235e778a872b1, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:55.624266 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e5430-ce28-44b0-a7d7-83d29a7cfd67 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:55.629947 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f37f21e2-4c46-47bc-a017-7dc7e6420d76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:55.646725 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 912/1810] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:55 2022] PUT /identity/v3/projects/77c2c6a32563414b98c6c7ce5efc76d5/users/9b7bf7398f884c2481c235e778a872b1/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:55.647975 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e5430-ce28-44b0-a7d7-83d29a7cfd67 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:55.753014 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f21e2-4c46-47bc-a017-7dc7e6420d76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:55.755443 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e5430-ce28-44b0-a7d7-83d29a7cfd67 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:55.755778 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f21e2-4c46-47bc-a017-7dc7e6420d76 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:55.763179 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773ebf4-aeb7-4744-8f3a-2c2a6e0c9e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:55.764217 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773ebf4-aeb7-4744-8f3a-2c2a6e0c9e6c admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:55.764636 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773ebf4-aeb7-4744-8f3a-2c2a6e0c9e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:55.765225 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773ebf4-aeb7-4744-8f3a-2c2a6e0c9e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:55.766957 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773ebf4-aeb7-4744-8f3a-2c2a6e0c9e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:55.768834 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773ebf4-aeb7-4744-8f3a-2c2a6e0c9e6c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:55.774748 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 899/1811] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:55.775871 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f21e2-4c46-47bc-a017-7dc7e6420d76 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:55.785161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 913/1812] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:55.787899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773ebf4-aeb7-4744-8f3a-2c2a6e0c9e6c admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:55.789556 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f21e2-4c46-47bc-a017-7dc7e6420d76 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:55.796618 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e86dd9-3e6d-4bb4-8123-c61dccf7a8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:55.797685 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e86dd9-3e6d-4bb4-8123-c61dccf7a8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:55.798158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e86dd9-3e6d-4bb4-8123-c61dccf7a8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:55.798909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e86dd9-3e6d-4bb4-8123-c61dccf7a8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:55.800644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e86dd9-3e6d-4bb4-8123-c61dccf7a8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:55.806019 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e86dd9-3e6d-4bb4-8123-c61dccf7a8c1 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:55.814806 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773ebf4-aeb7-4744-8f3a-2c2a6e0c9e6c admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:55.822407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 900/1813] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:55.823538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e86dd9-3e6d-4bb4-8123-c61dccf7a8c1 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:55.827021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa185d2-eee3-4741-9dfc-18ccaae923d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:55.828289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa185d2-eee3-4741-9dfc-18ccaae923d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:55.828577 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa185d2-eee3-4741-9dfc-18ccaae923d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:55.828855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa185d2-eee3-4741-9dfc-18ccaae923d1 admin admin] PATH_INFO: `/v3/projects/54e2a572ff93428db3e9d3ef4b2adea8/users/41f87e35a5d4493ba654eb0a84554e0e/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:55.831829 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa185d2-eee3-4741-9dfc-18ccaae923d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e2a572ff93428db3e9d3ef4b2adea8, user_id=41f87e35a5d4493ba654eb0a84554e0e, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:55.836035 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa185d2-eee3-4741-9dfc-18ccaae923d1 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:55.840870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e86dd9-3e6d-4bb4-8123-c61dccf7a8c1 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:55.846934 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e63bf-095d-42e9-96c3-ea3aafcf7a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:55.848558 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e63bf-095d-42e9-96c3-ea3aafcf7a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:55.848952 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e63bf-095d-42e9-96c3-ea3aafcf7a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:55.849340 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e63bf-095d-42e9-96c3-ea3aafcf7a4f admin admin] PATH_INFO: `/v3/projects/77c2c6a32563414b98c6c7ce5efc76d5/users/9b7bf7398f884c2481c235e778a872b1/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:55.859472 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 914/1814] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:55 2022] PUT /identity/v3/projects/54e2a572ff93428db3e9d3ef4b2adea8/users/41f87e35a5d4493ba654eb0a84554e0e/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:46:55.860040 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e63bf-095d-42e9-96c3-ea3aafcf7a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=77c2c6a32563414b98c6c7ce5efc76d5, user_id=9b7bf7398f884c2481c235e778a872b1, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:55.860040 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e63bf-095d-42e9-96c3-ea3aafcf7a4f admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:55.862945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a218d-d241-4aab-b3e8-e045bc0d9c9f None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:55.864097 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a218d-d241-4aab-b3e8-e045bc0d9c9f None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:55.864363 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a218d-d241-4aab-b3e8-e045bc0d9c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:55.897861 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 901/1815] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:55 2022] PUT /identity/v3/projects/77c2c6a32563414b98c6c7ce5efc76d5/users/9b7bf7398f884c2481c235e778a872b1/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:55.899837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb482-ff0d-40cd-aa23-d00c83db4d4e None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:55.900229 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb482-ff0d-40cd-aa23-d00c83db4d4e None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:55.901427 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb482-ff0d-40cd-aa23-d00c83db4d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:55.931251 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-800a218d-d241-4aab-b3e8-e045bc0d9c9f None None] MFA Rules not processed for user `41f87e35a5d4493ba654eb0a84554e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:55.934927 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-800a218d-d241-4aab-b3e8-e045bc0d9c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:55.978579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-761eb482-ff0d-40cd-aa23-d00c83db4d4e None None] MFA Rules not processed for user `9b7bf7398f884c2481c235e778a872b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:55.980216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-761eb482-ff0d-40cd-aa23-d00c83db4d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:56.107488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 915/1816] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:55 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:56.119591 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a218d-d241-4aab-b3e8-e045bc0d9c9f None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:56.122011 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-800a218d-d241-4aab-b3e8-e045bc0d9c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:56.176311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 902/1817] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:56.264408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a218d-d241-4aab-b3e8-e045bc0d9c9f None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:56.269087 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af017311-936e-417f-ab46-71cd77f72f93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:56.269814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af017311-936e-417f-ab46-71cd77f72f93 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:56.270091 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af017311-936e-417f-ab46-71cd77f72f93 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:56.270381 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af017311-936e-417f-ab46-71cd77f72f93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:56.282003 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af017311-936e-417f-ab46-71cd77f72f93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:56.283753 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af017311-936e-417f-ab46-71cd77f72f93 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:56.318328 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 916/1818] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:56 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:46:56.376063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eb482-ff0d-40cd-aa23-d00c83db4d4e None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:56.407997 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eb482-ff0d-40cd-aa23-d00c83db4d4e None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:56.418952 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daaa65-212a-4d60-b0a2-70647c7953a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:56.419983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daaa65-212a-4d60-b0a2-70647c7953a7 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:56.421859 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daaa65-212a-4d60-b0a2-70647c7953a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:56.422180 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daaa65-212a-4d60-b0a2-70647c7953a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:56.453813 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00daaa65-212a-4d60-b0a2-70647c7953a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:56.458463 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00daaa65-212a-4d60-b0a2-70647c7953a7 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:56.494656 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 903/1819] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:56.615289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af017311-936e-417f-ab46-71cd77f72f93 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:56.616750 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-af017311-936e-417f-ab46-71cd77f72f93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:56.850421 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af017311-936e-417f-ab46-71cd77f72f93 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:56.866859 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d88a9b-41b0-4b44-9ccd-12c6cdbdc564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:56.866859 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88a9b-41b0-4b44-9ccd-12c6cdbdc564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:56.866859 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88a9b-41b0-4b44-9ccd-12c6cdbdc564 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:56.866859 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88a9b-41b0-4b44-9ccd-12c6cdbdc564 admin admin] PATH_INFO: `/v3/projects/3bf42ddcbd6f4e7c85ba1d014494d651` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:56.867814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d88a9b-41b0-4b44-9ccd-12c6cdbdc564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf42ddcbd6f4e7c85ba1d014494d651)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:56.869742 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d88a9b-41b0-4b44-9ccd-12c6cdbdc564 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:56.980298 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-f9d88a9b-41b0-4b44-9ccd-12c6cdbdc564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf42ddcbd6f4e7c85ba1d014494d651', 'request_id': 'req-f9d88a9b-41b0-4b44-9ccd-12c6cdbdc564'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:57.000051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-f9d88a9b-41b0-4b44-9ccd-12c6cdbdc564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf42ddcbd6f4e7c85ba1d014494d651', 'request_id': 'req-f9d88a9b-41b0-4b44-9ccd-12c6cdbdc564'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:57.011328 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-f9d88a9b-41b0-4b44-9ccd-12c6cdbdc564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf42ddcbd6f4e7c85ba1d014494d651', 'request_id': 'req-f9d88a9b-41b0-4b44-9ccd-12c6cdbdc564'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:57.030284 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-f9d88a9b-41b0-4b44-9ccd-12c6cdbdc564 admin admin] The token cache is being invalidate because project 3bf42ddcbd6f4e7c85ba1d014494d651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:46:57.031445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-f9d88a9b-41b0-4b44-9ccd-12c6cdbdc564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:57.032780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-f9d88a9b-41b0-4b44-9ccd-12c6cdbdc564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:57.040441 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 917/1820] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:46:56 2022] DELETE /identity/v3/projects/3bf42ddcbd6f4e7c85ba1d014494d651 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:57.042635 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18794d2e-f654-4139-862f-faf9c07885da None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:57.043091 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18794d2e-f654-4139-862f-faf9c07885da None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:57.043221 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18794d2e-f654-4139-862f-faf9c07885da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:57.079891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-18794d2e-f654-4139-862f-faf9c07885da None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:57.081269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-18794d2e-f654-4139-862f-faf9c07885da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:57.262131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 904/1821] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:57.263983 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbaa54-4961-4d1f-a905-04483a4fd4bf None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:57.264428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbaa54-4961-4d1f-a905-04483a4fd4bf None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:57.264887 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbaa54-4961-4d1f-a905-04483a4fd4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:57.303563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-6abbaa54-4961-4d1f-a905-04483a4fd4bf None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:57.305203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-6abbaa54-4961-4d1f-a905-04483a4fd4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:57.326443 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 918/1822] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:57.332088 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18794d2e-f654-4139-862f-faf9c07885da None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:57.358490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18794d2e-f654-4139-862f-faf9c07885da None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:57.374541 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8eb85-7930-4e38-9402-74e9e6374372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:57.376426 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8eb85-7930-4e38-9402-74e9e6374372 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:57.377219 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8eb85-7930-4e38-9402-74e9e6374372 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:57.377739 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8eb85-7930-4e38-9402-74e9e6374372 admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:57.379033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8eb85-7930-4e38-9402-74e9e6374372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:46:57.379268 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8eb85-7930-4e38-9402-74e9e6374372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:57.381379 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8eb85-7930-4e38-9402-74e9e6374372 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:57.399486 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 905/1823] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:46:57.405476 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbaa54-4961-4d1f-a905-04483a4fd4bf None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:57.417148 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbaa54-4961-4d1f-a905-04483a4fd4bf None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:57.437296 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a343aa-dd6b-41c9-b009-49a3c0697594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:57.438143 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a343aa-dd6b-41c9-b009-49a3c0697594 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:57.440595 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a343aa-dd6b-41c9-b009-49a3c0697594 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:57.441011 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a343aa-dd6b-41c9-b009-49a3c0697594 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:57.444254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a343aa-dd6b-41c9-b009-49a3c0697594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:57.446657 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a343aa-dd6b-41c9-b009-49a3c0697594 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:57.467123 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8eb85-7930-4e38-9402-74e9e6374372 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:57.470204 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b0b8eb85-7930-4e38-9402-74e9e6374372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:57.494166 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8eb85-7930-4e38-9402-74e9e6374372 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:57.502327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3dd30-82c9-4751-9bb8-4a8002129dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:57.506620 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 919/1824] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:57 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:46:57.506620 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a343aa-dd6b-41c9-b009-49a3c0697594 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:57.506620 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-47a343aa-dd6b-41c9-b009-49a3c0697594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:57.508532 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3dd30-82c9-4751-9bb8-4a8002129dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:57.509387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3dd30-82c9-4751-9bb8-4a8002129dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:57.509828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3dd30-82c9-4751-9bb8-4a8002129dd7 admin admin] PATH_INFO: `/v3/users/441c2bb144e142d78d0930941bfb0781` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:57.511715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3dd30-82c9-4751-9bb8-4a8002129dd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=441c2bb144e142d78d0930941bfb0781)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:57.514936 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3dd30-82c9-4751-9bb8-4a8002129dd7 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:57.654175 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a343aa-dd6b-41c9-b009-49a3c0697594 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:57.670651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffb246-60d4-41c8-9fc9-860e2937fe4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:57.671736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffb246-60d4-41c8-9fc9-860e2937fe4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:57.672101 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffb246-60d4-41c8-9fc9-860e2937fe4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:57.672386 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffb246-60d4-41c8-9fc9-860e2937fe4d admin admin] PATH_INFO: `/v3/users/795a7ca387654bf7820df45e76318686` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:57.674198 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffb246-60d4-41c8-9fc9-860e2937fe4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=795a7ca387654bf7820df45e76318686)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:57.676131 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffb246-60d4-41c8-9fc9-860e2937fe4d admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:57.786501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ddffb246-60d4-41c8-9fc9-860e2937fe4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '795a7ca387654bf7820df45e76318686'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:57.808366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ddffb246-60d4-41c8-9fc9-860e2937fe4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '795a7ca387654bf7820df45e76318686'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:57.809148 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ddffb246-60d4-41c8-9fc9-860e2937fe4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '795a7ca387654bf7820df45e76318686'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:57.864209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ddffb246-60d4-41c8-9fc9-860e2937fe4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '795a7ca387654bf7820df45e76318686'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:57.880310 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ddffb246-60d4-41c8-9fc9-860e2937fe4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '795a7ca387654bf7820df45e76318686'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:57.898386 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 920/1825] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:46:57 2022] DELETE /identity/v3/users/795a7ca387654bf7820df45e76318686 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:57.899512 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffb246-60d4-41c8-9fc9-860e2937fe4d admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:57.906127 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ddffb246-60d4-41c8-9fc9-860e2937fe4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:58.134167 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffb246-60d4-41c8-9fc9-860e2937fe4d admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:58.136712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c4d3dd30-82c9-4751-9bb8-4a8002129dd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '441c2bb144e142d78d0930941bfb0781'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:58.149745 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14031b59-d27c-40b3-8e07-d4e8ef5e9c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:58.150713 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14031b59-d27c-40b3-8e07-d4e8ef5e9c3a admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:58.151343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14031b59-d27c-40b3-8e07-d4e8ef5e9c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:58.152643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14031b59-d27c-40b3-8e07-d4e8ef5e9c3a admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:58.152868 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c4d3dd30-82c9-4751-9bb8-4a8002129dd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '441c2bb144e142d78d0930941bfb0781'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:58.154467 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14031b59-d27c-40b3-8e07-d4e8ef5e9c3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:58.172474 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c4d3dd30-82c9-4751-9bb8-4a8002129dd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '441c2bb144e142d78d0930941bfb0781'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:58.173530 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c4d3dd30-82c9-4751-9bb8-4a8002129dd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '441c2bb144e142d78d0930941bfb0781'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:58.174324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c4d3dd30-82c9-4751-9bb8-4a8002129dd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '441c2bb144e142d78d0930941bfb0781'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:58.175426 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14031b59-d27c-40b3-8e07-d4e8ef5e9c3a admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:58.227643 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 906/1826] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:46:57 2022] DELETE /identity/v3/users/441c2bb144e142d78d0930941bfb0781 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:58.232701 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5088368-3a47-4dc6-aac1-8f1c5d015b38 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:58.233066 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5088368-3a47-4dc6-aac1-8f1c5d015b38 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:58.233323 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5088368-3a47-4dc6-aac1-8f1c5d015b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:58.235631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 921/1827] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:57 2022] POST /identity/v3/users => generated 297 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:58.241539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80ebaf-d5c7-49a2-bc93-2caf05d98016 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:58.241539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80ebaf-d5c7-49a2-bc93-2caf05d98016 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:58.246821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80ebaf-d5c7-49a2-bc93-2caf05d98016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:58.267774 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-d5088368-3a47-4dc6-aac1-8f1c5d015b38 None None] MFA Rules not processed for user `440a9798bf914da4af0398483e23e33c`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:58.269090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-d5088368-3a47-4dc6-aac1-8f1c5d015b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:58.308176 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-ad80ebaf-d5c7-49a2-bc93-2caf05d98016 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:58.309382 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ad80ebaf-d5c7-49a2-bc93-2caf05d98016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:58.417117 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 907/1828] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:58.418987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c967b0-dd76-4bdd-9397-e4e2751b7ef7 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:58.418987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c967b0-dd76-4bdd-9397-e4e2751b7ef7 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:58.423739 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c967b0-dd76-4bdd-9397-e4e2751b7ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:58.510278 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-71c967b0-dd76-4bdd-9397-e4e2751b7ef7 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:58.517637 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-71c967b0-dd76-4bdd-9397-e4e2751b7ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:58.518425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 922/1829] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:58.519357 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80ebaf-d5c7-49a2-bc93-2caf05d98016 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:58.525769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ad80ebaf-d5c7-49a2-bc93-2caf05d98016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:58.553090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80ebaf-d5c7-49a2-bc93-2caf05d98016 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:58.571414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 908/1830] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:58.577487 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c967b0-dd76-4bdd-9397-e4e2751b7ef7 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:58.580838 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-71c967b0-dd76-4bdd-9397-e4e2751b7ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:58.591459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0c4e8-a2c8-45c4-a617-2e5f32dd4669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:58.592266 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0c4e8-a2c8-45c4-a617-2e5f32dd4669 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:58.592548 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0c4e8-a2c8-45c4-a617-2e5f32dd4669 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:58.592830 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0c4e8-a2c8-45c4-a617-2e5f32dd4669 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:58.593573 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0c4e8-a2c8-45c4-a617-2e5f32dd4669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:58.595551 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0c4e8-a2c8-45c4-a617-2e5f32dd4669 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:58.614719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 923/1831] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:58.615631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0c4e8-a2c8-45c4-a617-2e5f32dd4669 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:58.629880 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0c4e8-a2c8-45c4-a617-2e5f32dd4669 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:58.635446 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4300a-8a88-46e2-a90f-6af9c48be232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:58.636204 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4300a-8a88-46e2-a90f-6af9c48be232 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:58.636466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4300a-8a88-46e2-a90f-6af9c48be232 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:58.636751 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4300a-8a88-46e2-a90f-6af9c48be232 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:58.637731 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4300a-8a88-46e2-a90f-6af9c48be232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:58.639444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4300a-8a88-46e2-a90f-6af9c48be232 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:58.667089 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 924/1832] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:58.670331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4300a-8a88-46e2-a90f-6af9c48be232 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:58.694510 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4300a-8a88-46e2-a90f-6af9c48be232 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:58.708166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ab4ab-25e8-447b-bb0e-5c6f4e48a913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:58.708796 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ab4ab-25e8-447b-bb0e-5c6f4e48a913 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:58.709088 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ab4ab-25e8-447b-bb0e-5c6f4e48a913 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:58.709374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ab4ab-25e8-447b-bb0e-5c6f4e48a913 admin admin] PATH_INFO: `/v3/projects/ee8a19fbe76d4d7e98ae9653d68a9510/users/4af780825d0f40dd9b9c548d706333ce/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:58.759951 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c967b0-dd76-4bdd-9397-e4e2751b7ef7 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:58.760981 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ab4ab-25e8-447b-bb0e-5c6f4e48a913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8a19fbe76d4d7e98ae9653d68a9510, user_id=4af780825d0f40dd9b9c548d706333ce, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:58.770728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a3523-1939-4963-8573-0285c23ee36f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:58.771577 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a3523-1939-4963-8573-0285c23ee36f service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:58.772066 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a3523-1939-4963-8573-0285c23ee36f service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:58.772624 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a3523-1939-4963-8573-0285c23ee36f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:58.778157 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ab4ab-25e8-447b-bb0e-5c6f4e48a913 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:58.802592 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a3523-1939-4963-8573-0285c23ee36f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:58.806595 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 925/1833] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:58 2022] PUT /identity/v3/projects/ee8a19fbe76d4d7e98ae9653d68a9510/users/4af780825d0f40dd9b9c548d706333ce/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:58.815373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ab4ab-25e8-447b-bb0e-5c6f4e48a913 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:58.819163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a3523-1939-4963-8573-0285c23ee36f service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:58.854299 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 909/1834] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:58.860360 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1f9a2-c8f2-4672-b92e-87f103d82897 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:58.860674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1f9a2-c8f2-4672-b92e-87f103d82897 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:58.860953 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1f9a2-c8f2-4672-b92e-87f103d82897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:58.976920 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-1bc1f9a2-c8f2-4672-b92e-87f103d82897 None None] MFA Rules not processed for user `4af780825d0f40dd9b9c548d706333ce`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:58.978792 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-1bc1f9a2-c8f2-4672-b92e-87f103d82897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:58.985542 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ab4ab-25e8-447b-bb0e-5c6f4e48a913 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:58.991026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642c67b-f107-4972-b154-56f782978688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:58.992041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642c67b-f107-4972-b154-56f782978688 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:58.992325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642c67b-f107-4972-b154-56f782978688 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:58.993050 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642c67b-f107-4972-b154-56f782978688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:59.088021 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 910/1835] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:46:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:59.089349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1f9a2-c8f2-4672-b92e-87f103d82897 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:59.137815 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642c67b-f107-4972-b154-56f782978688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:59.140237 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642c67b-f107-4972-b154-56f782978688 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:59.168033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 926/1836] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:59.300467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1f9a2-c8f2-4672-b92e-87f103d82897 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:59.311425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec1230-c937-4991-93e5-7790576a6d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:59.312601 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec1230-c937-4991-93e5-7790576a6d02 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:59.313100 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec1230-c937-4991-93e5-7790576a6d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:59.313523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec1230-c937-4991-93e5-7790576a6d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:59.314467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec1230-c937-4991-93e5-7790576a6d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:59.317662 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec1230-c937-4991-93e5-7790576a6d02 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:59.366843 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 911/1837] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:46:59 2022] POST /identity/v3/projects => generated 393 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:59.368235 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642c67b-f107-4972-b154-56f782978688 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:59.382630 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642c67b-f107-4972-b154-56f782978688 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:59.547837 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67d13b-b0c6-477c-828a-f326f2e596d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:59.548543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67d13b-b0c6-477c-828a-f326f2e596d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:59.548832 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67d13b-b0c6-477c-828a-f326f2e596d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:59.549103 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67d13b-b0c6-477c-828a-f326f2e596d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:59.550318 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67d13b-b0c6-477c-828a-f326f2e596d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:59.552077 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67d13b-b0c6-477c-828a-f326f2e596d9 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:59.602315 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 927/1838] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:46:59 2022] POST /identity/v3/users => generated 303 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:59.605963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec1230-c937-4991-93e5-7790576a6d02 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:59.618050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec1230-c937-4991-93e5-7790576a6d02 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:59.646363 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e253f-aa73-43ba-9d96-a26d6ca55dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:59.646810 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e253f-aa73-43ba-9d96-a26d6ca55dec admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:59.647136 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e253f-aa73-43ba-9d96-a26d6ca55dec admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:59.647416 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e253f-aa73-43ba-9d96-a26d6ca55dec admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:59.648647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e253f-aa73-43ba-9d96-a26d6ca55dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:59.654061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e253f-aa73-43ba-9d96-a26d6ca55dec admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:59.673714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 912/1839] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:59.677874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67d13b-b0c6-477c-828a-f326f2e596d9 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:59.689489 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67d13b-b0c6-477c-828a-f326f2e596d9 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:59.719791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc032f3-47e6-43e2-bfd7-489e4fee1fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:59.723134 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc032f3-47e6-43e2-bfd7-489e4fee1fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:59.723639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc032f3-47e6-43e2-bfd7-489e4fee1fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:59.724129 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc032f3-47e6-43e2-bfd7-489e4fee1fa8 admin admin] PATH_INFO: `/v3/projects/33bd83341bcc46d8b2e2838fc44b7402/users/07173641f49544f7b3cb03652e6a931f/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:59.753128 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc032f3-47e6-43e2-bfd7-489e4fee1fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33bd83341bcc46d8b2e2838fc44b7402, user_id=07173641f49544f7b3cb03652e6a931f, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:59.757635 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc032f3-47e6-43e2-bfd7-489e4fee1fa8 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:59.787791 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e253f-aa73-43ba-9d96-a26d6ca55dec admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:59.788341 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 928/1840] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:59 2022] PUT /identity/v3/projects/33bd83341bcc46d8b2e2838fc44b7402/users/07173641f49544f7b3cb03652e6a931f/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:46:59.800638 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e253f-aa73-43ba-9d96-a26d6ca55dec admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:59.808080 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4785eee-3c6b-47f4-9be1-0b439160ed90 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:59.809522 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4785eee-3c6b-47f4-9be1-0b439160ed90 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:59.810013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4785eee-3c6b-47f4-9be1-0b439160ed90 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:59.812378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 929/1841] 10.222.0.11 () {54 vars in 921 bytes} [Wed May 4 21:46:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:46:59.915600 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d36e3-be73-4380-b579-1ae50e829f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:59.917308 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d36e3-be73-4380-b579-1ae50e829f9e admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:59.918023 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d36e3-be73-4380-b579-1ae50e829f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:59.919212 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d36e3-be73-4380-b579-1ae50e829f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:59.920193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d36e3-be73-4380-b579-1ae50e829f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:59.922675 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d36e3-be73-4380-b579-1ae50e829f9e admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:59.936209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9966504-923a-4e27-9b15-5da39bcbf6ff None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:59.936209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9966504-923a-4e27-9b15-5da39bcbf6ff None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:59.936209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9966504-923a-4e27-9b15-5da39bcbf6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:59.973887 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 913/1842] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:59.976444 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d36e3-be73-4380-b579-1ae50e829f9e admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:59.997085 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-a9966504-923a-4e27-9b15-5da39bcbf6ff None None] MFA Rules not processed for user `f4f207481ccb4cfcbbcffd9df73d2985`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:00.000659 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a9966504-923a-4e27-9b15-5da39bcbf6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:00.018589 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d36e3-be73-4380-b579-1ae50e829f9e admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:00.037574 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760f904-f934-4bf9-aa8c-0c973c607fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:00.038494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760f904-f934-4bf9-aa8c-0c973c607fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:00.038889 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760f904-f934-4bf9-aa8c-0c973c607fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:00.039204 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760f904-f934-4bf9-aa8c-0c973c607fe7 admin admin] PATH_INFO: `/v3/projects/33bd83341bcc46d8b2e2838fc44b7402/users/07173641f49544f7b3cb03652e6a931f/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:00.044644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760f904-f934-4bf9-aa8c-0c973c607fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33bd83341bcc46d8b2e2838fc44b7402, user_id=07173641f49544f7b3cb03652e6a931f, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:00.052435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760f904-f934-4bf9-aa8c-0c973c607fe7 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:00.077888 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 914/1843] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:46:59 2022] PUT /identity/v3/projects/33bd83341bcc46d8b2e2838fc44b7402/users/07173641f49544f7b3cb03652e6a931f/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:00.078794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760f904-f934-4bf9-aa8c-0c973c607fe7 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:00.089596 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-2760f904-f934-4bf9-aa8c-0c973c607fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:00.155396 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 930/1844] 10.222.0.11 () {58 vars in 1018 bytes} [Wed May 4 21:46:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:00.160286 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236d9d2-145e-426d-82b2-d05d5dc46ce6 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:00.160785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236d9d2-145e-426d-82b2-d05d5dc46ce6 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:00.161207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236d9d2-145e-426d-82b2-d05d5dc46ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:00.187859 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760f904-f934-4bf9-aa8c-0c973c607fe7 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:00.194382 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb6fc8-cdc6-47ae-926a-4e28aae9984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:00.195446 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb6fc8-cdc6-47ae-926a-4e28aae9984e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:00.195727 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb6fc8-cdc6-47ae-926a-4e28aae9984e admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:00.196002 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb6fc8-cdc6-47ae-926a-4e28aae9984e admin admin] PATH_INFO: `/v3/users/6952cb65b5cd4e8dae10ca61e33d1846` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:00.197989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-b236d9d2-145e-426d-82b2-d05d5dc46ce6 None None] MFA Rules not processed for user `07173641f49544f7b3cb03652e6a931f`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:00.200545 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-b236d9d2-145e-426d-82b2-d05d5dc46ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:00.200687 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb6fc8-cdc6-47ae-926a-4e28aae9984e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6952cb65b5cd4e8dae10ca61e33d1846)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:00.205899 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb6fc8-cdc6-47ae-926a-4e28aae9984e admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:00.278107 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-13bb6fc8-cdc6-47ae-926a-4e28aae9984e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6952cb65b5cd4e8dae10ca61e33d1846'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:00.289690 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-13bb6fc8-cdc6-47ae-926a-4e28aae9984e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6952cb65b5cd4e8dae10ca61e33d1846'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:00.300203 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-13bb6fc8-cdc6-47ae-926a-4e28aae9984e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6952cb65b5cd4e8dae10ca61e33d1846'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:00.302916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-13bb6fc8-cdc6-47ae-926a-4e28aae9984e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6952cb65b5cd4e8dae10ca61e33d1846'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:00.305669 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-13bb6fc8-cdc6-47ae-926a-4e28aae9984e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6952cb65b5cd4e8dae10ca61e33d1846'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:00.325348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 931/1845] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:00.333898 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 915/1846] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:00 2022] DELETE /identity/v3/users/6952cb65b5cd4e8dae10ca61e33d1846 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:00.337688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236d9d2-145e-426d-82b2-d05d5dc46ce6 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:00.339099 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-b236d9d2-145e-426d-82b2-d05d5dc46ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:00.341650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ce38e-eaa9-4da9-986c-f54770555043 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:00.342045 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ce38e-eaa9-4da9-986c-f54770555043 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:00.343375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ce38e-eaa9-4da9-986c-f54770555043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:00.381488 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-f14ce38e-eaa9-4da9-986c-f54770555043 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:00.383590 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f14ce38e-eaa9-4da9-986c-f54770555043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:00.453364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236d9d2-145e-426d-82b2-d05d5dc46ce6 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:00.499756 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 916/1847] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:00.522654 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893ee3e-15be-46d3-9000-f18a10db70aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:00.523469 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893ee3e-15be-46d3-9000-f18a10db70aa service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:00.523805 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893ee3e-15be-46d3-9000-f18a10db70aa service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:00.524122 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893ee3e-15be-46d3-9000-f18a10db70aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:00.525992 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-2893ee3e-15be-46d3-9000-f18a10db70aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:00.568599 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ce38e-eaa9-4da9-986c-f54770555043 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:00.573932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f14ce38e-eaa9-4da9-986c-f54770555043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:00.650752 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893ee3e-15be-46d3-9000-f18a10db70aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:00.654158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893ee3e-15be-46d3-9000-f18a10db70aa service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:00.658513 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ce38e-eaa9-4da9-986c-f54770555043 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:00.662981 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946eb86-128d-414f-81f8-14b494bb1442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:00.664383 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946eb86-128d-414f-81f8-14b494bb1442 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:00.664860 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946eb86-128d-414f-81f8-14b494bb1442 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:00.665361 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946eb86-128d-414f-81f8-14b494bb1442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:00.676216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946eb86-128d-414f-81f8-14b494bb1442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:00.678199 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946eb86-128d-414f-81f8-14b494bb1442 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:00.694785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 932/1848] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:47:00.696775 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 917/1849] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:47:00.764311 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893ee3e-15be-46d3-9000-f18a10db70aa service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:00.766127 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-2893ee3e-15be-46d3-9000-f18a10db70aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:00.784723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893ee3e-15be-46d3-9000-f18a10db70aa service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:00.790636 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9b46a-24fc-40e9-ae3b-6e162e3ce519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:00.791330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9b46a-24fc-40e9-ae3b-6e162e3ce519 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:00.791913 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9b46a-24fc-40e9-ae3b-6e162e3ce519 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:00.795210 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9b46a-24fc-40e9-ae3b-6e162e3ce519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:00.795210 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5fc9b46a-24fc-40e9-ae3b-6e162e3ce519 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:00.796640 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946eb86-128d-414f-81f8-14b494bb1442 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:00.798096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-d946eb86-128d-414f-81f8-14b494bb1442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:00.824443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946eb86-128d-414f-81f8-14b494bb1442 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:00.835568 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a1fba-550e-4f0e-8428-3de29e4c470a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:00.836454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a1fba-550e-4f0e-8428-3de29e4c470a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:00.837703 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a1fba-550e-4f0e-8428-3de29e4c470a admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:00.838723 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a1fba-550e-4f0e-8428-3de29e4c470a admin admin] PATH_INFO: `/v3/projects/00ccdf2f64b840b6a000977f8bb3c2db` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:00.841735 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a1fba-550e-4f0e-8428-3de29e4c470a admin admin] RBAC: Authorizing `identity:delete_project(project_id=00ccdf2f64b840b6a000977f8bb3c2db)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:00.844552 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a1fba-550e-4f0e-8428-3de29e4c470a admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:00.901271 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9b46a-24fc-40e9-ae3b-6e162e3ce519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:00.902927 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9b46a-24fc-40e9-ae3b-6e162e3ce519 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:00.916289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 933/1850] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:00.917204 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9b46a-24fc-40e9-ae3b-6e162e3ce519 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:00.918753 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5fc9b46a-24fc-40e9-ae3b-6e162e3ce519 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:00.967698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b52a1fba-550e-4f0e-8428-3de29e4c470a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00ccdf2f64b840b6a000977f8bb3c2db', 'request_id': 'req-b52a1fba-550e-4f0e-8428-3de29e4c470a'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:00.983341 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b52a1fba-550e-4f0e-8428-3de29e4c470a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00ccdf2f64b840b6a000977f8bb3c2db', 'request_id': 'req-b52a1fba-550e-4f0e-8428-3de29e4c470a'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:01.004546 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b52a1fba-550e-4f0e-8428-3de29e4c470a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00ccdf2f64b840b6a000977f8bb3c2db', 'request_id': 'req-b52a1fba-550e-4f0e-8428-3de29e4c470a'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:01.025060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b52a1fba-550e-4f0e-8428-3de29e4c470a admin admin] The token cache is being invalidate because project 00ccdf2f64b840b6a000977f8bb3c2db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:01.025292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b52a1fba-550e-4f0e-8428-3de29e4c470a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:01.030839 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b52a1fba-550e-4f0e-8428-3de29e4c470a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:01.031908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9b46a-24fc-40e9-ae3b-6e162e3ce519 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:01.034462 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 918/1851] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:00 2022] DELETE /identity/v3/projects/00ccdf2f64b840b6a000977f8bb3c2db => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:01.040324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a1fba-550e-4f0e-8428-3de29e4c470a admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:01.043896 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b52a1fba-550e-4f0e-8428-3de29e4c470a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:01.128441 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a230b-da3d-4769-b21f-b0121a5b614d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:01.129256 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a230b-da3d-4769-b21f-b0121a5b614d service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:01.129603 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a230b-da3d-4769-b21f-b0121a5b614d service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:01.129948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a230b-da3d-4769-b21f-b0121a5b614d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:01.133314 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-922a230b-da3d-4769-b21f-b0121a5b614d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:01.149421 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a230b-da3d-4769-b21f-b0121a5b614d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:01.154259 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a230b-da3d-4769-b21f-b0121a5b614d service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:01.173029 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 934/1852] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:01.192206 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a230b-da3d-4769-b21f-b0121a5b614d service nova] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:01.195471 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a1fba-550e-4f0e-8428-3de29e4c470a admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:01.197488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-922a230b-da3d-4769-b21f-b0121a5b614d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:01.207787 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb7770-a689-4ae4-89c9-a7532ae20767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:01.208697 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb7770-a689-4ae4-89c9-a7532ae20767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:01.208977 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb7770-a689-4ae4-89c9-a7532ae20767 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:01.209249 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb7770-a689-4ae4-89c9-a7532ae20767 admin admin] PATH_INFO: `/v3/users/41f87e35a5d4493ba654eb0a84554e0e` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:01.211965 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb7770-a689-4ae4-89c9-a7532ae20767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41f87e35a5d4493ba654eb0a84554e0e)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:01.215895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb7770-a689-4ae4-89c9-a7532ae20767 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:01.221656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a230b-da3d-4769-b21f-b0121a5b614d service nova] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:01.231741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb592f-26fe-49dc-8f3c-dde0f0d247d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:01.234231 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb592f-26fe-49dc-8f3c-dde0f0d247d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:01.234520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb592f-26fe-49dc-8f3c-dde0f0d247d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:01.234849 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb592f-26fe-49dc-8f3c-dde0f0d247d3 admin admin] PATH_INFO: `/v3/projects/a5ae2ad8cbb14c2198432bde6ab159de` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:01.236602 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb592f-26fe-49dc-8f3c-dde0f0d247d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ae2ad8cbb14c2198432bde6ab159de)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:01.239031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb592f-26fe-49dc-8f3c-dde0f0d247d3 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:01.335884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-16cb592f-26fe-49dc-8f3c-dde0f0d247d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ae2ad8cbb14c2198432bde6ab159de', 'request_id': 'req-16cb592f-26fe-49dc-8f3c-dde0f0d247d3'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:01.376035 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-16cb592f-26fe-49dc-8f3c-dde0f0d247d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ae2ad8cbb14c2198432bde6ab159de', 'request_id': 'req-16cb592f-26fe-49dc-8f3c-dde0f0d247d3'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:01.389387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-f0cb7770-a689-4ae4-89c9-a7532ae20767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41f87e35a5d4493ba654eb0a84554e0e'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:01.391003 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-16cb592f-26fe-49dc-8f3c-dde0f0d247d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ae2ad8cbb14c2198432bde6ab159de', 'request_id': 'req-16cb592f-26fe-49dc-8f3c-dde0f0d247d3'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:01.409865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-f0cb7770-a689-4ae4-89c9-a7532ae20767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41f87e35a5d4493ba654eb0a84554e0e'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:01.440801 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-16cb592f-26fe-49dc-8f3c-dde0f0d247d3 admin admin] The token cache is being invalidate because project a5ae2ad8cbb14c2198432bde6ab159de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:01.442194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-16cb592f-26fe-49dc-8f3c-dde0f0d247d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:01.443657 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-f0cb7770-a689-4ae4-89c9-a7532ae20767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41f87e35a5d4493ba654eb0a84554e0e'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:01.445821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-16cb592f-26fe-49dc-8f3c-dde0f0d247d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:01.447262 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-f0cb7770-a689-4ae4-89c9-a7532ae20767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41f87e35a5d4493ba654eb0a84554e0e'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:01.449274 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-f0cb7770-a689-4ae4-89c9-a7532ae20767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41f87e35a5d4493ba654eb0a84554e0e'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:01.453741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 935/1853] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:01 2022] DELETE /identity/v3/projects/a5ae2ad8cbb14c2198432bde6ab159de => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:01.457848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb592f-26fe-49dc-8f3c-dde0f0d247d3 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:01.464101 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-16cb592f-26fe-49dc-8f3c-dde0f0d247d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:01.526778 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 919/1854] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:01 2022] DELETE /identity/v3/users/41f87e35a5d4493ba654eb0a84554e0e => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:01.685910 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb592f-26fe-49dc-8f3c-dde0f0d247d3 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:01.778440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa364750-16a1-4b95-b74b-e7c5ea7eabcb None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:01.778805 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa364750-16a1-4b95-b74b-e7c5ea7eabcb None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:01.779309 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa364750-16a1-4b95-b74b-e7c5ea7eabcb None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:01.781308 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 920/1855] 10.222.0.11 () {54 vars in 921 bytes} [Wed May 4 21:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:47:01.812649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2562c0-743e-4245-a90d-fe915df70af8 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:01.812937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2562c0-743e-4245-a90d-fe915df70af8 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:01.813704 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2562c0-743e-4245-a90d-fe915df70af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:01.853903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbd537-3cca-435e-aa5b-8140ea846212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:01.854912 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-ad2562c0-743e-4245-a90d-fe915df70af8 None None] MFA Rules not processed for user `f4f207481ccb4cfcbbcffd9df73d2985`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:01.857350 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbd537-3cca-435e-aa5b-8140ea846212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:01.857645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbd537-3cca-435e-aa5b-8140ea846212 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:01.858755 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ad2562c0-743e-4245-a90d-fe915df70af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:01.859081 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbd537-3cca-435e-aa5b-8140ea846212 admin admin] PATH_INFO: `/v3/users/9b7bf7398f884c2481c235e778a872b1` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:01.863430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbd537-3cca-435e-aa5b-8140ea846212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b7bf7398f884c2481c235e778a872b1)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:01.869100 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbd537-3cca-435e-aa5b-8140ea846212 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:01.988388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-9ccbd537-3cca-435e-aa5b-8140ea846212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b7bf7398f884c2481c235e778a872b1'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:02.002653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-9ccbd537-3cca-435e-aa5b-8140ea846212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b7bf7398f884c2481c235e778a872b1'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:02.003935 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-9ccbd537-3cca-435e-aa5b-8140ea846212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b7bf7398f884c2481c235e778a872b1'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:02.019422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 921/1856] 10.222.0.11 () {58 vars in 1018 bytes} [Wed May 4 21:47:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:02.024577 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-9ccbd537-3cca-435e-aa5b-8140ea846212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b7bf7398f884c2481c235e778a872b1'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:02.042522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2562c0-743e-4245-a90d-fe915df70af8 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:02.047681 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-9ccbd537-3cca-435e-aa5b-8140ea846212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b7bf7398f884c2481c235e778a872b1'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:02.048250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ad2562c0-743e-4245-a90d-fe915df70af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:02.056323 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 936/1857] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:01 2022] DELETE /identity/v3/users/9b7bf7398f884c2481c235e778a872b1 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:02.086328 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2562c0-743e-4245-a90d-fe915df70af8 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:02.187428 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3fecd-25c1-4ef5-a1af-f52948fcd094 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:02.188694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3fecd-25c1-4ef5-a1af-f52948fcd094 service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:02.188932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3fecd-25c1-4ef5-a1af-f52948fcd094 service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:02.189389 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3fecd-25c1-4ef5-a1af-f52948fcd094 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:02.204226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3fecd-25c1-4ef5-a1af-f52948fcd094 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:02.208925 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3fecd-25c1-4ef5-a1af-f52948fcd094 service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:02.223513 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 922/1858] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:02.504252 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbd537-3cca-435e-aa5b-8140ea846212 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:02.505772 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-9ccbd537-3cca-435e-aa5b-8140ea846212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:02.637300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbd537-3cca-435e-aa5b-8140ea846212 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:02.644582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7c4a3-d189-425b-8026-d33504fce4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:02.646613 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7c4a3-d189-425b-8026-d33504fce4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:02.648546 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7c4a3-d189-425b-8026-d33504fce4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:02.649529 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7c4a3-d189-425b-8026-d33504fce4bd admin admin] PATH_INFO: `/v3/projects/bd17f503418e4c3b8d368f334b8444a1` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:02.651293 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7c4a3-d189-425b-8026-d33504fce4bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd17f503418e4c3b8d368f334b8444a1)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:02.653619 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7c4a3-d189-425b-8026-d33504fce4bd admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:02.733149 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-07b7c4a3-d189-425b-8026-d33504fce4bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd17f503418e4c3b8d368f334b8444a1', 'request_id': 'req-07b7c4a3-d189-425b-8026-d33504fce4bd'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:02.744141 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-07b7c4a3-d189-425b-8026-d33504fce4bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd17f503418e4c3b8d368f334b8444a1', 'request_id': 'req-07b7c4a3-d189-425b-8026-d33504fce4bd'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:02.753157 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-07b7c4a3-d189-425b-8026-d33504fce4bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd17f503418e4c3b8d368f334b8444a1', 'request_id': 'req-07b7c4a3-d189-425b-8026-d33504fce4bd'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:02.767382 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-07b7c4a3-d189-425b-8026-d33504fce4bd admin admin] The token cache is being invalidate because project bd17f503418e4c3b8d368f334b8444a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:02.768098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-07b7c4a3-d189-425b-8026-d33504fce4bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:02.769012 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-07b7c4a3-d189-425b-8026-d33504fce4bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:02.771669 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 937/1859] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:02 2022] DELETE /identity/v3/projects/bd17f503418e4c3b8d368f334b8444a1 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:02.775963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3fecd-25c1-4ef5-a1af-f52948fcd094 service nova] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:02.788943 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3fecd-25c1-4ef5-a1af-f52948fcd094 service nova] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:02.872997 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e555c-e73e-49f8-95af-8b6a58a417c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:02.874574 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e555c-e73e-49f8-95af-8b6a58a417c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:02.875140 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e555c-e73e-49f8-95af-8b6a58a417c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:02.875567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e555c-e73e-49f8-95af-8b6a58a417c4 admin admin] PATH_INFO: `/v3/users/54cdafc7b14d4197ad0d23959d6502e7` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:02.878173 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e555c-e73e-49f8-95af-8b6a58a417c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54cdafc7b14d4197ad0d23959d6502e7)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:02.886509 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e555c-e73e-49f8-95af-8b6a58a417c4 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:02.973207 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-da7e555c-e73e-49f8-95af-8b6a58a417c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54cdafc7b14d4197ad0d23959d6502e7'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:02.986586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-da7e555c-e73e-49f8-95af-8b6a58a417c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54cdafc7b14d4197ad0d23959d6502e7'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:02.996613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-da7e555c-e73e-49f8-95af-8b6a58a417c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54cdafc7b14d4197ad0d23959d6502e7'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:02.997223 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-da7e555c-e73e-49f8-95af-8b6a58a417c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54cdafc7b14d4197ad0d23959d6502e7'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:02.998688 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-da7e555c-e73e-49f8-95af-8b6a58a417c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54cdafc7b14d4197ad0d23959d6502e7'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:03.042347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 923/1860] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:02 2022] DELETE /identity/v3/users/54cdafc7b14d4197ad0d23959d6502e7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:47:03.067198 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7c4a3-d189-425b-8026-d33504fce4bd admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:03.068831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-07b7c4a3-d189-425b-8026-d33504fce4bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:03.095343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7c4a3-d189-425b-8026-d33504fce4bd admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:03.302807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e172f-5c04-457e-a227-4d75ab3fb5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:03.303820 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e172f-5c04-457e-a227-4d75ab3fb5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:03.304200 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e172f-5c04-457e-a227-4d75ab3fb5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:03.304544 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e172f-5c04-457e-a227-4d75ab3fb5ac admin admin] PATH_INFO: `/v3/projects/77c2c6a32563414b98c6c7ce5efc76d5` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:03.307639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e172f-5c04-457e-a227-4d75ab3fb5ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=77c2c6a32563414b98c6c7ce5efc76d5)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:03.312976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e172f-5c04-457e-a227-4d75ab3fb5ac admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:03.475260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-099e172f-5c04-457e-a227-4d75ab3fb5ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77c2c6a32563414b98c6c7ce5efc76d5', 'request_id': 'req-099e172f-5c04-457e-a227-4d75ab3fb5ac'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:03.489684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-099e172f-5c04-457e-a227-4d75ab3fb5ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77c2c6a32563414b98c6c7ce5efc76d5', 'request_id': 'req-099e172f-5c04-457e-a227-4d75ab3fb5ac'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:03.507293 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-099e172f-5c04-457e-a227-4d75ab3fb5ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77c2c6a32563414b98c6c7ce5efc76d5', 'request_id': 'req-099e172f-5c04-457e-a227-4d75ab3fb5ac'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:03.530129 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-099e172f-5c04-457e-a227-4d75ab3fb5ac admin admin] The token cache is being invalidate because project 77c2c6a32563414b98c6c7ce5efc76d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:03.530500 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-099e172f-5c04-457e-a227-4d75ab3fb5ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:03.531364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-099e172f-5c04-457e-a227-4d75ab3fb5ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:03.536932 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 938/1861] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:03 2022] DELETE /identity/v3/projects/77c2c6a32563414b98c6c7ce5efc76d5 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:03.538382 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe2791-98bf-454c-8da1-bf4ca4de7e2a None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:03.538713 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe2791-98bf-454c-8da1-bf4ca4de7e2a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:03.538997 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe2791-98bf-454c-8da1-bf4ca4de7e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:03.561149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-54fe2791-98bf-454c-8da1-bf4ca4de7e2a None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:03.562365 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-54fe2791-98bf-454c-8da1-bf4ca4de7e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:03.621755 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e172f-5c04-457e-a227-4d75ab3fb5ac admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:03.623722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-099e172f-5c04-457e-a227-4d75ab3fb5ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:03.686267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 924/1862] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:47:03.697293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb9a27-25ba-43aa-abf6-27a80d321d8d None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:03.697621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb9a27-25ba-43aa-abf6-27a80d321d8d None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:03.697840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb9a27-25ba-43aa-abf6-27a80d321d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:03.732701 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-45cb9a27-25ba-43aa-abf6-27a80d321d8d None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:03.733942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-45cb9a27-25ba-43aa-abf6-27a80d321d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:03.758244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 925/1863] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:03.760285 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb9a27-25ba-43aa-abf6-27a80d321d8d None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:03.776421 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb9a27-25ba-43aa-abf6-27a80d321d8d None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:03.783563 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e4607-24e6-405d-963a-d70665e214da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:03.784458 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e4607-24e6-405d-963a-d70665e214da admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:03.785029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e4607-24e6-405d-963a-d70665e214da admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:03.786813 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e4607-24e6-405d-963a-d70665e214da admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:03.787343 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e4607-24e6-405d-963a-d70665e214da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:47:03.787659 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e4607-24e6-405d-963a-d70665e214da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:03.789719 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e4607-24e6-405d-963a-d70665e214da admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:03.807426 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 926/1864] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:47:03.811600 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e4607-24e6-405d-963a-d70665e214da admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:03.822770 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e172f-5c04-457e-a227-4d75ab3fb5ac admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:03.827985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e4607-24e6-405d-963a-d70665e214da admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:03.829262 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec934379-c81f-462e-ad70-b3210359ac3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:03.830630 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec934379-c81f-462e-ad70-b3210359ac3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:03.831077 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec934379-c81f-462e-ad70-b3210359ac3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:03.831691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec934379-c81f-462e-ad70-b3210359ac3c admin admin] PATH_INFO: `/v3/projects/54e2a572ff93428db3e9d3ef4b2adea8` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:03.833573 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec934379-c81f-462e-ad70-b3210359ac3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=54e2a572ff93428db3e9d3ef4b2adea8)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:03.836505 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec934379-c81f-462e-ad70-b3210359ac3c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:03.838794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609603ca-ce2c-45dc-bdbc-bba9e0a0cd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:03.839642 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609603ca-ce2c-45dc-bdbc-bba9e0a0cd17 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:03.841183 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609603ca-ce2c-45dc-bdbc-bba9e0a0cd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:03.841541 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609603ca-ce2c-45dc-bdbc-bba9e0a0cd17 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:03.843079 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609603ca-ce2c-45dc-bdbc-bba9e0a0cd17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:03.847293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609603ca-ce2c-45dc-bdbc-bba9e0a0cd17 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:03.927883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 927/1865] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:03 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:03.929104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609603ca-ce2c-45dc-bdbc-bba9e0a0cd17 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:03.933182 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-609603ca-ce2c-45dc-bdbc-bba9e0a0cd17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:03.967427 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ec934379-c81f-462e-ad70-b3210359ac3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54e2a572ff93428db3e9d3ef4b2adea8', 'request_id': 'req-ec934379-c81f-462e-ad70-b3210359ac3c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:03.989783 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ec934379-c81f-462e-ad70-b3210359ac3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54e2a572ff93428db3e9d3ef4b2adea8', 'request_id': 'req-ec934379-c81f-462e-ad70-b3210359ac3c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:04.003256 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ec934379-c81f-462e-ad70-b3210359ac3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54e2a572ff93428db3e9d3ef4b2adea8', 'request_id': 'req-ec934379-c81f-462e-ad70-b3210359ac3c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:04.030714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ec934379-c81f-462e-ad70-b3210359ac3c admin admin] The token cache is being invalidate because project 54e2a572ff93428db3e9d3ef4b2adea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:04.032581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ec934379-c81f-462e-ad70-b3210359ac3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:04.037535 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ec934379-c81f-462e-ad70-b3210359ac3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:04.044183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 939/1866] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:03 2022] DELETE /identity/v3/projects/54e2a572ff93428db3e9d3ef4b2adea8 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:04.044374 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609603ca-ce2c-45dc-bdbc-bba9e0a0cd17 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:04.045466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec934379-c81f-462e-ad70-b3210359ac3c admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:04.048436 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ec934379-c81f-462e-ad70-b3210359ac3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:04.051393 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd011c0-1075-463c-a5eb-ee047a5cf690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:04.052289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd011c0-1075-463c-a5eb-ee047a5cf690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:04.052572 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd011c0-1075-463c-a5eb-ee047a5cf690 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:04.052844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd011c0-1075-463c-a5eb-ee047a5cf690 admin admin] PATH_INFO: `/v3/projects/62d2f02f88a4460cb276a9a9008071b3` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:04.055351 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd011c0-1075-463c-a5eb-ee047a5cf690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62d2f02f88a4460cb276a9a9008071b3)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:04.060614 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd011c0-1075-463c-a5eb-ee047a5cf690 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:04.145918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5cd011c0-1075-463c-a5eb-ee047a5cf690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62d2f02f88a4460cb276a9a9008071b3', 'request_id': 'req-5cd011c0-1075-463c-a5eb-ee047a5cf690'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:04.153161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5cd011c0-1075-463c-a5eb-ee047a5cf690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62d2f02f88a4460cb276a9a9008071b3', 'request_id': 'req-5cd011c0-1075-463c-a5eb-ee047a5cf690'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:04.169471 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5cd011c0-1075-463c-a5eb-ee047a5cf690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62d2f02f88a4460cb276a9a9008071b3', 'request_id': 'req-5cd011c0-1075-463c-a5eb-ee047a5cf690'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:04.203679 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5cd011c0-1075-463c-a5eb-ee047a5cf690 admin admin] The token cache is being invalidate because project 62d2f02f88a4460cb276a9a9008071b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:04.204674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5cd011c0-1075-463c-a5eb-ee047a5cf690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:04.205734 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5cd011c0-1075-463c-a5eb-ee047a5cf690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:04.213433 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 928/1867] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:03 2022] DELETE /identity/v3/projects/62d2f02f88a4460cb276a9a9008071b3 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:04.213433 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf896b-d6d8-4b44-97a1-4da2c449c0e3 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:04.213433 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf896b-d6d8-4b44-97a1-4da2c449c0e3 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:04.215281 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec934379-c81f-462e-ad70-b3210359ac3c admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:04.216710 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf896b-d6d8-4b44-97a1-4da2c449c0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:04.248151 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-7daf896b-d6d8-4b44-97a1-4da2c449c0e3 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:04.250602 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-7daf896b-d6d8-4b44-97a1-4da2c449c0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:04.341430 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 929/1868] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:04.349615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf896b-d6d8-4b44-97a1-4da2c449c0e3 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:04.361192 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-7daf896b-d6d8-4b44-97a1-4da2c449c0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:04.381055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41092648-5e64-4065-84ac-e3c49069c8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:04.381271 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf896b-d6d8-4b44-97a1-4da2c449c0e3 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:04.382037 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41092648-5e64-4065-84ac-e3c49069c8cd admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:04.382358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41092648-5e64-4065-84ac-e3c49069c8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:04.382627 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41092648-5e64-4065-84ac-e3c49069c8cd admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:04.383601 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41092648-5e64-4065-84ac-e3c49069c8cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:04.385879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41092648-5e64-4065-84ac-e3c49069c8cd admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:04.386309 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c5493-286e-4957-b96f-bebf92cc7d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:04.387247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c5493-286e-4957-b96f-bebf92cc7d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:04.387536 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c5493-286e-4957-b96f-bebf92cc7d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:04.387814 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c5493-286e-4957-b96f-bebf92cc7d14 admin admin] PATH_INFO: `/v3/users/4962d29d73bc457eb4f5abd3104f4e4f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:04.389033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c5493-286e-4957-b96f-bebf92cc7d14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4962d29d73bc457eb4f5abd3104f4e4f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:04.390954 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c5493-286e-4957-b96f-bebf92cc7d14 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:04.411620 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 940/1869] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:04 2022] POST /identity/v3/users => generated 293 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:04.414706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8b99f-6cd5-42d2-a9fa-df820d3c6880 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:04.416697 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8b99f-6cd5-42d2-a9fa-df820d3c6880 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:04.416697 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8b99f-6cd5-42d2-a9fa-df820d3c6880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:04.437549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-c3f8b99f-6cd5-42d2-a9fa-df820d3c6880 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:04.438935 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c3f8b99f-6cd5-42d2-a9fa-df820d3c6880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:04.456773 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 941/1870] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:04.456773 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8b99f-6cd5-42d2-a9fa-df820d3c6880 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:04.456773 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c3f8b99f-6cd5-42d2-a9fa-df820d3c6880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:04.470076 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8b99f-6cd5-42d2-a9fa-df820d3c6880 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:04.472517 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-779c5493-286e-4957-b96f-bebf92cc7d14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4962d29d73bc457eb4f5abd3104f4e4f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:04.479807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd581a73-d3f8-4470-a296-894fd91e9602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:04.481012 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd581a73-d3f8-4470-a296-894fd91e9602 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:04.481012 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd581a73-d3f8-4470-a296-894fd91e9602 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:04.481335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd581a73-d3f8-4470-a296-894fd91e9602 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:04.481988 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd581a73-d3f8-4470-a296-894fd91e9602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:04.483711 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd581a73-d3f8-4470-a296-894fd91e9602 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:04.485926 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-779c5493-286e-4957-b96f-bebf92cc7d14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4962d29d73bc457eb4f5abd3104f4e4f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:04.493157 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-779c5493-286e-4957-b96f-bebf92cc7d14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4962d29d73bc457eb4f5abd3104f4e4f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:04.493835 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-779c5493-286e-4957-b96f-bebf92cc7d14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4962d29d73bc457eb4f5abd3104f4e4f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:04.494560 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-779c5493-286e-4957-b96f-bebf92cc7d14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4962d29d73bc457eb4f5abd3104f4e4f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:04.509927 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 942/1871] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:04.509927 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd581a73-d3f8-4470-a296-894fd91e9602 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:04.516751 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-cd581a73-d3f8-4470-a296-894fd91e9602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:04.523193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 930/1872] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:04 2022] DELETE /identity/v3/users/4962d29d73bc457eb4f5abd3104f4e4f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:04.525311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c5493-286e-4957-b96f-bebf92cc7d14 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:04.526794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-779c5493-286e-4957-b96f-bebf92cc7d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:04.539307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd581a73-d3f8-4470-a296-894fd91e9602 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:04.643643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b0cf4-5dd5-4574-a4dd-acb7bb33ea9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:04.644819 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0cf4-5dd5-4574-a4dd-acb7bb33ea9f admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:04.645200 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0cf4-5dd5-4574-a4dd-acb7bb33ea9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:04.645439 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0cf4-5dd5-4574-a4dd-acb7bb33ea9f admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:04.646325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b0cf4-5dd5-4574-a4dd-acb7bb33ea9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:47:04.646900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b0cf4-5dd5-4574-a4dd-acb7bb33ea9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:04.649203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b0cf4-5dd5-4574-a4dd-acb7bb33ea9f admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:04.658439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c5493-286e-4957-b96f-bebf92cc7d14 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:04.685944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 943/1873] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:47:04.687636 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b0cf4-5dd5-4574-a4dd-acb7bb33ea9f admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:04.688147 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78f0e0-a513-49a6-a1e4-f54934bb95ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:04.688876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78f0e0-a513-49a6-a1e4-f54934bb95ff admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:04.689784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78f0e0-a513-49a6-a1e4-f54934bb95ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:04.690083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78f0e0-a513-49a6-a1e4-f54934bb95ff admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:04.690889 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78f0e0-a513-49a6-a1e4-f54934bb95ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:04.692662 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78f0e0-a513-49a6-a1e4-f54934bb95ff admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:04.700275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b0cf4-5dd5-4574-a4dd-acb7bb33ea9f admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:04.706157 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dad951-5395-4a60-bb92-baeb589d0211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:04.706850 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad951-5395-4a60-bb92-baeb589d0211 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:04.707178 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad951-5395-4a60-bb92-baeb589d0211 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:04.707465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad951-5395-4a60-bb92-baeb589d0211 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:04.708177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dad951-5395-4a60-bb92-baeb589d0211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:04.712436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 931/1874] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:04.712619 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dad951-5395-4a60-bb92-baeb589d0211 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:04.713606 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78f0e0-a513-49a6-a1e4-f54934bb95ff admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:04.724139 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78f0e0-a513-49a6-a1e4-f54934bb95ff admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:04.729983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7dc43-3e70-4471-8719-8f2ca0771382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:04.731356 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7dc43-3e70-4471-8719-8f2ca0771382 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:04.731805 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7dc43-3e70-4471-8719-8f2ca0771382 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:04.732238 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7dc43-3e70-4471-8719-8f2ca0771382 admin admin] PATH_INFO: `/v3/projects/8089997f41954f9da7f5acad960a41af/users/d20750eaa264488f908cacff25567435/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:04.751645 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7dc43-3e70-4471-8719-8f2ca0771382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8089997f41954f9da7f5acad960a41af, user_id=d20750eaa264488f908cacff25567435, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:04.754751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7dc43-3e70-4471-8719-8f2ca0771382 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:04.761181 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 944/1875] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:04 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:04.762152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dad951-5395-4a60-bb92-baeb589d0211 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:04.785077 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 932/1876] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:04 2022] PUT /identity/v3/projects/8089997f41954f9da7f5acad960a41af/users/d20750eaa264488f908cacff25567435/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:04.795901 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aa5ab-8418-4e60-bd55-5fac7f33f44e None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:04.797038 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aa5ab-8418-4e60-bd55-5fac7f33f44e None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:04.797395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aa5ab-8418-4e60-bd55-5fac7f33f44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:04.842555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dad951-5395-4a60-bb92-baeb589d0211 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:04.842802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-a27aa5ab-8418-4e60-bd55-5fac7f33f44e None None] MFA Rules not processed for user `d20750eaa264488f908cacff25567435`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:04.844877 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a27aa5ab-8418-4e60-bd55-5fac7f33f44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:04.910413 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49833b9d-0f1d-47e2-87a8-9741186fd770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:04.911229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49833b9d-0f1d-47e2-87a8-9741186fd770 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:04.911655 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49833b9d-0f1d-47e2-87a8-9741186fd770 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:04.911937 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49833b9d-0f1d-47e2-87a8-9741186fd770 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:04.912918 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49833b9d-0f1d-47e2-87a8-9741186fd770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:04.915493 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49833b9d-0f1d-47e2-87a8-9741186fd770 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:04.964110 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 945/1877] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:04 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:04.965765 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49833b9d-0f1d-47e2-87a8-9741186fd770 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:04.981302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49833b9d-0f1d-47e2-87a8-9741186fd770 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:04.986354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39141fa3-1527-4786-8a29-19ef01bc3b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:04.987065 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39141fa3-1527-4786-8a29-19ef01bc3b8d admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:04.987339 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39141fa3-1527-4786-8a29-19ef01bc3b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:04.987623 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39141fa3-1527-4786-8a29-19ef01bc3b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:04.988345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39141fa3-1527-4786-8a29-19ef01bc3b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:04.989967 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39141fa3-1527-4786-8a29-19ef01bc3b8d admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:05.005246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 946/1878] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:05.007840 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39141fa3-1527-4786-8a29-19ef01bc3b8d admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:05.019604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39141fa3-1527-4786-8a29-19ef01bc3b8d admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:05.022472 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 933/1879] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:47:05.029120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96fa82-e2a7-4b10-a828-1a35428ed6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:05.029827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96fa82-e2a7-4b10-a828-1a35428ed6dd admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:05.030110 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96fa82-e2a7-4b10-a828-1a35428ed6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:05.030435 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96fa82-e2a7-4b10-a828-1a35428ed6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:05.030716 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aa5ab-8418-4e60-bd55-5fac7f33f44e None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:05.031199 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96fa82-e2a7-4b10-a828-1a35428ed6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:05.033396 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96fa82-e2a7-4b10-a828-1a35428ed6dd admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:05.046195 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 947/1880] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:05.050534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96fa82-e2a7-4b10-a828-1a35428ed6dd admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:05.064167 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96fa82-e2a7-4b10-a828-1a35428ed6dd admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:05.065095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aa5ab-8418-4e60-bd55-5fac7f33f44e None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:05.070242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26428a6-59ed-48c0-b5c4-5ce7ef9f33c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:05.071550 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26428a6-59ed-48c0-b5c4-5ce7ef9f33c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:05.071920 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26428a6-59ed-48c0-b5c4-5ce7ef9f33c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:05.072257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26428a6-59ed-48c0-b5c4-5ce7ef9f33c3 admin admin] PATH_INFO: `/v3/projects/414757b98fce48eeaa07ba0b9862eb3a/users/175b6a82c48a4231b57bc5a6d0a6e790/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:05.088289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bd230-5c6a-403c-8a4c-235002a71746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:05.090922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bd230-5c6a-403c-8a4c-235002a71746 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:05.092057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26428a6-59ed-48c0-b5c4-5ce7ef9f33c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=414757b98fce48eeaa07ba0b9862eb3a, user_id=175b6a82c48a4231b57bc5a6d0a6e790, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:05.092601 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bd230-5c6a-403c-8a4c-235002a71746 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:05.092999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bd230-5c6a-403c-8a4c-235002a71746 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:05.094137 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bd230-5c6a-403c-8a4c-235002a71746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:05.095416 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26428a6-59ed-48c0-b5c4-5ce7ef9f33c3 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:05.099977 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bd230-5c6a-403c-8a4c-235002a71746 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:05.134479 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 948/1881] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:05 2022] PUT /identity/v3/projects/414757b98fce48eeaa07ba0b9862eb3a/users/175b6a82c48a4231b57bc5a6d0a6e790/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:05.140522 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15314141-a547-42bd-ba47-e9df89431d81 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:05.142417 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15314141-a547-42bd-ba47-e9df89431d81 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:05.142417 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15314141-a547-42bd-ba47-e9df89431d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:05.197013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 934/1882] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:05 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:05.198511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bd230-5c6a-403c-8a4c-235002a71746 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:05.226155 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-15314141-a547-42bd-ba47-e9df89431d81 None None] MFA Rules not processed for user `175b6a82c48a4231b57bc5a6d0a6e790`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:05.228378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-15314141-a547-42bd-ba47-e9df89431d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:05.405214 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bd230-5c6a-403c-8a4c-235002a71746 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:05.421441 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ef5dd-e2a8-4464-b981-015de75d9bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:05.423110 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ef5dd-e2a8-4464-b981-015de75d9bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:05.424214 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ef5dd-e2a8-4464-b981-015de75d9bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:05.425730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ef5dd-e2a8-4464-b981-015de75d9bb5 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:05.427435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ef5dd-e2a8-4464-b981-015de75d9bb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:05.433740 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ef5dd-e2a8-4464-b981-015de75d9bb5 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:05.451576 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 949/1883] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:05.456469 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15314141-a547-42bd-ba47-e9df89431d81 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:05.480504 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 935/1884] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:05 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:05.484401 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ef5dd-e2a8-4464-b981-015de75d9bb5 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:05.487063 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15314141-a547-42bd-ba47-e9df89431d81 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:05.504864 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b886d-3f5f-4a8f-83e3-31d12c521843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:05.505775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b886d-3f5f-4a8f-83e3-31d12c521843 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:05.507138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b886d-3f5f-4a8f-83e3-31d12c521843 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:05.507138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b886d-3f5f-4a8f-83e3-31d12c521843 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:05.508255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b886d-3f5f-4a8f-83e3-31d12c521843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:05.511611 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b886d-3f5f-4a8f-83e3-31d12c521843 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:05.512007 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ef5dd-e2a8-4464-b981-015de75d9bb5 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:05.527363 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d4360-43ff-4f7e-84c8-7430a68bee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:05.529156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d4360-43ff-4f7e-84c8-7430a68bee95 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:05.529156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d4360-43ff-4f7e-84c8-7430a68bee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:05.529156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d4360-43ff-4f7e-84c8-7430a68bee95 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:05.530051 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d4360-43ff-4f7e-84c8-7430a68bee95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:05.531818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d4360-43ff-4f7e-84c8-7430a68bee95 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:05.567438 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 936/1885] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:05.570733 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d4360-43ff-4f7e-84c8-7430a68bee95 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:05.583228 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 950/1886] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:05 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:05.587557 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b886d-3f5f-4a8f-83e3-31d12c521843 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:05.605514 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d4360-43ff-4f7e-84c8-7430a68bee95 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:05.709488 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e8897-2bba-4313-88ed-9970a4c91457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:05.711284 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e8897-2bba-4313-88ed-9970a4c91457 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:05.711967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e8897-2bba-4313-88ed-9970a4c91457 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:05.713197 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e8897-2bba-4313-88ed-9970a4c91457 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:05.714491 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e8897-2bba-4313-88ed-9970a4c91457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:05.719032 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e8897-2bba-4313-88ed-9970a4c91457 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:05.740252 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 937/1887] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:05.743143 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e8897-2bba-4313-88ed-9970a4c91457 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:05.759679 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e8897-2bba-4313-88ed-9970a4c91457 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:05.766943 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8f2ee-ccf5-4a40-9a64-bef3f64a8d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:05.768034 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8f2ee-ccf5-4a40-9a64-bef3f64a8d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:05.768323 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8f2ee-ccf5-4a40-9a64-bef3f64a8d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:05.768600 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8f2ee-ccf5-4a40-9a64-bef3f64a8d7e admin admin] PATH_INFO: `/v3/projects/ba10241698a349fdb683b06e477fa832/users/903934a4d3524d9f895146ca97de1e84/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:05.783024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b886d-3f5f-4a8f-83e3-31d12c521843 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:05.793956 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d085e7-e930-411a-9c7b-ffbe6d2e0166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:05.800605 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d085e7-e930-411a-9c7b-ffbe6d2e0166 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:05.801115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d085e7-e930-411a-9c7b-ffbe6d2e0166 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:05.801314 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d085e7-e930-411a-9c7b-ffbe6d2e0166 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:05.802028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d085e7-e930-411a-9c7b-ffbe6d2e0166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:05.805996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d085e7-e930-411a-9c7b-ffbe6d2e0166 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:05.809862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8f2ee-ccf5-4a40-9a64-bef3f64a8d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba10241698a349fdb683b06e477fa832, user_id=903934a4d3524d9f895146ca97de1e84, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:05.815210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8f2ee-ccf5-4a40-9a64-bef3f64a8d7e admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:05.869745 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 951/1888] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:05 2022] POST /identity/v3/users => generated 296 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:05.870759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d085e7-e930-411a-9c7b-ffbe6d2e0166 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:05.872572 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c2d085e7-e930-411a-9c7b-ffbe6d2e0166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:05.883430 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 938/1889] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:05 2022] PUT /identity/v3/projects/ba10241698a349fdb683b06e477fa832/users/903934a4d3524d9f895146ca97de1e84/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:05.889771 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8f2ee-ccf5-4a40-9a64-bef3f64a8d7e admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:05.910338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d085e7-e930-411a-9c7b-ffbe6d2e0166 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:06.041986 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e84601-5a40-4215-bf00-f1d1aba23a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:06.051170 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e84601-5a40-4215-bf00-f1d1aba23a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:06.051445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e84601-5a40-4215-bf00-f1d1aba23a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:06.051724 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e84601-5a40-4215-bf00-f1d1aba23a4d admin admin] PATH_INFO: `/v3/users/4af780825d0f40dd9b9c548d706333ce` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:06.053144 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e84601-5a40-4215-bf00-f1d1aba23a4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4af780825d0f40dd9b9c548d706333ce)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:06.055594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e84601-5a40-4215-bf00-f1d1aba23a4d admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:06.112602 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8f2ee-ccf5-4a40-9a64-bef3f64a8d7e admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:06.125259 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d811f4-317f-4c01-b148-f5d53f90fc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:06.132257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d811f4-317f-4c01-b148-f5d53f90fc76 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:06.132780 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d811f4-317f-4c01-b148-f5d53f90fc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:06.133072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d811f4-317f-4c01-b148-f5d53f90fc76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:06.133945 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d811f4-317f-4c01-b148-f5d53f90fc76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:06.142179 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d811f4-317f-4c01-b148-f5d53f90fc76 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:06.186878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 939/1890] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:06.188563 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05785233-a6c5-42e6-865e-239a8cd0767a None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:06.188739 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05785233-a6c5-42e6-865e-239a8cd0767a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:06.189015 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05785233-a6c5-42e6-865e-239a8cd0767a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:06.202354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-48e84601-5a40-4215-bf00-f1d1aba23a4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4af780825d0f40dd9b9c548d706333ce'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:06.226764 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-48e84601-5a40-4215-bf00-f1d1aba23a4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4af780825d0f40dd9b9c548d706333ce'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:06.231619 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-48e84601-5a40-4215-bf00-f1d1aba23a4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4af780825d0f40dd9b9c548d706333ce'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:06.273079 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-48e84601-5a40-4215-bf00-f1d1aba23a4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4af780825d0f40dd9b9c548d706333ce'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:06.289658 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-05785233-a6c5-42e6-865e-239a8cd0767a None None] MFA Rules not processed for user `903934a4d3524d9f895146ca97de1e84`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:06.290941 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-05785233-a6c5-42e6-865e-239a8cd0767a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:06.293035 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-48e84601-5a40-4215-bf00-f1d1aba23a4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4af780825d0f40dd9b9c548d706333ce'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:06.304198 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 952/1891] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:05 2022] DELETE /identity/v3/users/4af780825d0f40dd9b9c548d706333ce => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:06.305234 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e84601-5a40-4215-bf00-f1d1aba23a4d admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:06.306670 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-48e84601-5a40-4215-bf00-f1d1aba23a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:06.397350 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 940/1892] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:06.398590 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05785233-a6c5-42e6-865e-239a8cd0767a None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:06.400587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-05785233-a6c5-42e6-865e-239a8cd0767a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:06.400968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e84601-5a40-4215-bf00-f1d1aba23a4d admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:06.406991 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e7f54-a023-4609-8132-2f1822dcdb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:06.408471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e7f54-a023-4609-8132-2f1822dcdb5e admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:06.408755 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e7f54-a023-4609-8132-2f1822dcdb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:06.409084 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e7f54-a023-4609-8132-2f1822dcdb5e admin admin] PATH_INFO: `/v3/projects/9dc389131e994078928d921749c4d331/users/4b810b8687dc444daaa6a55f974332dd/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:06.419359 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05785233-a6c5-42e6-865e-239a8cd0767a None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:06.424845 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c9cf3-b6d4-422b-9b8b-05ff55dc5949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:06.425737 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c9cf3-b6d4-422b-9b8b-05ff55dc5949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:06.426332 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c9cf3-b6d4-422b-9b8b-05ff55dc5949 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:06.426614 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c9cf3-b6d4-422b-9b8b-05ff55dc5949 admin admin] PATH_INFO: `/v3/projects/5ed13595f6e94d1d823dc8a61a41c2de` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:06.432154 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e7f54-a023-4609-8132-2f1822dcdb5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc389131e994078928d921749c4d331, user_id=4b810b8687dc444daaa6a55f974332dd, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:06.433726 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c9cf3-b6d4-422b-9b8b-05ff55dc5949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed13595f6e94d1d823dc8a61a41c2de)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:06.435771 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c9cf3-b6d4-422b-9b8b-05ff55dc5949 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:06.438644 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e7f54-a023-4609-8132-2f1822dcdb5e admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:06.459294 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 953/1893] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:06 2022] PUT /identity/v3/projects/9dc389131e994078928d921749c4d331/users/4b810b8687dc444daaa6a55f974332dd/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:06.463489 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c01c1-88ee-476c-b198-f1aa2ab7bdf0 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:06.464145 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c01c1-88ee-476c-b198-f1aa2ab7bdf0 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:06.465106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c01c1-88ee-476c-b198-f1aa2ab7bdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:06.489924 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-b09c01c1-88ee-476c-b198-f1aa2ab7bdf0 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:06.492160 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-b09c01c1-88ee-476c-b198-f1aa2ab7bdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:06.500856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b76c9cf3-b6d4-422b-9b8b-05ff55dc5949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed13595f6e94d1d823dc8a61a41c2de', 'request_id': 'req-b76c9cf3-b6d4-422b-9b8b-05ff55dc5949'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:06.518470 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b76c9cf3-b6d4-422b-9b8b-05ff55dc5949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed13595f6e94d1d823dc8a61a41c2de', 'request_id': 'req-b76c9cf3-b6d4-422b-9b8b-05ff55dc5949'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:06.540143 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b76c9cf3-b6d4-422b-9b8b-05ff55dc5949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed13595f6e94d1d823dc8a61a41c2de', 'request_id': 'req-b76c9cf3-b6d4-422b-9b8b-05ff55dc5949'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:06.559608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b76c9cf3-b6d4-422b-9b8b-05ff55dc5949 admin admin] The token cache is being invalidate because project 5ed13595f6e94d1d823dc8a61a41c2de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:06.560075 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b76c9cf3-b6d4-422b-9b8b-05ff55dc5949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:06.560782 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b76c9cf3-b6d4-422b-9b8b-05ff55dc5949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:06.562844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 941/1894] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:06 2022] DELETE /identity/v3/projects/5ed13595f6e94d1d823dc8a61a41c2de => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:06.563720 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c9cf3-b6d4-422b-9b8b-05ff55dc5949 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:06.565364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b76c9cf3-b6d4-422b-9b8b-05ff55dc5949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:06.588254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 954/1895] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:06.589558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c01c1-88ee-476c-b198-f1aa2ab7bdf0 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:06.591333 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-b09c01c1-88ee-476c-b198-f1aa2ab7bdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:06.608501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c01c1-88ee-476c-b198-f1aa2ab7bdf0 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:06.624029 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb98694-2429-49a3-a1e0-319a2a5a6508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:06.624674 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb98694-2429-49a3-a1e0-319a2a5a6508 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:06.624953 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb98694-2429-49a3-a1e0-319a2a5a6508 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:06.625371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb98694-2429-49a3-a1e0-319a2a5a6508 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:06.634765 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb98694-2429-49a3-a1e0-319a2a5a6508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:06.636888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb98694-2429-49a3-a1e0-319a2a5a6508 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:06.650709 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 955/1896] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:06.656531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c00330-65b2-4ed6-a659-1d13b50c78f2 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:06.656728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c9cf3-b6d4-422b-9b8b-05ff55dc5949 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:06.656818 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c00330-65b2-4ed6-a659-1d13b50c78f2 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:06.657089 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c00330-65b2-4ed6-a659-1d13b50c78f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:06.666668 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f346c-6e04-41cb-b884-d61096949dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:06.667390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f346c-6e04-41cb-b884-d61096949dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:06.667672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f346c-6e04-41cb-b884-d61096949dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:06.668019 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f346c-6e04-41cb-b884-d61096949dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:06.670404 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f346c-6e04-41cb-b884-d61096949dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:06.672734 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f346c-6e04-41cb-b884-d61096949dd3 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:06.684287 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-06c00330-65b2-4ed6-a659-1d13b50c78f2 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:06.686173 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-06c00330-65b2-4ed6-a659-1d13b50c78f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:06.704106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 956/1897] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:06.706388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c00330-65b2-4ed6-a659-1d13b50c78f2 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:06.709118 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-06c00330-65b2-4ed6-a659-1d13b50c78f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:06.712395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 942/1898] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:06 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:06.713225 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f346c-6e04-41cb-b884-d61096949dd3 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:06.791469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f346c-6e04-41cb-b884-d61096949dd3 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:06.796513 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a4271-1b54-495d-bdf8-aa3a8bb02a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:06.797848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a4271-1b54-495d-bdf8-aa3a8bb02a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:06.798192 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a4271-1b54-495d-bdf8-aa3a8bb02a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:06.798535 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a4271-1b54-495d-bdf8-aa3a8bb02a11 admin admin] PATH_INFO: `/v3/projects/9dc389131e994078928d921749c4d331/users/4b810b8687dc444daaa6a55f974332dd/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:06.801559 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a4271-1b54-495d-bdf8-aa3a8bb02a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc389131e994078928d921749c4d331, user_id=4b810b8687dc444daaa6a55f974332dd, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:06.804471 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a4271-1b54-495d-bdf8-aa3a8bb02a11 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:06.805949 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c00330-65b2-4ed6-a659-1d13b50c78f2 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:06.820234 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 943/1899] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:06 2022] PUT /identity/v3/projects/9dc389131e994078928d921749c4d331/users/4b810b8687dc444daaa6a55f974332dd/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:06.821275 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94034e-e03e-4044-9c61-72836dccebbd None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:06.821640 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94034e-e03e-4044-9c61-72836dccebbd None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:06.822018 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94034e-e03e-4044-9c61-72836dccebbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:06.846160 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-ca94034e-e03e-4044-9c61-72836dccebbd None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:06.847512 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ca94034e-e03e-4044-9c61-72836dccebbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:06.890917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30e13b-b651-47fb-9127-00b2d3723ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:06.892925 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30e13b-b651-47fb-9127-00b2d3723ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:06.892925 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30e13b-b651-47fb-9127-00b2d3723ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:06.892925 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30e13b-b651-47fb-9127-00b2d3723ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:06.904118 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30e13b-b651-47fb-9127-00b2d3723ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:06.905206 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30e13b-b651-47fb-9127-00b2d3723ce8 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:06.917431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 957/1900] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:06.918274 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30e13b-b651-47fb-9127-00b2d3723ce8 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:06.930688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30e13b-b651-47fb-9127-00b2d3723ce8 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:06.998575 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a7151-8c86-485a-8d6c-b5ac371ac778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:06.999462 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a7151-8c86-485a-8d6c-b5ac371ac778 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:06.999837 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a7151-8c86-485a-8d6c-b5ac371ac778 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:07.000125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a7151-8c86-485a-8d6c-b5ac371ac778 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:07.000895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a7151-8c86-485a-8d6c-b5ac371ac778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:07.001570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 944/1901] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:07.004183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a7151-8c86-485a-8d6c-b5ac371ac778 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:07.010026 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d737eb2-4877-4de8-9a95-98ce62467d54 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:07.011453 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d737eb2-4877-4de8-9a95-98ce62467d54 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:07.011739 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d737eb2-4877-4de8-9a95-98ce62467d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:07.036517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 958/1902] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:06 2022] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:07.038853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a7151-8c86-485a-8d6c-b5ac371ac778 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:07.052481 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a7151-8c86-485a-8d6c-b5ac371ac778 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:07.062074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741ace1-e660-478c-b9c4-d94765ff99f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:07.064207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ace1-e660-478c-b9c4-d94765ff99f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:07.065873 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ace1-e660-478c-b9c4-d94765ff99f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:07.066317 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ace1-e660-478c-b9c4-d94765ff99f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:07.068474 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741ace1-e660-478c-b9c4-d94765ff99f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:47:07.069014 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741ace1-e660-478c-b9c4-d94765ff99f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:07.072491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741ace1-e660-478c-b9c4-d94765ff99f2 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:07.080310 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-5d737eb2-4877-4de8-9a95-98ce62467d54 None None] MFA Rules not processed for user `4b810b8687dc444daaa6a55f974332dd`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:07.090994 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 959/1903] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:47:07.092317 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741ace1-e660-478c-b9c4-d94765ff99f2 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:07.096160 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-5d737eb2-4877-4de8-9a95-98ce62467d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:07.117507 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741ace1-e660-478c-b9c4-d94765ff99f2 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:07.131877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345fff0-b15f-4314-af94-e7e849e97f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:07.134963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345fff0-b15f-4314-af94-e7e849e97f82 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:07.135382 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345fff0-b15f-4314-af94-e7e849e97f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:07.135968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345fff0-b15f-4314-af94-e7e849e97f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:07.139830 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345fff0-b15f-4314-af94-e7e849e97f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:07.143351 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345fff0-b15f-4314-af94-e7e849e97f82 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:07.173236 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 960/1904] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:07.177036 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345fff0-b15f-4314-af94-e7e849e97f82 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:07.207987 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345fff0-b15f-4314-af94-e7e849e97f82 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:07.223180 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d0adc-4fcc-411f-ab3d-5ae06db161a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:07.226576 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d0adc-4fcc-411f-ab3d-5ae06db161a1 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:07.226866 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d0adc-4fcc-411f-ab3d-5ae06db161a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:07.227543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d0adc-4fcc-411f-ab3d-5ae06db161a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:07.227877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d0adc-4fcc-411f-ab3d-5ae06db161a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:07.235218 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d0adc-4fcc-411f-ab3d-5ae06db161a1 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:07.277618 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 945/1905] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:07.278569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d737eb2-4877-4de8-9a95-98ce62467d54 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:07.306811 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 961/1906] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:07 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:07.307291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d737eb2-4877-4de8-9a95-98ce62467d54 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:07.307795 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d0adc-4fcc-411f-ab3d-5ae06db161a1 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:07.309583 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-b10d0adc-4fcc-411f-ab3d-5ae06db161a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:07.415740 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d0adc-4fcc-411f-ab3d-5ae06db161a1 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:07.427964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55bd82-8905-4bad-8e7e-99ecdf0f63eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:07.428831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55bd82-8905-4bad-8e7e-99ecdf0f63eb service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:07.430532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55bd82-8905-4bad-8e7e-99ecdf0f63eb service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:07.430829 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55bd82-8905-4bad-8e7e-99ecdf0f63eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:07.443847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d771d6-2000-4b94-8a54-63a44544d2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:07.445113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d771d6-2000-4b94-8a54-63a44544d2ea admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:07.445397 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d771d6-2000-4b94-8a54-63a44544d2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:07.445677 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d771d6-2000-4b94-8a54-63a44544d2ea admin admin] PATH_INFO: `/v3/projects/5c53393887bc4499954af8f61be1c4f9/users/6d0964cc25354679b06cd47c6ba73fd6/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:07.492005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d771d6-2000-4b94-8a54-63a44544d2ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c53393887bc4499954af8f61be1c4f9, user_id=6d0964cc25354679b06cd47c6ba73fd6, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:07.498901 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d771d6-2000-4b94-8a54-63a44544d2ea admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:07.567659 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 946/1907] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:07 2022] PUT /identity/v3/projects/5c53393887bc4499954af8f61be1c4f9/users/6d0964cc25354679b06cd47c6ba73fd6/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:07.569849 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d771d6-2000-4b94-8a54-63a44544d2ea admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:07.591089 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55bd82-8905-4bad-8e7e-99ecdf0f63eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:07.592542 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55bd82-8905-4bad-8e7e-99ecdf0f63eb service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:07.613058 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 962/1908] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:07.613932 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55bd82-8905-4bad-8e7e-99ecdf0f63eb service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:07.647158 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55bd82-8905-4bad-8e7e-99ecdf0f63eb service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:07.705076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d771d6-2000-4b94-8a54-63a44544d2ea admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:07.722037 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99563ddd-29e2-4a6d-b776-99a93255f10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:07.722950 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99563ddd-29e2-4a6d-b776-99a93255f10c admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:07.723304 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99563ddd-29e2-4a6d-b776-99a93255f10c admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:07.723581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99563ddd-29e2-4a6d-b776-99a93255f10c admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:07.724399 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99563ddd-29e2-4a6d-b776-99a93255f10c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:07.728715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99563ddd-29e2-4a6d-b776-99a93255f10c admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:07.767636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 947/1909] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:07 2022] POST /identity/v3/users => generated 294 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:07.774026 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99563ddd-29e2-4a6d-b776-99a93255f10c admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:07.790714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99563ddd-29e2-4a6d-b776-99a93255f10c admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:07.798933 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298fd93-1f71-4e13-90f0-5efed44a9f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:07.799719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298fd93-1f71-4e13-90f0-5efed44a9f42 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:07.800069 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298fd93-1f71-4e13-90f0-5efed44a9f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:07.800415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298fd93-1f71-4e13-90f0-5efed44a9f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:07.801389 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298fd93-1f71-4e13-90f0-5efed44a9f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:07.803843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298fd93-1f71-4e13-90f0-5efed44a9f42 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:07.812828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ae60d-25b5-4ab6-b9a1-1616bd610d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:07.814148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ae60d-25b5-4ab6-b9a1-1616bd610d23 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:07.814605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ae60d-25b5-4ab6-b9a1-1616bd610d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:07.815224 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ae60d-25b5-4ab6-b9a1-1616bd610d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:07.816130 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ae60d-25b5-4ab6-b9a1-1616bd610d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:07.821167 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 963/1910] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:07.821318 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ae60d-25b5-4ab6-b9a1-1616bd610d23 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:07.826783 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298fd93-1f71-4e13-90f0-5efed44a9f42 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:07.846757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298fd93-1f71-4e13-90f0-5efed44a9f42 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:07.854272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 948/1911] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:07.856443 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128eb81-3ebc-4d4a-8757-0c46134e39b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:07.857476 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128eb81-3ebc-4d4a-8757-0c46134e39b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:07.857761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128eb81-3ebc-4d4a-8757-0c46134e39b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:07.858035 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128eb81-3ebc-4d4a-8757-0c46134e39b0 admin admin] PATH_INFO: `/v3/projects/5c53393887bc4499954af8f61be1c4f9/users/6d0964cc25354679b06cd47c6ba73fd6/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:07.859319 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ae60d-25b5-4ab6-b9a1-1616bd610d23 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:07.864282 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128eb81-3ebc-4d4a-8757-0c46134e39b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c53393887bc4499954af8f61be1c4f9, user_id=6d0964cc25354679b06cd47c6ba73fd6, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:07.865978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-d67ae60d-25b5-4ab6-b9a1-1616bd610d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:07.868528 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128eb81-3ebc-4d4a-8757-0c46134e39b0 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:07.887784 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 964/1912] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:07 2022] PUT /identity/v3/projects/5c53393887bc4499954af8f61be1c4f9/users/6d0964cc25354679b06cd47c6ba73fd6/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:07.889499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128eb81-3ebc-4d4a-8757-0c46134e39b0 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:07.907750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ae60d-25b5-4ab6-b9a1-1616bd610d23 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:07.968577 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128eb81-3ebc-4d4a-8757-0c46134e39b0 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:07.973994 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88b199-24de-45d5-b4e5-aac9d81c6a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:07.974644 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88b199-24de-45d5-b4e5-aac9d81c6a47 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:07.974957 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88b199-24de-45d5-b4e5-aac9d81c6a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:07.975265 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88b199-24de-45d5-b4e5-aac9d81c6a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:07.976056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88b199-24de-45d5-b4e5-aac9d81c6a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:07.976297 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06a6d4-177e-4159-ac3c-47bd5eb4c30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:07.977233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06a6d4-177e-4159-ac3c-47bd5eb4c30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:07.977554 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06a6d4-177e-4159-ac3c-47bd5eb4c30d admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:07.977797 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88b199-24de-45d5-b4e5-aac9d81c6a47 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:07.977902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06a6d4-177e-4159-ac3c-47bd5eb4c30d admin admin] PATH_INFO: `/v3/projects/ee8a19fbe76d4d7e98ae9653d68a9510` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:07.979462 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06a6d4-177e-4159-ac3c-47bd5eb4c30d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8a19fbe76d4d7e98ae9653d68a9510)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:07.981473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06a6d4-177e-4159-ac3c-47bd5eb4c30d admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:07.991074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 965/1913] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:07.991074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc226643-0e99-49e3-b148-013f6622252b None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:07.991074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc226643-0e99-49e3-b148-013f6622252b None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:07.991074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc226643-0e99-49e3-b148-013f6622252b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:08.019894 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-cc226643-0e99-49e3-b148-013f6622252b None None] MFA Rules not processed for user `6d0964cc25354679b06cd47c6ba73fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:08.021380 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-cc226643-0e99-49e3-b148-013f6622252b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:08.042203 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-ca06a6d4-177e-4159-ac3c-47bd5eb4c30d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8a19fbe76d4d7e98ae9653d68a9510', 'request_id': 'req-ca06a6d4-177e-4159-ac3c-47bd5eb4c30d'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:08.048670 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-ca06a6d4-177e-4159-ac3c-47bd5eb4c30d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8a19fbe76d4d7e98ae9653d68a9510', 'request_id': 'req-ca06a6d4-177e-4159-ac3c-47bd5eb4c30d'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:08.056884 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-ca06a6d4-177e-4159-ac3c-47bd5eb4c30d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8a19fbe76d4d7e98ae9653d68a9510', 'request_id': 'req-ca06a6d4-177e-4159-ac3c-47bd5eb4c30d'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:08.074288 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-ca06a6d4-177e-4159-ac3c-47bd5eb4c30d admin admin] The token cache is being invalidate because project ee8a19fbe76d4d7e98ae9653d68a9510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:08.074577 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-ca06a6d4-177e-4159-ac3c-47bd5eb4c30d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:08.075278 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-ca06a6d4-177e-4159-ac3c-47bd5eb4c30d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:08.076861 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 949/1914] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:07 2022] DELETE /identity/v3/projects/ee8a19fbe76d4d7e98ae9653d68a9510 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:08.077590 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06a6d4-177e-4159-ac3c-47bd5eb4c30d admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:08.078887 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ca06a6d4-177e-4159-ac3c-47bd5eb4c30d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:08.099429 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 966/1915] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:08.100385 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc226643-0e99-49e3-b148-013f6622252b None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:08.101798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-cc226643-0e99-49e3-b148-013f6622252b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:08.142876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06a6d4-177e-4159-ac3c-47bd5eb4c30d admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:08.148752 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca4488-933c-4298-b00f-13a6e78f22df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:08.149694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca4488-933c-4298-b00f-13a6e78f22df admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:08.149941 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca4488-933c-4298-b00f-13a6e78f22df admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:08.150249 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca4488-933c-4298-b00f-13a6e78f22df admin admin] PATH_INFO: `/v3/projects/1376c02854244e5d852c26714176ed8c/users/bd04e02b38384659b7acc371af728584/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:08.165283 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca4488-933c-4298-b00f-13a6e78f22df admin admin] RBAC: Authorizing `identity:create_grant(project_id=1376c02854244e5d852c26714176ed8c, user_id=bd04e02b38384659b7acc371af728584, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:08.165766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc226643-0e99-49e3-b148-013f6622252b None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:08.168400 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca4488-933c-4298-b00f-13a6e78f22df admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:08.186450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 950/1916] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:08 2022] PUT /identity/v3/projects/1376c02854244e5d852c26714176ed8c/users/bd04e02b38384659b7acc371af728584/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:08.199231 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca4488-933c-4298-b00f-13a6e78f22df admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:08.199231 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-9dca4488-933c-4298-b00f-13a6e78f22df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:08.225721 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432b587-1710-4b44-8c20-d5295e24021b tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b810b8687dc444daaa6a55f974332dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dc389131e994078928d921749c4d331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:08.226340 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432b587-1710-4b44-8c20-d5295e24021b tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:08.226635 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432b587-1710-4b44-8c20-d5295e24021b tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:08.226919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432b587-1710-4b44-8c20-d5295e24021b tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:08.227691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432b587-1710-4b44-8c20-d5295e24021b tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:47:08.228010 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432b587-1710-4b44-8c20-d5295e24021b tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:08.229628 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432b587-1710-4b44-8c20-d5295e24021b tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:08.241654 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 967/1917] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:47:08.242594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432b587-1710-4b44-8c20-d5295e24021b tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:08.244283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-2432b587-1710-4b44-8c20-d5295e24021b tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:08.279505 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca4488-933c-4298-b00f-13a6e78f22df admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:08.285443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b4475-851f-4c1c-8672-8f0420d7650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:08.286779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b4475-851f-4c1c-8672-8f0420d7650d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:08.287146 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b4475-851f-4c1c-8672-8f0420d7650d admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:08.287568 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b4475-851f-4c1c-8672-8f0420d7650d admin admin] PATH_INFO: `/v3/users/07173641f49544f7b3cb03652e6a931f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:08.289654 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b4475-851f-4c1c-8672-8f0420d7650d admin admin] RBAC: Authorizing `identity:delete_user(user_id=07173641f49544f7b3cb03652e6a931f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:08.293293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b4475-851f-4c1c-8672-8f0420d7650d admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:08.344901 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432b587-1710-4b44-8c20-d5295e24021b tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:08.374368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-3e4b4475-851f-4c1c-8672-8f0420d7650d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07173641f49544f7b3cb03652e6a931f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:08.385811 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-3e4b4475-851f-4c1c-8672-8f0420d7650d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07173641f49544f7b3cb03652e6a931f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:08.403705 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-3e4b4475-851f-4c1c-8672-8f0420d7650d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07173641f49544f7b3cb03652e6a931f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:08.404484 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-3e4b4475-851f-4c1c-8672-8f0420d7650d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07173641f49544f7b3cb03652e6a931f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:08.405186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-3e4b4475-851f-4c1c-8672-8f0420d7650d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07173641f49544f7b3cb03652e6a931f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:08.432382 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 951/1918] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:08 2022] DELETE /identity/v3/users/07173641f49544f7b3cb03652e6a931f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:08.436722 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b3c11-4d85-435e-a71f-cdea9d23fd6a None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:08.436947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c88fca-7812-4705-b2df-8618dd26281d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:08.437076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b3c11-4d85-435e-a71f-cdea9d23fd6a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:08.437286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b3c11-4d85-435e-a71f-cdea9d23fd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:08.437618 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c88fca-7812-4705-b2df-8618dd26281d service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:08.437905 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c88fca-7812-4705-b2df-8618dd26281d service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:08.438185 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c88fca-7812-4705-b2df-8618dd26281d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:08.440206 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-11c88fca-7812-4705-b2df-8618dd26281d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:08.467425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-445b3c11-4d85-435e-a71f-cdea9d23fd6a None None] MFA Rules not processed for user `bd04e02b38384659b7acc371af728584`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:08.468966 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-445b3c11-4d85-435e-a71f-cdea9d23fd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:08.530300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c88fca-7812-4705-b2df-8618dd26281d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:08.532144 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c88fca-7812-4705-b2df-8618dd26281d service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:08.557076 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 968/1919] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:08.558673 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c88fca-7812-4705-b2df-8618dd26281d service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:08.561725 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-11c88fca-7812-4705-b2df-8618dd26281d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:08.579772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 952/1920] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:08.582567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b3c11-4d85-435e-a71f-cdea9d23fd6a None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:08.593393 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-445b3c11-4d85-435e-a71f-cdea9d23fd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:08.723789 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c88fca-7812-4705-b2df-8618dd26281d service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:08.739755 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b3c11-4d85-435e-a71f-cdea9d23fd6a None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:08.746230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe550f-21e7-437c-b356-8f5b7a2d2e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:08.747526 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe550f-21e7-437c-b356-8f5b7a2d2e68 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:08.748027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe550f-21e7-437c-b356-8f5b7a2d2e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:08.748481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe550f-21e7-437c-b356-8f5b7a2d2e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:08.749331 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe550f-21e7-437c-b356-8f5b7a2d2e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:08.754959 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe550f-21e7-437c-b356-8f5b7a2d2e68 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:08.797086 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 953/1921] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:08 2022] POST /identity/v3/projects => generated 387 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:08.806957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe550f-21e7-437c-b356-8f5b7a2d2e68 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:08.870480 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24636850-f417-49b3-b2db-8b1d6ffc827f tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b810b8687dc444daaa6a55f974332dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dc389131e994078928d921749c4d331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:08.871483 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24636850-f417-49b3-b2db-8b1d6ffc827f tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:08.872215 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24636850-f417-49b3-b2db-8b1d6ffc827f tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:08.872620 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24636850-f417-49b3-b2db-8b1d6ffc827f tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:08.875090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24636850-f417-49b3-b2db-8b1d6ffc827f tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:08.879418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24636850-f417-49b3-b2db-8b1d6ffc827f tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:08.949974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 969/1922] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:08 2022] POST /identity/v3/projects => generated 354 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:08.951452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24636850-f417-49b3-b2db-8b1d6ffc827f tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:08.965854 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe550f-21e7-437c-b356-8f5b7a2d2e68 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:09.043996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24636850-f417-49b3-b2db-8b1d6ffc827f tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:09.049836 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b135453-2fb6-406b-a92d-bb7c21c4b4af tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b810b8687dc444daaa6a55f974332dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dc389131e994078928d921749c4d331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:09.050526 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b135453-2fb6-406b-a92d-bb7c21c4b4af tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:09.050810 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b135453-2fb6-406b-a92d-bb7c21c4b4af tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:09.051229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b135453-2fb6-406b-a92d-bb7c21c4b4af tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:09.052053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b135453-2fb6-406b-a92d-bb7c21c4b4af tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:47:09.052673 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b135453-2fb6-406b-a92d-bb7c21c4b4af tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:09.054704 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b135453-2fb6-406b-a92d-bb7c21c4b4af tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:09.071740 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 970/1923] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:47:09.083288 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd161f-bd00-45fa-aa06-7db96b09366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:09.084009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd161f-bd00-45fa-aa06-7db96b09366f admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:09.084279 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd161f-bd00-45fa-aa06-7db96b09366f admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:09.084552 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd161f-bd00-45fa-aa06-7db96b09366f admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:09.085306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd161f-bd00-45fa-aa06-7db96b09366f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:09.088020 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd161f-bd00-45fa-aa06-7db96b09366f admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:09.133439 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b135453-2fb6-406b-a92d-bb7c21c4b4af tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:09.136489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 954/1924] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:08 2022] POST /identity/v3/users => generated 300 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:09.145124 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd161f-bd00-45fa-aa06-7db96b09366f admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:09.157989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b135453-2fb6-406b-a92d-bb7c21c4b4af tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:09.176538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c803b-fe05-4c0c-a340-db224f01312c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:09.179663 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c803b-fe05-4c0c-a340-db224f01312c admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:09.183373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c803b-fe05-4c0c-a340-db224f01312c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:09.184471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c803b-fe05-4c0c-a340-db224f01312c admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:09.187806 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c803b-fe05-4c0c-a340-db224f01312c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:09.194263 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c803b-fe05-4c0c-a340-db224f01312c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:09.234954 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 971/1925] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:09.238727 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c803b-fe05-4c0c-a340-db224f01312c admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:09.238920 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd161f-bd00-45fa-aa06-7db96b09366f admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:09.252365 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c803b-fe05-4c0c-a340-db224f01312c admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:09.256572 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66f6f1-b269-4e1b-96af-729f976e5688 tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b810b8687dc444daaa6a55f974332dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dc389131e994078928d921749c4d331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:09.258314 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66f6f1-b269-4e1b-96af-729f976e5688 tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:09.258618 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66f6f1-b269-4e1b-96af-729f976e5688 tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:09.258906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66f6f1-b269-4e1b-96af-729f976e5688 tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] PATH_INFO: `/v3/projects/c94ace785b324e48ba4c5c4cd9335273` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:09.260317 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ecac9-99de-4185-903d-dbbff62a3b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:09.261479 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ecac9-99de-4185-903d-dbbff62a3b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:09.261857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ecac9-99de-4185-903d-dbbff62a3b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:09.262445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ecac9-99de-4185-903d-dbbff62a3b1f admin admin] PATH_INFO: `/v3/projects/b497972b32bf4fea82fcfe845da4078c/users/c61b09b2b6ff4f8199c6142e0caa0a8f/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:09.273712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66f6f1-b269-4e1b-96af-729f976e5688 tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c94ace785b324e48ba4c5c4cd9335273)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:09.276058 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66f6f1-b269-4e1b-96af-729f976e5688 tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:09.281076 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ecac9-99de-4185-903d-dbbff62a3b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b497972b32bf4fea82fcfe845da4078c, user_id=c61b09b2b6ff4f8199c6142e0caa0a8f, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:09.284222 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ecac9-99de-4185-903d-dbbff62a3b1f admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:09.307392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 972/1926] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:09 2022] PUT /identity/v3/projects/b497972b32bf4fea82fcfe845da4078c/users/c61b09b2b6ff4f8199c6142e0caa0a8f/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:47:09.311321 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ecac9-99de-4185-903d-dbbff62a3b1f admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:09.409187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4a66f6f1-b269-4e1b-96af-729f976e5688 tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c94ace785b324e48ba4c5c4cd9335273', 'request_id': 'req-4a66f6f1-b269-4e1b-96af-729f976e5688'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:09.418957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4a66f6f1-b269-4e1b-96af-729f976e5688 tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c94ace785b324e48ba4c5c4cd9335273', 'request_id': 'req-4a66f6f1-b269-4e1b-96af-729f976e5688'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:09.428186 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ecac9-99de-4185-903d-dbbff62a3b1f admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:09.431485 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4a66f6f1-b269-4e1b-96af-729f976e5688 tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c94ace785b324e48ba4c5c4cd9335273', 'request_id': 'req-4a66f6f1-b269-4e1b-96af-729f976e5688'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:09.465573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4a66f6f1-b269-4e1b-96af-729f976e5688 tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] The token cache is being invalidate because project c94ace785b324e48ba4c5c4cd9335273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:09.465785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4a66f6f1-b269-4e1b-96af-729f976e5688 tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:09.468152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4a66f6f1-b269-4e1b-96af-729f976e5688 tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:09.473725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 955/1927] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:09 2022] DELETE /identity/v3/projects/c94ace785b324e48ba4c5c4cd9335273 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:47:09.496372 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c604092-633d-4a62-bfbc-ade228b02790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:09.497062 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c604092-633d-4a62-bfbc-ade228b02790 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:09.497410 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c604092-633d-4a62-bfbc-ade228b02790 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:09.497733 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c604092-633d-4a62-bfbc-ade228b02790 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:09.498438 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c604092-633d-4a62-bfbc-ade228b02790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:09.500756 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c604092-633d-4a62-bfbc-ade228b02790 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:09.514138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 973/1928] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:09.518770 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66f6f1-b269-4e1b-96af-729f976e5688 tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:09.521525 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-4a66f6f1-b269-4e1b-96af-729f976e5688 tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:09.546366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66f6f1-b269-4e1b-96af-729f976e5688 tempest-VolumeQuotaClassesTest-428987338 tempest-VolumeQuotaClassesTest-428987338-project-admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:09.561155 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a67b5e-4f92-49be-b81e-8b78c3e4fd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:09.583582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a67b5e-4f92-49be-b81e-8b78c3e4fd10 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:09.583582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a67b5e-4f92-49be-b81e-8b78c3e4fd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:09.583582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a67b5e-4f92-49be-b81e-8b78c3e4fd10 admin admin] PATH_INFO: `/v3/projects/b497972b32bf4fea82fcfe845da4078c/users/c61b09b2b6ff4f8199c6142e0caa0a8f/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:09.585124 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a67b5e-4f92-49be-b81e-8b78c3e4fd10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b497972b32bf4fea82fcfe845da4078c, user_id=c61b09b2b6ff4f8199c6142e0caa0a8f, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:09.594686 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a67b5e-4f92-49be-b81e-8b78c3e4fd10 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:09.606781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c604092-633d-4a62-bfbc-ade228b02790 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:09.608863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-6c604092-633d-4a62-bfbc-ade228b02790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:09.621928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 956/1929] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:09 2022] PUT /identity/v3/projects/b497972b32bf4fea82fcfe845da4078c/users/c61b09b2b6ff4f8199c6142e0caa0a8f/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:09.623963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49399e8b-32a8-4f5f-89f0-7b12423ccf3b None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:09.624396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49399e8b-32a8-4f5f-89f0-7b12423ccf3b None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:09.624683 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49399e8b-32a8-4f5f-89f0-7b12423ccf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:09.632852 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c604092-633d-4a62-bfbc-ade228b02790 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:09.673326 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-49399e8b-32a8-4f5f-89f0-7b12423ccf3b None None] MFA Rules not processed for user `c61b09b2b6ff4f8199c6142e0caa0a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:09.675569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-49399e8b-32a8-4f5f-89f0-7b12423ccf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:09.768418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb437f1-3bb6-4830-8567-8c83e13be5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:09.769601 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb437f1-3bb6-4830-8567-8c83e13be5b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:09.769945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb437f1-3bb6-4830-8567-8c83e13be5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:09.770290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb437f1-3bb6-4830-8567-8c83e13be5b1 admin admin] PATH_INFO: `/v3/projects/33bd83341bcc46d8b2e2838fc44b7402` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:09.772203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb437f1-3bb6-4830-8567-8c83e13be5b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33bd83341bcc46d8b2e2838fc44b7402)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:09.774709 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb437f1-3bb6-4830-8567-8c83e13be5b1 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:09.776789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 957/1930] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:09.788482 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49399e8b-32a8-4f5f-89f0-7b12423ccf3b None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:09.791901 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-49399e8b-32a8-4f5f-89f0-7b12423ccf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:09.835029 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3bb437f1-3bb6-4830-8567-8c83e13be5b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33bd83341bcc46d8b2e2838fc44b7402', 'request_id': 'req-3bb437f1-3bb6-4830-8567-8c83e13be5b1'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:09.843354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3bb437f1-3bb6-4830-8567-8c83e13be5b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33bd83341bcc46d8b2e2838fc44b7402', 'request_id': 'req-3bb437f1-3bb6-4830-8567-8c83e13be5b1'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:09.850073 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3bb437f1-3bb6-4830-8567-8c83e13be5b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33bd83341bcc46d8b2e2838fc44b7402', 'request_id': 'req-3bb437f1-3bb6-4830-8567-8c83e13be5b1'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:09.854821 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49399e8b-32a8-4f5f-89f0-7b12423ccf3b None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:09.860835 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3bb437f1-3bb6-4830-8567-8c83e13be5b1 admin admin] The token cache is being invalidate because project 33bd83341bcc46d8b2e2838fc44b7402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:09.861133 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3bb437f1-3bb6-4830-8567-8c83e13be5b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:09.861789 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3bb437f1-3bb6-4830-8567-8c83e13be5b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:09.863424 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 974/1931] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:09 2022] DELETE /identity/v3/projects/33bd83341bcc46d8b2e2838fc44b7402 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:47:09.864185 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb437f1-3bb6-4830-8567-8c83e13be5b1 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:09.867948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-3bb437f1-3bb6-4830-8567-8c83e13be5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:09.905486 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f104b81-c847-4e8b-80f3-2b407e1e3af5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:09.906787 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f104b81-c847-4e8b-80f3-2b407e1e3af5 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:09.907098 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f104b81-c847-4e8b-80f3-2b407e1e3af5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:09.907375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f104b81-c847-4e8b-80f3-2b407e1e3af5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:09.909421 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-9f104b81-c847-4e8b-80f3-2b407e1e3af5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:09.928876 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb437f1-3bb6-4830-8567-8c83e13be5b1 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:09.934176 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e30f59-62c3-4dd8-b232-0253ddfcb96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:09.935083 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e30f59-62c3-4dd8-b232-0253ddfcb96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:09.935377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e30f59-62c3-4dd8-b232-0253ddfcb96e admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:09.935660 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e30f59-62c3-4dd8-b232-0253ddfcb96e admin admin] PATH_INFO: `/v3/users/175b6a82c48a4231b57bc5a6d0a6e790` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:09.936896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e30f59-62c3-4dd8-b232-0253ddfcb96e admin admin] RBAC: Authorizing `identity:delete_user(user_id=175b6a82c48a4231b57bc5a6d0a6e790)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:09.938837 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e30f59-62c3-4dd8-b232-0253ddfcb96e admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:09.970854 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f104b81-c847-4e8b-80f3-2b407e1e3af5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:09.972566 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f104b81-c847-4e8b-80f3-2b407e1e3af5 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:09.984226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 958/1932] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:47:09.985571 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1439ea-f2a3-41b9-8308-1f9f15873ea2 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:09.985863 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1439ea-f2a3-41b9-8308-1f9f15873ea2 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:09.986198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1439ea-f2a3-41b9-8308-1f9f15873ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:09.991255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-13e30f59-62c3-4dd8-b232-0253ddfcb96e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '175b6a82c48a4231b57bc5a6d0a6e790'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:09.998748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-13e30f59-62c3-4dd8-b232-0253ddfcb96e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '175b6a82c48a4231b57bc5a6d0a6e790'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:09.999854 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-13e30f59-62c3-4dd8-b232-0253ddfcb96e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '175b6a82c48a4231b57bc5a6d0a6e790'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:10.004853 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-fe1439ea-f2a3-41b9-8308-1f9f15873ea2 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:10.006189 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-fe1439ea-f2a3-41b9-8308-1f9f15873ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:10.014303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-13e30f59-62c3-4dd8-b232-0253ddfcb96e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '175b6a82c48a4231b57bc5a6d0a6e790'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:10.016994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 959/1933] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:10.025013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee38c7-c2c4-4b31-84a1-8dfe65276dca None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:10.025356 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee38c7-c2c4-4b31-84a1-8dfe65276dca None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:10.025633 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee38c7-c2c4-4b31-84a1-8dfe65276dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:10.028893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-13e30f59-62c3-4dd8-b232-0253ddfcb96e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '175b6a82c48a4231b57bc5a6d0a6e790'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:10.036792 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 975/1934] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:09 2022] DELETE /identity/v3/users/175b6a82c48a4231b57bc5a6d0a6e790 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:10.041813 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5d63a-b27c-4ab0-913d-a5094adb2021 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:10.042202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5d63a-b27c-4ab0-913d-a5094adb2021 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:10.042324 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5d63a-b27c-4ab0-913d-a5094adb2021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:10.046413 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-aeee38c7-c2c4-4b31-84a1-8dfe65276dca None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:10.047664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-aeee38c7-c2c4-4b31-84a1-8dfe65276dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:10.063627 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-bbc5d63a-b27c-4ab0-913d-a5094adb2021 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:10.064856 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-bbc5d63a-b27c-4ab0-913d-a5094adb2021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:10.120169 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 960/1935] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:10.120901 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee38c7-c2c4-4b31-84a1-8dfe65276dca None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:10.130377 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee38c7-c2c4-4b31-84a1-8dfe65276dca None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:10.131509 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 976/1936] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:10.136388 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87c7f6-beb6-47af-9620-438c99b970be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:10.137133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87c7f6-beb6-47af-9620-438c99b970be admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:10.137504 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87c7f6-beb6-47af-9620-438c99b970be admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:10.137847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87c7f6-beb6-47af-9620-438c99b970be admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:10.138649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87c7f6-beb6-47af-9620-438c99b970be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:47:10.139022 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87c7f6-beb6-47af-9620-438c99b970be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:10.141122 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87c7f6-beb6-47af-9620-438c99b970be admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:10.142011 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5d63a-b27c-4ab0-913d-a5094adb2021 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:10.143586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-bbc5d63a-b27c-4ab0-913d-a5094adb2021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:10.159450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 961/1937] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:47:10.165069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87c7f6-beb6-47af-9620-438c99b970be admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:10.176285 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87c7f6-beb6-47af-9620-438c99b970be admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:10.181560 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dee6fa-64c0-4ed2-aa3a-2ac70262c91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:10.182334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dee6fa-64c0-4ed2-aa3a-2ac70262c91a admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:10.182513 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dee6fa-64c0-4ed2-aa3a-2ac70262c91a admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:10.182916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dee6fa-64c0-4ed2-aa3a-2ac70262c91a admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:10.183653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dee6fa-64c0-4ed2-aa3a-2ac70262c91a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:10.185718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dee6fa-64c0-4ed2-aa3a-2ac70262c91a admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:10.224720 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5d63a-b27c-4ab0-913d-a5094adb2021 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:10.225254 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 962/1938] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:10 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:10.226475 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dee6fa-64c0-4ed2-aa3a-2ac70262c91a admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:10.307285 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f63691-29ab-4d52-9981-4f79de9fa72e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:10.308139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f63691-29ab-4d52-9981-4f79de9fa72e service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:10.308551 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f63691-29ab-4d52-9981-4f79de9fa72e service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:10.308896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f63691-29ab-4d52-9981-4f79de9fa72e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:10.342313 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dee6fa-64c0-4ed2-aa3a-2ac70262c91a admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:10.351521 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a58e99-f2b9-4a96-be87-dfa9972c75a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:10.352401 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a58e99-f2b9-4a96-be87-dfa9972c75a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:10.352749 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a58e99-f2b9-4a96-be87-dfa9972c75a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:10.353146 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a58e99-f2b9-4a96-be87-dfa9972c75a3 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:10.354163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a58e99-f2b9-4a96-be87-dfa9972c75a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:10.356400 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a58e99-f2b9-4a96-be87-dfa9972c75a3 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:10.405612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 963/1939] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:10 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:10.411681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a58e99-f2b9-4a96-be87-dfa9972c75a3 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:10.424113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a58e99-f2b9-4a96-be87-dfa9972c75a3 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:10.433396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdddadc-98d0-4056-a156-f65d585b4bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:10.434325 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdddadc-98d0-4056-a156-f65d585b4bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:10.437914 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdddadc-98d0-4056-a156-f65d585b4bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:10.442604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdddadc-98d0-4056-a156-f65d585b4bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:10.443286 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f63691-29ab-4d52-9981-4f79de9fa72e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:10.443760 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdddadc-98d0-4056-a156-f65d585b4bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:10.444793 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f63691-29ab-4d52-9981-4f79de9fa72e service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:10.447358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdddadc-98d0-4056-a156-f65d585b4bb6 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:10.462124 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 977/1940] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:47:10.480983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 964/1941] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:10.481825 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f63691-29ab-4d52-9981-4f79de9fa72e service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:10.493398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f63691-29ab-4d52-9981-4f79de9fa72e service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:10.504937 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd7dca-20ba-4f8e-bc74-40b7a8cc20ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:10.505628 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd7dca-20ba-4f8e-bc74-40b7a8cc20ce admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:10.505910 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd7dca-20ba-4f8e-bc74-40b7a8cc20ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:10.506191 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd7dca-20ba-4f8e-bc74-40b7a8cc20ce admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:10.506898 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd7dca-20ba-4f8e-bc74-40b7a8cc20ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:10.508635 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd7dca-20ba-4f8e-bc74-40b7a8cc20ce admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:10.537814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 978/1942] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:47:10.538718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdddadc-98d0-4056-a156-f65d585b4bb6 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:10.550424 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd7dca-20ba-4f8e-bc74-40b7a8cc20ce admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:10.552271 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-54cd7dca-20ba-4f8e-bc74-40b7a8cc20ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:10.556180 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdddadc-98d0-4056-a156-f65d585b4bb6 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:10.566163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4ebff-83da-4b4f-b26d-04ea8b1ac34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:10.567246 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4ebff-83da-4b4f-b26d-04ea8b1ac34f admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:10.567534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4ebff-83da-4b4f-b26d-04ea8b1ac34f admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:10.567951 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4ebff-83da-4b4f-b26d-04ea8b1ac34f admin admin] PATH_INFO: `/v3/projects/5cd90da7657947b59cf7e637e8eca556/users/f2e665b1c741487180b8b731fe99cf53/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:10.594397 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4ebff-83da-4b4f-b26d-04ea8b1ac34f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd90da7657947b59cf7e637e8eca556, user_id=f2e665b1c741487180b8b731fe99cf53, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:10.597261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4ebff-83da-4b4f-b26d-04ea8b1ac34f admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:10.612076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 965/1943] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:10 2022] PUT /identity/v3/projects/5cd90da7657947b59cf7e637e8eca556/users/f2e665b1c741487180b8b731fe99cf53/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:10.623598 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5454ed-5342-44d0-b1c6-20e0dfc190c2 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:10.624023 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5454ed-5342-44d0-b1c6-20e0dfc190c2 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:10.624263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5454ed-5342-44d0-b1c6-20e0dfc190c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:10.662247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-bf5454ed-5342-44d0-b1c6-20e0dfc190c2 None None] MFA Rules not processed for user `f2e665b1c741487180b8b731fe99cf53`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:10.662983 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd7dca-20ba-4f8e-bc74-40b7a8cc20ce admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:10.664505 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-bf5454ed-5342-44d0-b1c6-20e0dfc190c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:10.739924 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694be2b-0b24-4e6f-91f6-67cbd4033587 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:10.740624 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694be2b-0b24-4e6f-91f6-67cbd4033587 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:10.741095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694be2b-0b24-4e6f-91f6-67cbd4033587 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:10.741659 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694be2b-0b24-4e6f-91f6-67cbd4033587 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:10.743580 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5694be2b-0b24-4e6f-91f6-67cbd4033587 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:10.754569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 966/1944] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:10.755935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5454ed-5342-44d0-b1c6-20e0dfc190c2 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:10.757681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-bf5454ed-5342-44d0-b1c6-20e0dfc190c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:10.841662 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694be2b-0b24-4e6f-91f6-67cbd4033587 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:10.843901 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694be2b-0b24-4e6f-91f6-67cbd4033587 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:10.860029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5454ed-5342-44d0-b1c6-20e0dfc190c2 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:10.869519 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 979/1945] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:10.872726 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694be2b-0b24-4e6f-91f6-67cbd4033587 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:10.875254 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269270c-c86c-4046-ad93-395cb7a0a807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:10.878379 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269270c-c86c-4046-ad93-395cb7a0a807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:10.879267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269270c-c86c-4046-ad93-395cb7a0a807 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:10.879562 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269270c-c86c-4046-ad93-395cb7a0a807 admin admin] PATH_INFO: `/v3/users/bd04e02b38384659b7acc371af728584` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:10.883314 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269270c-c86c-4046-ad93-395cb7a0a807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd04e02b38384659b7acc371af728584)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:10.889474 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269270c-c86c-4046-ad93-395cb7a0a807 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:10.895883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694be2b-0b24-4e6f-91f6-67cbd4033587 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:10.933183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32186060-9ba3-42d0-85aa-cfd7237a9af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:10.933882 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32186060-9ba3-42d0-85aa-cfd7237a9af7 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:10.934169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32186060-9ba3-42d0-85aa-cfd7237a9af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:10.934447 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32186060-9ba3-42d0-85aa-cfd7237a9af7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:10.935207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32186060-9ba3-42d0-85aa-cfd7237a9af7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:10.940147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32186060-9ba3-42d0-85aa-cfd7237a9af7 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:10.980712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-f269270c-c86c-4046-ad93-395cb7a0a807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd04e02b38384659b7acc371af728584'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:10.994389 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-f269270c-c86c-4046-ad93-395cb7a0a807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd04e02b38384659b7acc371af728584'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:11.001893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 980/1946] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:10 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:11.009592 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32186060-9ba3-42d0-85aa-cfd7237a9af7 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:11.019809 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-f269270c-c86c-4046-ad93-395cb7a0a807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd04e02b38384659b7acc371af728584'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:11.021377 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-f269270c-c86c-4046-ad93-395cb7a0a807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd04e02b38384659b7acc371af728584'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:11.036142 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-f269270c-c86c-4046-ad93-395cb7a0a807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd04e02b38384659b7acc371af728584'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:11.087845 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 967/1947] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:10 2022] DELETE /identity/v3/users/bd04e02b38384659b7acc371af728584 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:11.089141 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269270c-c86c-4046-ad93-395cb7a0a807 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:11.091177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f269270c-c86c-4046-ad93-395cb7a0a807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:11.127974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32186060-9ba3-42d0-85aa-cfd7237a9af7 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:11.187870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269270c-c86c-4046-ad93-395cb7a0a807 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:11.193243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2a881-823e-48c4-8bb7-92cc7173a744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:11.194451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2a881-823e-48c4-8bb7-92cc7173a744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:11.195748 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2a881-823e-48c4-8bb7-92cc7173a744 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:11.196156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2a881-823e-48c4-8bb7-92cc7173a744 admin admin] PATH_INFO: `/v3/projects/414757b98fce48eeaa07ba0b9862eb3a` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:11.197796 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2a881-823e-48c4-8bb7-92cc7173a744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=414757b98fce48eeaa07ba0b9862eb3a)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:11.199893 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2a881-823e-48c4-8bb7-92cc7173a744 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:11.214247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a9a8d-1f30-4038-a5b1-143cd4ae11ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:11.214966 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a9a8d-1f30-4038-a5b1-143cd4ae11ee admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:11.215290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a9a8d-1f30-4038-a5b1-143cd4ae11ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:11.215569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a9a8d-1f30-4038-a5b1-143cd4ae11ee admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:11.216280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a9a8d-1f30-4038-a5b1-143cd4ae11ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:11.218345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a9a8d-1f30-4038-a5b1-143cd4ae11ee admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:11.242349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 981/1948] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:11 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:11.244882 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efec171-925e-47e5-9e66-55f73aa65714 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:11.245579 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efec171-925e-47e5-9e66-55f73aa65714 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:11.245851 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efec171-925e-47e5-9e66-55f73aa65714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:11.268035 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-9efec171-925e-47e5-9e66-55f73aa65714 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:11.269538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-9efec171-925e-47e5-9e66-55f73aa65714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:11.275650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-92d2a881-823e-48c4-8bb7-92cc7173a744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '414757b98fce48eeaa07ba0b9862eb3a', 'request_id': 'req-92d2a881-823e-48c4-8bb7-92cc7173a744'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:11.283963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-92d2a881-823e-48c4-8bb7-92cc7173a744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '414757b98fce48eeaa07ba0b9862eb3a', 'request_id': 'req-92d2a881-823e-48c4-8bb7-92cc7173a744'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:11.300564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-92d2a881-823e-48c4-8bb7-92cc7173a744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '414757b98fce48eeaa07ba0b9862eb3a', 'request_id': 'req-92d2a881-823e-48c4-8bb7-92cc7173a744'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:11.321694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-92d2a881-823e-48c4-8bb7-92cc7173a744 admin admin] The token cache is being invalidate because project 414757b98fce48eeaa07ba0b9862eb3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:11.324309 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-92d2a881-823e-48c4-8bb7-92cc7173a744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:11.325208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-92d2a881-823e-48c4-8bb7-92cc7173a744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:11.328467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 968/1949] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:11 2022] DELETE /identity/v3/projects/414757b98fce48eeaa07ba0b9862eb3a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:11.330376 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2a881-823e-48c4-8bb7-92cc7173a744 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:11.336744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-92d2a881-823e-48c4-8bb7-92cc7173a744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:11.379162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 982/1950] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:11.379704 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efec171-925e-47e5-9e66-55f73aa65714 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:11.382290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-9efec171-925e-47e5-9e66-55f73aa65714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:11.404405 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efec171-925e-47e5-9e66-55f73aa65714 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:11.411573 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6ff03-1ad3-429f-8c12-eae576e247b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:11.412857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6ff03-1ad3-429f-8c12-eae576e247b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:11.413404 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6ff03-1ad3-429f-8c12-eae576e247b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:11.414688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6ff03-1ad3-429f-8c12-eae576e247b9 admin admin] PATH_INFO: `/v3/users/4b810b8687dc444daaa6a55f974332dd` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:11.416327 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6ff03-1ad3-429f-8c12-eae576e247b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b810b8687dc444daaa6a55f974332dd)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:11.419200 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6ff03-1ad3-429f-8c12-eae576e247b9 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:11.439240 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2a881-823e-48c4-8bb7-92cc7173a744 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:11.465409 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30258a43-a0e9-4276-aa84-962432eeeb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:11.468114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30258a43-a0e9-4276-aa84-962432eeeb78 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:11.471780 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30258a43-a0e9-4276-aa84-962432eeeb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:11.472078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30258a43-a0e9-4276-aa84-962432eeeb78 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:11.472858 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30258a43-a0e9-4276-aa84-962432eeeb78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:11.480392 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30258a43-a0e9-4276-aa84-962432eeeb78 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:11.505694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 969/1951] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:11.506629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30258a43-a0e9-4276-aa84-962432eeeb78 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:11.514596 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-30258a43-a0e9-4276-aa84-962432eeeb78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:11.520293 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-acc6ff03-1ad3-429f-8c12-eae576e247b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b810b8687dc444daaa6a55f974332dd'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:11.550527 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-acc6ff03-1ad3-429f-8c12-eae576e247b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b810b8687dc444daaa6a55f974332dd'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:11.554150 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-acc6ff03-1ad3-429f-8c12-eae576e247b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b810b8687dc444daaa6a55f974332dd'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:11.578202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-acc6ff03-1ad3-429f-8c12-eae576e247b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b810b8687dc444daaa6a55f974332dd'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:11.598564 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-acc6ff03-1ad3-429f-8c12-eae576e247b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b810b8687dc444daaa6a55f974332dd'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:11.615152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 983/1952] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:11 2022] DELETE /identity/v3/users/4b810b8687dc444daaa6a55f974332dd => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:11.615152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6ff03-1ad3-429f-8c12-eae576e247b9 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:11.618481 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-acc6ff03-1ad3-429f-8c12-eae576e247b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:11.653129 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30258a43-a0e9-4276-aa84-962432eeeb78 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:11.762808 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6ff03-1ad3-429f-8c12-eae576e247b9 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:11.769539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fb020-1ebe-4752-9c17-59a131797a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:11.770903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fb020-1ebe-4752-9c17-59a131797a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:11.771337 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fb020-1ebe-4752-9c17-59a131797a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:11.771707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fb020-1ebe-4752-9c17-59a131797a79 admin admin] PATH_INFO: `/v3/projects/8aca419b095740ceb392cf5456177be9/users/e101feedc2ce494f8729cc540f32c117/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:11.789962 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114db208-2e43-4cdc-b2a1-cfa80c2942ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:11.790750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114db208-2e43-4cdc-b2a1-cfa80c2942ce service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:11.790998 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114db208-2e43-4cdc-b2a1-cfa80c2942ce service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:11.791230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114db208-2e43-4cdc-b2a1-cfa80c2942ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:11.794018 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5fb020-1ebe-4752-9c17-59a131797a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aca419b095740ceb392cf5456177be9, user_id=e101feedc2ce494f8729cc540f32c117, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:11.799217 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5fb020-1ebe-4752-9c17-59a131797a79 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:11.804258 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-114db208-2e43-4cdc-b2a1-cfa80c2942ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:11.820860 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 984/1953] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:11 2022] PUT /identity/v3/projects/8aca419b095740ceb392cf5456177be9/users/e101feedc2ce494f8729cc540f32c117/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:11.824732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fb020-1ebe-4752-9c17-59a131797a79 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:11.838292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114db208-2e43-4cdc-b2a1-cfa80c2942ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:11.840733 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114db208-2e43-4cdc-b2a1-cfa80c2942ce service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:11.868224 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 970/1954] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:11.935840 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fb020-1ebe-4752-9c17-59a131797a79 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:11.941122 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48242b14-380d-42cf-8628-13b22f0d659f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:11.942074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48242b14-380d-42cf-8628-13b22f0d659f admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:11.942362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48242b14-380d-42cf-8628-13b22f0d659f admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:11.942703 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48242b14-380d-42cf-8628-13b22f0d659f admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:11.943512 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48242b14-380d-42cf-8628-13b22f0d659f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:11.945557 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48242b14-380d-42cf-8628-13b22f0d659f admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:11.976274 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 985/1955] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:47:11.983583 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114db208-2e43-4cdc-b2a1-cfa80c2942ce service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:11.994252 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48242b14-380d-42cf-8628-13b22f0d659f admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:11.994421 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114db208-2e43-4cdc-b2a1-cfa80c2942ce service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:11.996947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-48242b14-380d-42cf-8628-13b22f0d659f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:12.004984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1a3a1-2537-4d58-80fc-c390208a0506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:12.005921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1a3a1-2537-4d58-80fc-c390208a0506 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:12.006202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1a3a1-2537-4d58-80fc-c390208a0506 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:12.006477 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1a3a1-2537-4d58-80fc-c390208a0506 admin admin] PATH_INFO: `/v3/projects/8aca419b095740ceb392cf5456177be9/users/e101feedc2ce494f8729cc540f32c117/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:12.011861 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1a3a1-2537-4d58-80fc-c390208a0506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aca419b095740ceb392cf5456177be9, user_id=e101feedc2ce494f8729cc540f32c117, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:12.015132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1a3a1-2537-4d58-80fc-c390208a0506 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:12.031535 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 971/1956] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:11 2022] PUT /identity/v3/projects/8aca419b095740ceb392cf5456177be9/users/e101feedc2ce494f8729cc540f32c117/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:12.050620 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03aacd-7f2a-4937-83e9-34c5be3519db None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:12.051000 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03aacd-7f2a-4937-83e9-34c5be3519db None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:12.051799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03aacd-7f2a-4937-83e9-34c5be3519db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:12.086742 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48242b14-380d-42cf-8628-13b22f0d659f admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:12.116775 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-3a03aacd-7f2a-4937-83e9-34c5be3519db None None] MFA Rules not processed for user `e101feedc2ce494f8729cc540f32c117`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:12.117783 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-3a03aacd-7f2a-4937-83e9-34c5be3519db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:12.191227 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfa6c6-65fb-4e70-8a58-d4a9b3eecc7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:12.192109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfa6c6-65fb-4e70-8a58-d4a9b3eecc7c service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:12.192485 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfa6c6-65fb-4e70-8a58-d4a9b3eecc7c service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:12.192883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfa6c6-65fb-4e70-8a58-d4a9b3eecc7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:12.194992 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-27dfa6c6-65fb-4e70-8a58-d4a9b3eecc7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:12.245327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 972/1957] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:12.280207 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03aacd-7f2a-4937-83e9-34c5be3519db None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:12.282250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-3a03aacd-7f2a-4937-83e9-34c5be3519db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:12.284542 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfa6c6-65fb-4e70-8a58-d4a9b3eecc7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:12.286100 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfa6c6-65fb-4e70-8a58-d4a9b3eecc7c service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:12.298398 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03aacd-7f2a-4937-83e9-34c5be3519db None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:12.300543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 986/1958] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:12.311805 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22494a-7730-410c-8dc6-6a91d5cbeed3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:12.312499 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22494a-7730-410c-8dc6-6a91d5cbeed3 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:12.312758 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22494a-7730-410c-8dc6-6a91d5cbeed3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:12.313669 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22494a-7730-410c-8dc6-6a91d5cbeed3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:12.323245 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22494a-7730-410c-8dc6-6a91d5cbeed3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:12.324790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22494a-7730-410c-8dc6-6a91d5cbeed3 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:12.343457 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 973/1959] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:47:12.362161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfa6c6-65fb-4e70-8a58-d4a9b3eecc7c service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:12.363848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-27dfa6c6-65fb-4e70-8a58-d4a9b3eecc7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:12.470616 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfa6c6-65fb-4e70-8a58-d4a9b3eecc7c service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:12.477538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36297bdc-ff07-492b-b598-53a1bee95b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:12.478516 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36297bdc-ff07-492b-b598-53a1bee95b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:12.478861 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36297bdc-ff07-492b-b598-53a1bee95b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:12.479631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36297bdc-ff07-492b-b598-53a1bee95b4c admin admin] PATH_INFO: `/v3/projects/9dc389131e994078928d921749c4d331` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:12.480705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36297bdc-ff07-492b-b598-53a1bee95b4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dc389131e994078928d921749c4d331)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:12.482885 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36297bdc-ff07-492b-b598-53a1bee95b4c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:12.507188 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22494a-7730-410c-8dc6-6a91d5cbeed3 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:12.516519 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22494a-7730-410c-8dc6-6a91d5cbeed3 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:12.539637 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec225f33-4f33-4481-8b39-3a1db74bceb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:12.541161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec225f33-4f33-4481-8b39-3a1db74bceb9 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:12.541646 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec225f33-4f33-4481-8b39-3a1db74bceb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:12.542100 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec225f33-4f33-4481-8b39-3a1db74bceb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:12.544555 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ec225f33-4f33-4481-8b39-3a1db74bceb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:12.585863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-36297bdc-ff07-492b-b598-53a1bee95b4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc389131e994078928d921749c4d331', 'request_id': 'req-36297bdc-ff07-492b-b598-53a1bee95b4c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:12.597723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-36297bdc-ff07-492b-b598-53a1bee95b4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc389131e994078928d921749c4d331', 'request_id': 'req-36297bdc-ff07-492b-b598-53a1bee95b4c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:12.606108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-36297bdc-ff07-492b-b598-53a1bee95b4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc389131e994078928d921749c4d331', 'request_id': 'req-36297bdc-ff07-492b-b598-53a1bee95b4c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:12.620018 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-36297bdc-ff07-492b-b598-53a1bee95b4c admin admin] The token cache is being invalidate because project 9dc389131e994078928d921749c4d331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:12.620331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-36297bdc-ff07-492b-b598-53a1bee95b4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:12.621055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-36297bdc-ff07-492b-b598-53a1bee95b4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:12.626736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 987/1960] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:12 2022] DELETE /identity/v3/projects/9dc389131e994078928d921749c4d331 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:12.628789 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21208779-0422-4d5e-94ea-d97a59e2bc55 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:12.629303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21208779-0422-4d5e-94ea-d97a59e2bc55 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:12.629759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21208779-0422-4d5e-94ea-d97a59e2bc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:12.632387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec225f33-4f33-4481-8b39-3a1db74bceb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:12.634238 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec225f33-4f33-4481-8b39-3a1db74bceb9 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:12.646470 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 974/1961] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:47:12.654804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec225f33-4f33-4481-8b39-3a1db74bceb9 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:12.657421 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ec225f33-4f33-4481-8b39-3a1db74bceb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:12.674238 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec225f33-4f33-4481-8b39-3a1db74bceb9 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:12.677816 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-21208779-0422-4d5e-94ea-d97a59e2bc55 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:12.684572 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-21208779-0422-4d5e-94ea-d97a59e2bc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:12.754473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd4ec1-632e-489a-ae95-d8470f757394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:12.756183 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd4ec1-632e-489a-ae95-d8470f757394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:12.756629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd4ec1-632e-489a-ae95-d8470f757394 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:12.757292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd4ec1-632e-489a-ae95-d8470f757394 admin admin] PATH_INFO: `/v3/projects/1376c02854244e5d852c26714176ed8c` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:12.758550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd4ec1-632e-489a-ae95-d8470f757394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1376c02854244e5d852c26714176ed8c)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:12.760975 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd4ec1-632e-489a-ae95-d8470f757394 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:12.775081 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 988/1962] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:12.779262 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581211b8-b317-43d8-858d-12dd4a008ccc None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:12.779581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581211b8-b317-43d8-858d-12dd4a008ccc None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:12.779827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581211b8-b317-43d8-858d-12dd4a008ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:12.798423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-581211b8-b317-43d8-858d-12dd4a008ccc None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:12.799668 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-581211b8-b317-43d8-858d-12dd4a008ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:12.809071 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 989/1963] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:12.813910 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581211b8-b317-43d8-858d-12dd4a008ccc None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:12.824887 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581211b8-b317-43d8-858d-12dd4a008ccc None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:12.834364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4dfd4ec1-632e-489a-ae95-d8470f757394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1376c02854244e5d852c26714176ed8c', 'request_id': 'req-4dfd4ec1-632e-489a-ae95-d8470f757394'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:12.843339 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4dfd4ec1-632e-489a-ae95-d8470f757394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1376c02854244e5d852c26714176ed8c', 'request_id': 'req-4dfd4ec1-632e-489a-ae95-d8470f757394'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:12.854388 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4dfd4ec1-632e-489a-ae95-d8470f757394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1376c02854244e5d852c26714176ed8c', 'request_id': 'req-4dfd4ec1-632e-489a-ae95-d8470f757394'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:12.868317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4dfd4ec1-632e-489a-ae95-d8470f757394 admin admin] The token cache is being invalidate because project 1376c02854244e5d852c26714176ed8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:12.868700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4dfd4ec1-632e-489a-ae95-d8470f757394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:12.869278 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4dfd4ec1-632e-489a-ae95-d8470f757394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:12.871089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 975/1964] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:12 2022] DELETE /identity/v3/projects/1376c02854244e5d852c26714176ed8c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:12.875565 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd4ec1-632e-489a-ae95-d8470f757394 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:12.877220 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-4dfd4ec1-632e-489a-ae95-d8470f757394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:12.906706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed528a-6ced-4042-9fe1-6c83eb10adb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:12.907432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed528a-6ced-4042-9fe1-6c83eb10adb4 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:12.907720 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed528a-6ced-4042-9fe1-6c83eb10adb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:12.908001 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed528a-6ced-4042-9fe1-6c83eb10adb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:12.908741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed528a-6ced-4042-9fe1-6c83eb10adb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:47:12.909052 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed528a-6ced-4042-9fe1-6c83eb10adb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:12.910701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed528a-6ced-4042-9fe1-6c83eb10adb4 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:12.952741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 990/1965] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:47:12.954310 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed528a-6ced-4042-9fe1-6c83eb10adb4 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:12.956492 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-9eed528a-6ced-4042-9fe1-6c83eb10adb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:12.974607 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed528a-6ced-4042-9fe1-6c83eb10adb4 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:12.983827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b69c90-d192-4043-9707-c7f66eddbc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:12.984868 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b69c90-d192-4043-9707-c7f66eddbc00 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:12.985238 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b69c90-d192-4043-9707-c7f66eddbc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:12.987144 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b69c90-d192-4043-9707-c7f66eddbc00 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:12.987772 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b69c90-d192-4043-9707-c7f66eddbc00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:12.990539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b69c90-d192-4043-9707-c7f66eddbc00 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:13.025993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd4ec1-632e-489a-ae95-d8470f757394 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:13.046873 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 991/1966] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:12 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:13.047459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ae1d1-bb23-45f2-af78-46b9a10617f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:13.048006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b69c90-d192-4043-9707-c7f66eddbc00 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:13.048996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ae1d1-bb23-45f2-af78-46b9a10617f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:13.049494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ae1d1-bb23-45f2-af78-46b9a10617f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:13.050153 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ae1d1-bb23-45f2-af78-46b9a10617f9 admin admin] PATH_INFO: `/v3/users/c61b09b2b6ff4f8199c6142e0caa0a8f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:13.053351 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ae1d1-bb23-45f2-af78-46b9a10617f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c61b09b2b6ff4f8199c6142e0caa0a8f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:13.056258 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ae1d1-bb23-45f2-af78-46b9a10617f9 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:13.143992 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b69c90-d192-4043-9707-c7f66eddbc00 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:13.150909 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326dbb4-f6b6-4aa0-af76-7cd8b6a28746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:13.151685 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326dbb4-f6b6-4aa0-af76-7cd8b6a28746 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:13.151980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326dbb4-f6b6-4aa0-af76-7cd8b6a28746 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:13.152316 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326dbb4-f6b6-4aa0-af76-7cd8b6a28746 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:13.152953 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326dbb4-f6b6-4aa0-af76-7cd8b6a28746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:13.155278 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326dbb4-f6b6-4aa0-af76-7cd8b6a28746 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:13.165984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c60ae1d1-bb23-45f2-af78-46b9a10617f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c61b09b2b6ff4f8199c6142e0caa0a8f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:13.183540 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c60ae1d1-bb23-45f2-af78-46b9a10617f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c61b09b2b6ff4f8199c6142e0caa0a8f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:13.191596 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c60ae1d1-bb23-45f2-af78-46b9a10617f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c61b09b2b6ff4f8199c6142e0caa0a8f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:13.192602 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c60ae1d1-bb23-45f2-af78-46b9a10617f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c61b09b2b6ff4f8199c6142e0caa0a8f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:13.193986 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c60ae1d1-bb23-45f2-af78-46b9a10617f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c61b09b2b6ff4f8199c6142e0caa0a8f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:13.208124 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 992/1967] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:13 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:13.209113 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326dbb4-f6b6-4aa0-af76-7cd8b6a28746 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:13.211005 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-f326dbb4-f6b6-4aa0-af76-7cd8b6a28746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:13.229309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326dbb4-f6b6-4aa0-af76-7cd8b6a28746 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:13.234647 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bfd9c-1a07-47bb-86d7-68e4f12b461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:13.235778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bfd9c-1a07-47bb-86d7-68e4f12b461b admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:13.236137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bfd9c-1a07-47bb-86d7-68e4f12b461b admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:13.236390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bfd9c-1a07-47bb-86d7-68e4f12b461b admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:13.237346 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bfd9c-1a07-47bb-86d7-68e4f12b461b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:13.239403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bfd9c-1a07-47bb-86d7-68e4f12b461b admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:13.245161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 976/1968] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:12 2022] DELETE /identity/v3/users/c61b09b2b6ff4f8199c6142e0caa0a8f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:13.259518 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 993/1969] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:13.260496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ae1d1-bb23-45f2-af78-46b9a10617f9 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:13.326187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ae1d1-bb23-45f2-af78-46b9a10617f9 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:13.332857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91a025-0b32-49c7-a62e-a840ceb3b18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:13.333563 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91a025-0b32-49c7-a62e-a840ceb3b18c admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:13.333944 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91a025-0b32-49c7-a62e-a840ceb3b18c admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:13.334235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91a025-0b32-49c7-a62e-a840ceb3b18c admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:13.335074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91a025-0b32-49c7-a62e-a840ceb3b18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:13.336892 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91a025-0b32-49c7-a62e-a840ceb3b18c admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:13.352137 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 977/1970] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:47:13.353458 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bfd9c-1a07-47bb-86d7-68e4f12b461b admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:13.376223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bfd9c-1a07-47bb-86d7-68e4f12b461b admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:13.390299 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc02795-c051-4aa6-a18b-cb5fe6e482a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:13.391315 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc02795-c051-4aa6-a18b-cb5fe6e482a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:13.391606 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc02795-c051-4aa6-a18b-cb5fe6e482a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:13.391887 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc02795-c051-4aa6-a18b-cb5fe6e482a9 admin admin] PATH_INFO: `/v3/projects/35a09886bbc04b4f94a7ab12f5073995/users/6ad64214945346479d160a1f3bff0503/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:13.424877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc02795-c051-4aa6-a18b-cb5fe6e482a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a09886bbc04b4f94a7ab12f5073995, user_id=6ad64214945346479d160a1f3bff0503, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:13.430424 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc02795-c051-4aa6-a18b-cb5fe6e482a9 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:13.453611 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 994/1971] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:13 2022] PUT /identity/v3/projects/35a09886bbc04b4f94a7ab12f5073995/users/6ad64214945346479d160a1f3bff0503/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:13.467435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31852590-39a8-434b-9b35-9c4b4fa54f11 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:13.467699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31852590-39a8-434b-9b35-9c4b4fa54f11 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:13.468228 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31852590-39a8-434b-9b35-9c4b4fa54f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:13.504989 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-31852590-39a8-434b-9b35-9c4b4fa54f11 None None] MFA Rules not processed for user `6ad64214945346479d160a1f3bff0503`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:13.506230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-31852590-39a8-434b-9b35-9c4b4fa54f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:13.624913 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 978/1972] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:13.626075 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc02795-c051-4aa6-a18b-cb5fe6e482a9 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:13.741573 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc02795-c051-4aa6-a18b-cb5fe6e482a9 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:13.758944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e8013-b99e-4670-98ae-5cf1743a3692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:13.759886 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e8013-b99e-4670-98ae-5cf1743a3692 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:13.760907 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e8013-b99e-4670-98ae-5cf1743a3692 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:13.761342 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e8013-b99e-4670-98ae-5cf1743a3692 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:13.762833 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e8013-b99e-4670-98ae-5cf1743a3692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:13.766590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e8013-b99e-4670-98ae-5cf1743a3692 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:13.827298 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 995/1973] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:13 2022] POST /identity/v3/projects => generated 387 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:47:13.829665 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31852590-39a8-434b-9b35-9c4b4fa54f11 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:13.844363 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31852590-39a8-434b-9b35-9c4b4fa54f11 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:13.967208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb751e-607f-4043-95a5-84a431999823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:13.968158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb751e-607f-4043-95a5-84a431999823 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:13.969155 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb751e-607f-4043-95a5-84a431999823 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:13.969842 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb751e-607f-4043-95a5-84a431999823 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:13.971363 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb751e-607f-4043-95a5-84a431999823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:13.974846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e8013-b99e-4670-98ae-5cf1743a3692 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:13.976232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb751e-607f-4043-95a5-84a431999823 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:13.978374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-da1e8013-b99e-4670-98ae-5cf1743a3692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:14.000789 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e8013-b99e-4670-98ae-5cf1743a3692 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:14.008645 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 979/1974] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:13 2022] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:14.015268 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb751e-607f-4043-95a5-84a431999823 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:14.015745 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871c479-5ab8-43a7-b91e-64af5c1c4a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:14.017848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871c479-5ab8-43a7-b91e-64af5c1c4a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:14.018146 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871c479-5ab8-43a7-b91e-64af5c1c4a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:14.018434 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871c479-5ab8-43a7-b91e-64af5c1c4a25 admin admin] PATH_INFO: `/v3/projects/b497972b32bf4fea82fcfe845da4078c` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:14.022701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871c479-5ab8-43a7-b91e-64af5c1c4a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b497972b32bf4fea82fcfe845da4078c)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:14.027911 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871c479-5ab8-43a7-b91e-64af5c1c4a25 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:14.037159 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb751e-607f-4043-95a5-84a431999823 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:14.056504 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf949c-607f-4a66-91ae-c1088884d247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:14.057206 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf949c-607f-4a66-91ae-c1088884d247 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:14.057493 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf949c-607f-4a66-91ae-c1088884d247 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:14.057773 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf949c-607f-4a66-91ae-c1088884d247 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:14.058527 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf949c-607f-4a66-91ae-c1088884d247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:14.060172 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf949c-607f-4a66-91ae-c1088884d247 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:14.090138 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 980/1975] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:14.091328 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf949c-607f-4a66-91ae-c1088884d247 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:14.107597 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf949c-607f-4a66-91ae-c1088884d247 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:14.118754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4871c479-5ab8-43a7-b91e-64af5c1c4a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b497972b32bf4fea82fcfe845da4078c', 'request_id': 'req-4871c479-5ab8-43a7-b91e-64af5c1c4a25'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:14.136899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4871c479-5ab8-43a7-b91e-64af5c1c4a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b497972b32bf4fea82fcfe845da4078c', 'request_id': 'req-4871c479-5ab8-43a7-b91e-64af5c1c4a25'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:14.148348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4871c479-5ab8-43a7-b91e-64af5c1c4a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b497972b32bf4fea82fcfe845da4078c', 'request_id': 'req-4871c479-5ab8-43a7-b91e-64af5c1c4a25'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:14.177650 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4871c479-5ab8-43a7-b91e-64af5c1c4a25 admin admin] The token cache is being invalidate because project b497972b32bf4fea82fcfe845da4078c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:14.177967 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4871c479-5ab8-43a7-b91e-64af5c1c4a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:14.180393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4871c479-5ab8-43a7-b91e-64af5c1c4a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:14.191165 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 996/1976] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:13 2022] DELETE /identity/v3/projects/b497972b32bf4fea82fcfe845da4078c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:47:14.193088 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadbb44-00bd-405d-b911-c6a23494a91d None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:14.193382 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadbb44-00bd-405d-b911-c6a23494a91d None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:14.193663 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadbb44-00bd-405d-b911-c6a23494a91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:14.204050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba9635-74c2-4499-86c3-7f46094c75e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:14.206751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba9635-74c2-4499-86c3-7f46094c75e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:14.207590 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba9635-74c2-4499-86c3-7f46094c75e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:14.208662 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba9635-74c2-4499-86c3-7f46094c75e3 admin admin] PATH_INFO: `/v3/projects/8f5b0f64604f44768af656ff036abd45/users/eb833152876a4878b69161499ab4f7e1/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:14.228918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba9635-74c2-4499-86c3-7f46094c75e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f5b0f64604f44768af656ff036abd45, user_id=eb833152876a4878b69161499ab4f7e1, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:14.231975 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba9635-74c2-4499-86c3-7f46094c75e3 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:14.240962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-0aadbb44-00bd-405d-b911-c6a23494a91d None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:14.243543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-0aadbb44-00bd-405d-b911-c6a23494a91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:14.281812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 981/1977] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:14 2022] PUT /identity/v3/projects/8f5b0f64604f44768af656ff036abd45/users/eb833152876a4878b69161499ab4f7e1/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:14.282967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba9635-74c2-4499-86c3-7f46094c75e3 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:14.285268 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a3ba9635-74c2-4499-86c3-7f46094c75e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:14.377732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 997/1978] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:14.392298 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eab11b-4b23-47d9-8785-41a0a50272c2 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:14.393248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba9635-74c2-4499-86c3-7f46094c75e3 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:14.393555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eab11b-4b23-47d9-8785-41a0a50272c2 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:14.394026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eab11b-4b23-47d9-8785-41a0a50272c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:14.410082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b541783-2dd1-4ed7-9d45-a4e960a2005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:14.410776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b541783-2dd1-4ed7-9d45-a4e960a2005f admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:14.411108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b541783-2dd1-4ed7-9d45-a4e960a2005f admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:14.411357 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b541783-2dd1-4ed7-9d45-a4e960a2005f admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:14.412083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b541783-2dd1-4ed7-9d45-a4e960a2005f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:14.416262 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b541783-2dd1-4ed7-9d45-a4e960a2005f admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:14.434952 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 982/1979] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:14.440241 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b541783-2dd1-4ed7-9d45-a4e960a2005f admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:14.451998 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b541783-2dd1-4ed7-9d45-a4e960a2005f admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:14.457772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d17ba-d85e-4242-b76f-dfaa1aba3b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:14.458968 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d17ba-d85e-4242-b76f-dfaa1aba3b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:14.459292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d17ba-d85e-4242-b76f-dfaa1aba3b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:14.459573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d17ba-d85e-4242-b76f-dfaa1aba3b4c admin admin] PATH_INFO: `/v3/projects/8f5b0f64604f44768af656ff036abd45/users/eb833152876a4878b69161499ab4f7e1/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:14.464670 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d17ba-d85e-4242-b76f-dfaa1aba3b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f5b0f64604f44768af656ff036abd45, user_id=eb833152876a4878b69161499ab4f7e1, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:14.469168 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d17ba-d85e-4242-b76f-dfaa1aba3b4c admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:14.480514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-06eab11b-4b23-47d9-8785-41a0a50272c2 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:14.484989 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 983/1980] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:14 2022] PUT /identity/v3/projects/8f5b0f64604f44768af656ff036abd45/users/eb833152876a4878b69161499ab4f7e1/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:47:14.492031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-06eab11b-4b23-47d9-8785-41a0a50272c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:14.496738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a2bb6-bb7e-445f-b268-9d6e8da24f06 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:14.497034 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a2bb6-bb7e-445f-b268-9d6e8da24f06 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:14.497336 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a2bb6-bb7e-445f-b268-9d6e8da24f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:14.549782 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-d73a2bb6-bb7e-445f-b268-9d6e8da24f06 None None] MFA Rules not processed for user `eb833152876a4878b69161499ab4f7e1`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:14.551009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-d73a2bb6-bb7e-445f-b268-9d6e8da24f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:14.597526 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 998/1981] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:14.604816 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eab11b-4b23-47d9-8785-41a0a50272c2 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:14.614461 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eab11b-4b23-47d9-8785-41a0a50272c2 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:14.620262 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced7652-9b16-4b3d-b62a-061e702a8a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:14.620923 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced7652-9b16-4b3d-b62a-061e702a8a31 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:14.621208 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced7652-9b16-4b3d-b62a-061e702a8a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:14.621485 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced7652-9b16-4b3d-b62a-061e702a8a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:14.622283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced7652-9b16-4b3d-b62a-061e702a8a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:47:14.622774 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced7652-9b16-4b3d-b62a-061e702a8a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:14.624450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced7652-9b16-4b3d-b62a-061e702a8a31 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:14.647239 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 999/1982] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:47:14.652649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced7652-9b16-4b3d-b62a-061e702a8a31 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:14.671553 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced7652-9b16-4b3d-b62a-061e702a8a31 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:14.677498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbb25a-6161-4a4c-90bc-053af24e6062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:14.678223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbb25a-6161-4a4c-90bc-053af24e6062 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:14.678511 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbb25a-6161-4a4c-90bc-053af24e6062 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:14.678992 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbb25a-6161-4a4c-90bc-053af24e6062 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:14.679906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbb25a-6161-4a4c-90bc-053af24e6062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:14.683366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 984/1983] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:14.683479 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbb25a-6161-4a4c-90bc-053af24e6062 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:14.694009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a2bb6-bb7e-445f-b268-9d6e8da24f06 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:14.697624 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-d73a2bb6-bb7e-445f-b268-9d6e8da24f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:14.731700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1000/1984] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:14 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:14.736143 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbb25a-6161-4a4c-90bc-053af24e6062 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:14.768721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a2bb6-bb7e-445f-b268-9d6e8da24f06 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:14.816553 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbb25a-6161-4a4c-90bc-053af24e6062 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:14.820534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93007d23-8c26-49c2-81cc-f49c356ea90f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:14.821336 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f43308-8100-42f3-bc6d-8543f303bdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:14.821510 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93007d23-8c26-49c2-81cc-f49c356ea90f service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:14.821629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93007d23-8c26-49c2-81cc-f49c356ea90f service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:14.821903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93007d23-8c26-49c2-81cc-f49c356ea90f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:14.822042 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f43308-8100-42f3-bc6d-8543f303bdc3 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:14.822279 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f43308-8100-42f3-bc6d-8543f303bdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:14.822551 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f43308-8100-42f3-bc6d-8543f303bdc3 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:14.824975 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f43308-8100-42f3-bc6d-8543f303bdc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:14.825191 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f43308-8100-42f3-bc6d-8543f303bdc3 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:14.848241 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1001/1985] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:14 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:14.853373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f43308-8100-42f3-bc6d-8543f303bdc3 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:14.864638 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f43308-8100-42f3-bc6d-8543f303bdc3 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:14.871769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49763cb5-5aaf-40bd-861e-49c45005692b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:14.872776 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49763cb5-5aaf-40bd-861e-49c45005692b admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:14.873592 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49763cb5-5aaf-40bd-861e-49c45005692b admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:14.873882 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49763cb5-5aaf-40bd-861e-49c45005692b admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:14.874625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49763cb5-5aaf-40bd-861e-49c45005692b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:14.877802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49763cb5-5aaf-40bd-861e-49c45005692b admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:14.892762 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1002/1986] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:47:14.896193 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49763cb5-5aaf-40bd-861e-49c45005692b admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:14.910044 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49763cb5-5aaf-40bd-861e-49c45005692b admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:14.916189 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcdf6c-0b65-42b3-84e7-ca0e2bd97fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:14.917496 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcdf6c-0b65-42b3-84e7-ca0e2bd97fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:14.917885 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcdf6c-0b65-42b3-84e7-ca0e2bd97fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:14.918235 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcdf6c-0b65-42b3-84e7-ca0e2bd97fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:14.919374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adcdf6c-0b65-42b3-84e7-ca0e2bd97fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:14.919492 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93007d23-8c26-49c2-81cc-f49c356ea90f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:14.921004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adcdf6c-0b65-42b3-84e7-ca0e2bd97fe8 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:14.921606 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93007d23-8c26-49c2-81cc-f49c356ea90f service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:14.938052 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1003/1987] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:14.944022 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcdf6c-0b65-42b3-84e7-ca0e2bd97fe8 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:14.954757 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 985/1988] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:47:14.955853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcdf6c-0b65-42b3-84e7-ca0e2bd97fe8 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:14.962761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8a19f-3db0-4113-97ee-7fe5f5205f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:14.963861 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8a19f-3db0-4113-97ee-7fe5f5205f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:14.964286 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8a19f-3db0-4113-97ee-7fe5f5205f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:14.964723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8a19f-3db0-4113-97ee-7fe5f5205f6a admin admin] PATH_INFO: `/v3/projects/bc3818f1b6e949afaaf3228e0d442318/users/12fd15b985614e8287fb8ab0a111a237/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:14.987002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8a19f-3db0-4113-97ee-7fe5f5205f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3818f1b6e949afaaf3228e0d442318, user_id=12fd15b985614e8287fb8ab0a111a237, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:14.989899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8a19f-3db0-4113-97ee-7fe5f5205f6a admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:15.014715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1004/1989] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:14 2022] PUT /identity/v3/projects/bc3818f1b6e949afaaf3228e0d442318/users/12fd15b985614e8287fb8ab0a111a237/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:47:15.025742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b71c0-a447-43b5-b7fd-6b4bfbb7bc0f None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:15.026036 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b71c0-a447-43b5-b7fd-6b4bfbb7bc0f None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:15.026505 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b71c0-a447-43b5-b7fd-6b4bfbb7bc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:15.061140 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-f13b71c0-a447-43b5-b7fd-6b4bfbb7bc0f None None] MFA Rules not processed for user `12fd15b985614e8287fb8ab0a111a237`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:15.062743 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f13b71c0-a447-43b5-b7fd-6b4bfbb7bc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:15.155430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8a19f-3db0-4113-97ee-7fe5f5205f6a admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:15.180011 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 986/1990] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:15.190410 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b71c0-a447-43b5-b7fd-6b4bfbb7bc0f None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:15.192039 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f13b71c0-a447-43b5-b7fd-6b4bfbb7bc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:15.277699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8a19f-3db0-4113-97ee-7fe5f5205f6a admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:15.287444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a7f87-aaa6-4d0c-845c-aa03d9c6b586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:15.290740 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a7f87-aaa6-4d0c-845c-aa03d9c6b586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:15.291027 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a7f87-aaa6-4d0c-845c-aa03d9c6b586 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:15.291335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a7f87-aaa6-4d0c-845c-aa03d9c6b586 admin admin] PATH_INFO: `/v3/users/6ad64214945346479d160a1f3bff0503` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:15.293000 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b71c0-a447-43b5-b7fd-6b4bfbb7bc0f None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:15.294294 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a7f87-aaa6-4d0c-845c-aa03d9c6b586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ad64214945346479d160a1f3bff0503)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:15.297664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a7f87-aaa6-4d0c-845c-aa03d9c6b586 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:15.305035 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117310c1-47d0-434e-8795-61a6073e8535 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:15.305744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117310c1-47d0-434e-8795-61a6073e8535 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:15.305997 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117310c1-47d0-434e-8795-61a6073e8535 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:15.306304 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117310c1-47d0-434e-8795-61a6073e8535 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:15.328286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117310c1-47d0-434e-8795-61a6073e8535 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:15.333856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117310c1-47d0-434e-8795-61a6073e8535 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:15.345710 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 987/1991] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:15.404637 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-235a7f87-aaa6-4d0c-845c-aa03d9c6b586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ad64214945346479d160a1f3bff0503'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:15.413432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-235a7f87-aaa6-4d0c-845c-aa03d9c6b586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ad64214945346479d160a1f3bff0503'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:15.415868 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-235a7f87-aaa6-4d0c-845c-aa03d9c6b586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ad64214945346479d160a1f3bff0503'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:15.450510 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-235a7f87-aaa6-4d0c-845c-aa03d9c6b586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ad64214945346479d160a1f3bff0503'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:15.471733 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-235a7f87-aaa6-4d0c-845c-aa03d9c6b586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ad64214945346479d160a1f3bff0503'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:15.483921 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1005/1992] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:15 2022] DELETE /identity/v3/users/6ad64214945346479d160a1f3bff0503 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:47:15.489612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a996e7-3076-4ec1-b002-35e7276e8470 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:15.490296 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a996e7-3076-4ec1-b002-35e7276e8470 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:15.490721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a996e7-3076-4ec1-b002-35e7276e8470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:15.527812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-70a996e7-3076-4ec1-b002-35e7276e8470 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:15.529397 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-70a996e7-3076-4ec1-b002-35e7276e8470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:15.616006 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 988/1993] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:15.625531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a7f87-aaa6-4d0c-845c-aa03d9c6b586 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:15.627247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-235a7f87-aaa6-4d0c-845c-aa03d9c6b586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:15.629392 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a996e7-3076-4ec1-b002-35e7276e8470 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:15.630999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-70a996e7-3076-4ec1-b002-35e7276e8470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:15.650048 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a7f87-aaa6-4d0c-845c-aa03d9c6b586 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:15.656719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e3edc-04d3-4b2c-887e-f2dd04de4b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:15.658399 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e3edc-04d3-4b2c-887e-f2dd04de4b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:15.658823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e3edc-04d3-4b2c-887e-f2dd04de4b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:15.659248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e3edc-04d3-4b2c-887e-f2dd04de4b4c admin admin] PATH_INFO: `/v3/users/f2e665b1c741487180b8b731fe99cf53` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:15.661852 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e3edc-04d3-4b2c-887e-f2dd04de4b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2e665b1c741487180b8b731fe99cf53)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:15.665571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e3edc-04d3-4b2c-887e-f2dd04de4b4c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:15.756940 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-754e3edc-04d3-4b2c-887e-f2dd04de4b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2e665b1c741487180b8b731fe99cf53'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:15.768325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-754e3edc-04d3-4b2c-887e-f2dd04de4b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2e665b1c741487180b8b731fe99cf53'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:15.770349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-754e3edc-04d3-4b2c-887e-f2dd04de4b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2e665b1c741487180b8b731fe99cf53'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:15.790112 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-754e3edc-04d3-4b2c-887e-f2dd04de4b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2e665b1c741487180b8b731fe99cf53'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:15.800678 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a996e7-3076-4ec1-b002-35e7276e8470 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:15.806491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-754e3edc-04d3-4b2c-887e-f2dd04de4b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2e665b1c741487180b8b731fe99cf53'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:15.806853 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e508cf1-45e4-4fa4-a6f1-f885f6293708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:15.807500 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e508cf1-45e4-4fa4-a6f1-f885f6293708 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:15.807796 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e508cf1-45e4-4fa4-a6f1-f885f6293708 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:15.808077 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e508cf1-45e4-4fa4-a6f1-f885f6293708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:15.815354 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-4e508cf1-45e4-4fa4-a6f1-f885f6293708 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:15.820172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1006/1994] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:15 2022] DELETE /identity/v3/users/f2e665b1c741487180b8b731fe99cf53 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:15.828140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b1033-ecae-4355-9c74-221229cf17dc None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:15.828770 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b1033-ecae-4355-9c74-221229cf17dc None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:15.829152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b1033-ecae-4355-9c74-221229cf17dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:15.832048 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e508cf1-45e4-4fa4-a6f1-f885f6293708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:15.833503 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e508cf1-45e4-4fa4-a6f1-f885f6293708 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:15.853500 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-9c1b1033-ecae-4355-9c74-221229cf17dc None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:15.855268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-9c1b1033-ecae-4355-9c74-221229cf17dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:15.860198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 989/1995] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:15.939639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1007/1996] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:47:15.958537 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e508cf1-45e4-4fa4-a6f1-f885f6293708 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:15.961289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-4e508cf1-45e4-4fa4-a6f1-f885f6293708 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:15.996503 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e508cf1-45e4-4fa4-a6f1-f885f6293708 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:16.093315 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc57f6d-c03d-49af-93c1-e35c95c82d62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:16.094434 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc57f6d-c03d-49af-93c1-e35c95c82d62 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:16.094837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc57f6d-c03d-49af-93c1-e35c95c82d62 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:16.095258 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc57f6d-c03d-49af-93c1-e35c95c82d62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:16.111748 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc57f6d-c03d-49af-93c1-e35c95c82d62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:16.115135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc57f6d-c03d-49af-93c1-e35c95c82d62 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:16.145459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 990/1997] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:16.469669 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b1033-ecae-4355-9c74-221229cf17dc None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:16.471347 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-9c1b1033-ecae-4355-9c74-221229cf17dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:16.518240 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b1033-ecae-4355-9c74-221229cf17dc None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:16.524381 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd86f2f-5b52-4232-a061-37f2c4771c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:16.525420 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd86f2f-5b52-4232-a061-37f2c4771c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:16.526001 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd86f2f-5b52-4232-a061-37f2c4771c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:16.526226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd86f2f-5b52-4232-a061-37f2c4771c87 admin admin] PATH_INFO: `/v3/projects/35a09886bbc04b4f94a7ab12f5073995` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:16.528327 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd86f2f-5b52-4232-a061-37f2c4771c87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35a09886bbc04b4f94a7ab12f5073995)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:16.540249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd86f2f-5b52-4232-a061-37f2c4771c87 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:16.603287 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3bd86f2f-5b52-4232-a061-37f2c4771c87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a09886bbc04b4f94a7ab12f5073995', 'request_id': 'req-3bd86f2f-5b52-4232-a061-37f2c4771c87'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:16.614957 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3bd86f2f-5b52-4232-a061-37f2c4771c87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a09886bbc04b4f94a7ab12f5073995', 'request_id': 'req-3bd86f2f-5b52-4232-a061-37f2c4771c87'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:16.621864 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3bd86f2f-5b52-4232-a061-37f2c4771c87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a09886bbc04b4f94a7ab12f5073995', 'request_id': 'req-3bd86f2f-5b52-4232-a061-37f2c4771c87'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:16.632737 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3bd86f2f-5b52-4232-a061-37f2c4771c87 admin admin] The token cache is being invalidate because project 35a09886bbc04b4f94a7ab12f5073995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:16.633046 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3bd86f2f-5b52-4232-a061-37f2c4771c87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:16.633629 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3bd86f2f-5b52-4232-a061-37f2c4771c87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:16.635493 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1008/1998] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:16 2022] DELETE /identity/v3/projects/35a09886bbc04b4f94a7ab12f5073995 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:16.639139 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc57f6d-c03d-49af-93c1-e35c95c82d62 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:16.655719 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc57f6d-c03d-49af-93c1-e35c95c82d62 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:16.727594 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b47bef-5ccb-4b81-89da-94a638e18493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:16.727835 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd86f2f-5b52-4232-a061-37f2c4771c87 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:16.728701 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b47bef-5ccb-4b81-89da-94a638e18493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:16.729066 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b47bef-5ccb-4b81-89da-94a638e18493 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:16.729431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b47bef-5ccb-4b81-89da-94a638e18493 admin admin] PATH_INFO: `/v3/users/eb833152876a4878b69161499ab4f7e1` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:16.730273 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-3bd86f2f-5b52-4232-a061-37f2c4771c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:16.730854 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b47bef-5ccb-4b81-89da-94a638e18493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb833152876a4878b69161499ab4f7e1)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:16.733248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b47bef-5ccb-4b81-89da-94a638e18493 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:16.754997 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd86f2f-5b52-4232-a061-37f2c4771c87 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:16.761680 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c16f0-d36c-4df5-9b54-8a57d1f7c58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:16.762499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c16f0-d36c-4df5-9b54-8a57d1f7c58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:16.762772 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c16f0-d36c-4df5-9b54-8a57d1f7c58d admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:16.763069 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c16f0-d36c-4df5-9b54-8a57d1f7c58d admin admin] PATH_INFO: `/v3/projects/5cd90da7657947b59cf7e637e8eca556` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:16.764922 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c16f0-d36c-4df5-9b54-8a57d1f7c58d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd90da7657947b59cf7e637e8eca556)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:16.766921 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c16f0-d36c-4df5-9b54-8a57d1f7c58d admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:16.808246 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-34b47bef-5ccb-4b81-89da-94a638e18493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb833152876a4878b69161499ab4f7e1'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:16.815370 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ba6c16f0-d36c-4df5-9b54-8a57d1f7c58d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd90da7657947b59cf7e637e8eca556', 'request_id': 'req-ba6c16f0-d36c-4df5-9b54-8a57d1f7c58d'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:16.816793 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-34b47bef-5ccb-4b81-89da-94a638e18493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb833152876a4878b69161499ab4f7e1'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:16.825903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ba6c16f0-d36c-4df5-9b54-8a57d1f7c58d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd90da7657947b59cf7e637e8eca556', 'request_id': 'req-ba6c16f0-d36c-4df5-9b54-8a57d1f7c58d'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:16.826441 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-34b47bef-5ccb-4b81-89da-94a638e18493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb833152876a4878b69161499ab4f7e1'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:16.827291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-34b47bef-5ccb-4b81-89da-94a638e18493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb833152876a4878b69161499ab4f7e1'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:16.828091 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-34b47bef-5ccb-4b81-89da-94a638e18493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb833152876a4878b69161499ab4f7e1'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:16.833371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ba6c16f0-d36c-4df5-9b54-8a57d1f7c58d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd90da7657947b59cf7e637e8eca556', 'request_id': 'req-ba6c16f0-d36c-4df5-9b54-8a57d1f7c58d'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:16.844350 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ba6c16f0-d36c-4df5-9b54-8a57d1f7c58d admin admin] The token cache is being invalidate because project 5cd90da7657947b59cf7e637e8eca556 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:16.844719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ba6c16f0-d36c-4df5-9b54-8a57d1f7c58d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:16.845449 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ba6c16f0-d36c-4df5-9b54-8a57d1f7c58d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:16.846447 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 991/1999] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:16 2022] DELETE /identity/v3/users/eb833152876a4878b69161499ab4f7e1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:16.847224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1009/2000] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:16 2022] DELETE /identity/v3/projects/5cd90da7657947b59cf7e637e8eca556 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:16.853100 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b47bef-5ccb-4b81-89da-94a638e18493 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:16.854645 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-34b47bef-5ccb-4b81-89da-94a638e18493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:16.941819 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b47bef-5ccb-4b81-89da-94a638e18493 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:16.949099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06fe7f9-d386-41b2-9e54-6699ba6b9158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:16.951353 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fe7f9-d386-41b2-9e54-6699ba6b9158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:16.951646 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fe7f9-d386-41b2-9e54-6699ba6b9158 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:16.951928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fe7f9-d386-41b2-9e54-6699ba6b9158 admin admin] PATH_INFO: `/v3/users/e101feedc2ce494f8729cc540f32c117` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:16.954591 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06fe7f9-d386-41b2-9e54-6699ba6b9158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e101feedc2ce494f8729cc540f32c117)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:16.956609 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06fe7f9-d386-41b2-9e54-6699ba6b9158 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:16.971920 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c16f0-d36c-4df5-9b54-8a57d1f7c58d admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:16.974196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ba6c16f0-d36c-4df5-9b54-8a57d1f7c58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:17.050285 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b06fe7f9-d386-41b2-9e54-6699ba6b9158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e101feedc2ce494f8729cc540f32c117'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:17.071024 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b06fe7f9-d386-41b2-9e54-6699ba6b9158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e101feedc2ce494f8729cc540f32c117'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:17.094449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b06fe7f9-d386-41b2-9e54-6699ba6b9158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e101feedc2ce494f8729cc540f32c117'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:17.096882 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b06fe7f9-d386-41b2-9e54-6699ba6b9158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e101feedc2ce494f8729cc540f32c117'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:17.098206 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b06fe7f9-d386-41b2-9e54-6699ba6b9158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e101feedc2ce494f8729cc540f32c117'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:17.129758 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 992/2001] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:16 2022] DELETE /identity/v3/users/e101feedc2ce494f8729cc540f32c117 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:47:17.136314 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c16f0-d36c-4df5-9b54-8a57d1f7c58d admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:17.219755 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715c018-b799-49f6-b561-faeb0003aa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:17.221679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715c018-b799-49f6-b561-faeb0003aa8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:17.222070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715c018-b799-49f6-b561-faeb0003aa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:17.222650 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715c018-b799-49f6-b561-faeb0003aa8b admin admin] PATH_INFO: `/v3/users/d20750eaa264488f908cacff25567435` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:17.224260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715c018-b799-49f6-b561-faeb0003aa8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d20750eaa264488f908cacff25567435)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:17.228548 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715c018-b799-49f6-b561-faeb0003aa8b admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:17.308661 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a715c018-b799-49f6-b561-faeb0003aa8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd20750eaa264488f908cacff25567435'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:17.316464 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a715c018-b799-49f6-b561-faeb0003aa8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd20750eaa264488f908cacff25567435'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:17.317172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a715c018-b799-49f6-b561-faeb0003aa8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd20750eaa264488f908cacff25567435'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:17.336144 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a715c018-b799-49f6-b561-faeb0003aa8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd20750eaa264488f908cacff25567435'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:17.349555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a715c018-b799-49f6-b561-faeb0003aa8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd20750eaa264488f908cacff25567435'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:17.356978 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1010/2002] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:16 2022] DELETE /identity/v3/users/d20750eaa264488f908cacff25567435 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:47:17.363985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19805808-fb05-41ad-b3a5-0b30d9ec246a None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:17.364291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19805808-fb05-41ad-b3a5-0b30d9ec246a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:17.364539 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19805808-fb05-41ad-b3a5-0b30d9ec246a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:17.368986 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715c018-b799-49f6-b561-faeb0003aa8b admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:17.370420 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a715c018-b799-49f6-b561-faeb0003aa8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:17.386470 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-19805808-fb05-41ad-b3a5-0b30d9ec246a None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:17.388090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-19805808-fb05-41ad-b3a5-0b30d9ec246a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:17.463895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 993/2003] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:17.470909 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715c018-b799-49f6-b561-faeb0003aa8b admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:17.475143 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19805808-fb05-41ad-b3a5-0b30d9ec246a None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:17.476145 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589d346-277e-402b-8853-462379e5041e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:17.477139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589d346-277e-402b-8853-462379e5041e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:17.477367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-19805808-fb05-41ad-b3a5-0b30d9ec246a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:17.477513 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589d346-277e-402b-8853-462379e5041e admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:17.477880 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589d346-277e-402b-8853-462379e5041e admin admin] PATH_INFO: `/v3/projects/8f5b0f64604f44768af656ff036abd45` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:17.479216 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589d346-277e-402b-8853-462379e5041e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f5b0f64604f44768af656ff036abd45)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:17.481225 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589d346-277e-402b-8853-462379e5041e admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:17.536273 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a589d346-277e-402b-8853-462379e5041e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f5b0f64604f44768af656ff036abd45', 'request_id': 'req-a589d346-277e-402b-8853-462379e5041e'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:17.541415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19805808-fb05-41ad-b3a5-0b30d9ec246a None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:17.547006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a589d346-277e-402b-8853-462379e5041e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f5b0f64604f44768af656ff036abd45', 'request_id': 'req-a589d346-277e-402b-8853-462379e5041e'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:17.554943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a589d346-277e-402b-8853-462379e5041e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f5b0f64604f44768af656ff036abd45', 'request_id': 'req-a589d346-277e-402b-8853-462379e5041e'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:17.566725 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a589d346-277e-402b-8853-462379e5041e admin admin] The token cache is being invalidate because project 8f5b0f64604f44768af656ff036abd45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:17.567365 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a589d346-277e-402b-8853-462379e5041e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:17.568219 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a589d346-277e-402b-8853-462379e5041e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:17.570533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1011/2004] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:17 2022] DELETE /identity/v3/projects/8f5b0f64604f44768af656ff036abd45 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:47:17.576295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b55b99-5dfa-4ac1-93ab-8f9f52e75d0b None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:17.576598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b55b99-5dfa-4ac1-93ab-8f9f52e75d0b None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:17.576879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b55b99-5dfa-4ac1-93ab-8f9f52e75d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:17.602291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0753fa-a575-43c8-8cc4-5bc7e0b6b011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:17.602863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-92b55b99-5dfa-4ac1-93ab-8f9f52e75d0b None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:17.602984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0753fa-a575-43c8-8cc4-5bc7e0b6b011 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:17.603287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0753fa-a575-43c8-8cc4-5bc7e0b6b011 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:17.603566 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0753fa-a575-43c8-8cc4-5bc7e0b6b011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:17.604285 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-92b55b99-5dfa-4ac1-93ab-8f9f52e75d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:17.605450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-5c0753fa-a575-43c8-8cc4-5bc7e0b6b011 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:17.665526 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1012/2005] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:47:17.669762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0753fa-a575-43c8-8cc4-5bc7e0b6b011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:17.673325 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0753fa-a575-43c8-8cc4-5bc7e0b6b011 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:17.677170 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742df51c-4c2e-418d-8665-da8a0d92da37 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:17.678288 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742df51c-4c2e-418d-8665-da8a0d92da37 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:17.678610 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742df51c-4c2e-418d-8665-da8a0d92da37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:17.683098 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 994/2006] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:17.700016 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-742df51c-4c2e-418d-8665-da8a0d92da37 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:17.700569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-742df51c-4c2e-418d-8665-da8a0d92da37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:17.715323 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1013/2007] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:17.716380 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0753fa-a575-43c8-8cc4-5bc7e0b6b011 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:17.730089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0753fa-a575-43c8-8cc4-5bc7e0b6b011 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:17.735550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5ffa8-09eb-4745-86f8-0d59ccbab3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:17.736230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5ffa8-09eb-4745-86f8-0d59ccbab3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:17.736514 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5ffa8-09eb-4745-86f8-0d59ccbab3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:17.736791 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5ffa8-09eb-4745-86f8-0d59ccbab3c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:17.737523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5ffa8-09eb-4745-86f8-0d59ccbab3c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:47:17.737834 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5ffa8-09eb-4745-86f8-0d59ccbab3c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:17.739634 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5ffa8-09eb-4745-86f8-0d59ccbab3c6 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:17.765325 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 995/2008] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:47:17.766533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742df51c-4c2e-418d-8665-da8a0d92da37 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:17.777559 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742df51c-4c2e-418d-8665-da8a0d92da37 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:17.782801 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97967bf8-a231-497e-a611-3efb15c347f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:17.783516 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97967bf8-a231-497e-a611-3efb15c347f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:17.783924 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97967bf8-a231-497e-a611-3efb15c347f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:17.784203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97967bf8-a231-497e-a611-3efb15c347f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:17.784910 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97967bf8-a231-497e-a611-3efb15c347f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:17.786810 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97967bf8-a231-497e-a611-3efb15c347f9 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:17.817043 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1014/2009] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:17 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:17.821498 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5ffa8-09eb-4745-86f8-0d59ccbab3c6 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:17.832259 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5ffa8-09eb-4745-86f8-0d59ccbab3c6 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:17.901241 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97967bf8-a231-497e-a611-3efb15c347f9 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:17.903411 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-97967bf8-a231-497e-a611-3efb15c347f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:17.909794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec384f-e2ac-470d-b251-ce4ea52466be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:17.910505 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec384f-e2ac-470d-b251-ce4ea52466be admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:17.910792 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec384f-e2ac-470d-b251-ce4ea52466be admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:17.911091 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec384f-e2ac-470d-b251-ce4ea52466be admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:17.911866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec384f-e2ac-470d-b251-ce4ea52466be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:17.914282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec384f-e2ac-470d-b251-ce4ea52466be admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:17.921582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97967bf8-a231-497e-a611-3efb15c347f9 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:17.927349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0ae8b-f344-48e4-b345-f3d95866a7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:17.928485 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ae8b-f344-48e4-b345-f3d95866a7fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:17.928940 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ae8b-f344-48e4-b345-f3d95866a7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:17.929294 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ae8b-f344-48e4-b345-f3d95866a7fb admin admin] PATH_INFO: `/v3/projects/8aca419b095740ceb392cf5456177be9` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:17.930890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0ae8b-f344-48e4-b345-f3d95866a7fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aca419b095740ceb392cf5456177be9)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:17.933075 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0ae8b-f344-48e4-b345-f3d95866a7fb admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:17.943128 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 996/2010] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:17 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:17.946819 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec384f-e2ac-470d-b251-ce4ea52466be admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:17.958374 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec384f-e2ac-470d-b251-ce4ea52466be admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:17.964712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60aa94-516c-4627-be43-fcee3826ff34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:17.966032 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60aa94-516c-4627-be43-fcee3826ff34 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:17.966317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60aa94-516c-4627-be43-fcee3826ff34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:17.966666 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60aa94-516c-4627-be43-fcee3826ff34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:17.967647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60aa94-516c-4627-be43-fcee3826ff34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:17.969768 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60aa94-516c-4627-be43-fcee3826ff34 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:17.988687 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 997/2011] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:47:17.992817 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60aa94-516c-4627-be43-fcee3826ff34 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:18.006512 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-cae0ae8b-f344-48e4-b345-f3d95866a7fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aca419b095740ceb392cf5456177be9', 'request_id': 'req-cae0ae8b-f344-48e4-b345-f3d95866a7fb'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:18.013922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60aa94-516c-4627-be43-fcee3826ff34 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:18.019816 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-cae0ae8b-f344-48e4-b345-f3d95866a7fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aca419b095740ceb392cf5456177be9', 'request_id': 'req-cae0ae8b-f344-48e4-b345-f3d95866a7fb'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:18.027643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-cae0ae8b-f344-48e4-b345-f3d95866a7fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aca419b095740ceb392cf5456177be9', 'request_id': 'req-cae0ae8b-f344-48e4-b345-f3d95866a7fb'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:18.047382 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-cae0ae8b-f344-48e4-b345-f3d95866a7fb admin admin] The token cache is being invalidate because project 8aca419b095740ceb392cf5456177be9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:18.048434 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-cae0ae8b-f344-48e4-b345-f3d95866a7fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:18.049316 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-cae0ae8b-f344-48e4-b345-f3d95866a7fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:18.053479 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1015/2012] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:17 2022] DELETE /identity/v3/projects/8aca419b095740ceb392cf5456177be9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:47:18.055551 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0ae8b-f344-48e4-b345-f3d95866a7fb admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:18.057361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-cae0ae8b-f344-48e4-b345-f3d95866a7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:18.088758 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae7c43-02e1-4d7c-9b32-ca59e50d5ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:18.089545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae7c43-02e1-4d7c-9b32-ca59e50d5ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:18.089911 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae7c43-02e1-4d7c-9b32-ca59e50d5ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:18.090255 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae7c43-02e1-4d7c-9b32-ca59e50d5ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:18.091111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae7c43-02e1-4d7c-9b32-ca59e50d5ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:18.092807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae7c43-02e1-4d7c-9b32-ca59e50d5ea8 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:18.105143 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 998/2013] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:47:18.106572 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941770af-4279-4dd0-9e9c-1696fe178975 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:18.106930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941770af-4279-4dd0-9e9c-1696fe178975 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:18.107315 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941770af-4279-4dd0-9e9c-1696fe178975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:18.127589 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-941770af-4279-4dd0-9e9c-1696fe178975 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:18.128692 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0ae8b-f344-48e4-b345-f3d95866a7fb admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:18.128987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-941770af-4279-4dd0-9e9c-1696fe178975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:18.133584 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c341617-d7fc-4096-8482-ea70eca3ba01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:18.134471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c341617-d7fc-4096-8482-ea70eca3ba01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:18.134772 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c341617-d7fc-4096-8482-ea70eca3ba01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:18.135119 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c341617-d7fc-4096-8482-ea70eca3ba01 admin admin] PATH_INFO: `/v3/projects/8089997f41954f9da7f5acad960a41af` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:18.136315 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c341617-d7fc-4096-8482-ea70eca3ba01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8089997f41954f9da7f5acad960a41af)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:18.137498 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 999/2014] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:18.138654 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941770af-4279-4dd0-9e9c-1696fe178975 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:18.139781 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-941770af-4279-4dd0-9e9c-1696fe178975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:18.144570 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c341617-d7fc-4096-8482-ea70eca3ba01 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:18.152502 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941770af-4279-4dd0-9e9c-1696fe178975 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:18.157804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a254d9-a4b6-4dab-900d-5931698c413d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:18.158700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a254d9-a4b6-4dab-900d-5931698c413d admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:18.158979 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a254d9-a4b6-4dab-900d-5931698c413d admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:18.159349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a254d9-a4b6-4dab-900d-5931698c413d admin admin] PATH_INFO: `/v3/projects/66463edce61342058f7c0774cb8f5e21/users/aed5bd46215c423c91a6f839c653e5a5/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:18.186581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a254d9-a4b6-4dab-900d-5931698c413d admin admin] RBAC: Authorizing `identity:create_grant(project_id=66463edce61342058f7c0774cb8f5e21, user_id=aed5bd46215c423c91a6f839c653e5a5, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:18.191250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a254d9-a4b6-4dab-900d-5931698c413d admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:18.204455 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3c341617-d7fc-4096-8482-ea70eca3ba01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8089997f41954f9da7f5acad960a41af', 'request_id': 'req-3c341617-d7fc-4096-8482-ea70eca3ba01'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:18.226576 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1000/2015] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:18 2022] PUT /identity/v3/projects/66463edce61342058f7c0774cb8f5e21/users/aed5bd46215c423c91a6f839c653e5a5/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:18.228621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70409788-6f77-4702-b715-83908238ac63 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:18.229157 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70409788-6f77-4702-b715-83908238ac63 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:18.229666 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70409788-6f77-4702-b715-83908238ac63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:18.241259 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3c341617-d7fc-4096-8482-ea70eca3ba01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8089997f41954f9da7f5acad960a41af', 'request_id': 'req-3c341617-d7fc-4096-8482-ea70eca3ba01'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:18.250410 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3c341617-d7fc-4096-8482-ea70eca3ba01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8089997f41954f9da7f5acad960a41af', 'request_id': 'req-3c341617-d7fc-4096-8482-ea70eca3ba01'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:18.259482 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-70409788-6f77-4702-b715-83908238ac63 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:18.260789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-70409788-6f77-4702-b715-83908238ac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:18.262437 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3c341617-d7fc-4096-8482-ea70eca3ba01 admin admin] The token cache is being invalidate because project 8089997f41954f9da7f5acad960a41af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:18.262732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3c341617-d7fc-4096-8482-ea70eca3ba01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:18.263411 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3c341617-d7fc-4096-8482-ea70eca3ba01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:18.265193 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1016/2016] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:18 2022] DELETE /identity/v3/projects/8089997f41954f9da7f5acad960a41af => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:18.270258 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bea7c8-0291-4e1d-be43-9b7a2ed7cf55 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:18.270258 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bea7c8-0291-4e1d-be43-9b7a2ed7cf55 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:18.270258 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bea7c8-0291-4e1d-be43-9b7a2ed7cf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:18.300335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-40bea7c8-0291-4e1d-be43-9b7a2ed7cf55 None None] MFA Rules not processed for user `aed5bd46215c423c91a6f839c653e5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:18.302153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-40bea7c8-0291-4e1d-be43-9b7a2ed7cf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:18.340760 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1001/2017] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:18.341436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70409788-6f77-4702-b715-83908238ac63 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:18.345220 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-70409788-6f77-4702-b715-83908238ac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:18.357479 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70409788-6f77-4702-b715-83908238ac63 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:18.362906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733a1c-51ca-4011-b302-741d36ee3700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:18.363840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733a1c-51ca-4011-b302-741d36ee3700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:18.364123 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733a1c-51ca-4011-b302-741d36ee3700 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:18.364406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733a1c-51ca-4011-b302-741d36ee3700 admin admin] PATH_INFO: `/v3/users/903934a4d3524d9f895146ca97de1e84` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:18.365616 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65733a1c-51ca-4011-b302-741d36ee3700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=903934a4d3524d9f895146ca97de1e84)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:18.368487 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65733a1c-51ca-4011-b302-741d36ee3700 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:18.376060 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1017/2018] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:18.377112 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bea7c8-0291-4e1d-be43-9b7a2ed7cf55 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:18.391251 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bea7c8-0291-4e1d-be43-9b7a2ed7cf55 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:18.400088 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f34083-fe28-4fd3-8eb8-8c3e7fa451f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:18.401087 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f34083-fe28-4fd3-8eb8-8c3e7fa451f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:18.401521 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f34083-fe28-4fd3-8eb8-8c3e7fa451f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:18.402553 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f34083-fe28-4fd3-8eb8-8c3e7fa451f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:18.403757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f34083-fe28-4fd3-8eb8-8c3e7fa451f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:47:18.404110 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f34083-fe28-4fd3-8eb8-8c3e7fa451f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:18.406232 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f34083-fe28-4fd3-8eb8-8c3e7fa451f3 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:18.427239 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1018/2019] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:47:18.427239 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f34083-fe28-4fd3-8eb8-8c3e7fa451f3 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:18.428498 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-65733a1c-51ca-4011-b302-741d36ee3700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '903934a4d3524d9f895146ca97de1e84'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:18.432564 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-91f34083-fe28-4fd3-8eb8-8c3e7fa451f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:18.440923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-65733a1c-51ca-4011-b302-741d36ee3700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '903934a4d3524d9f895146ca97de1e84'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:18.448230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-65733a1c-51ca-4011-b302-741d36ee3700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '903934a4d3524d9f895146ca97de1e84'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:18.449262 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-65733a1c-51ca-4011-b302-741d36ee3700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '903934a4d3524d9f895146ca97de1e84'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:18.449886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-65733a1c-51ca-4011-b302-741d36ee3700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '903934a4d3524d9f895146ca97de1e84'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:18.451809 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f34083-fe28-4fd3-8eb8-8c3e7fa451f3 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:18.457525 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662799f7-f326-434c-bf05-459ff86ae9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:18.458195 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662799f7-f326-434c-bf05-459ff86ae9ea admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:18.458479 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662799f7-f326-434c-bf05-459ff86ae9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:18.458772 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662799f7-f326-434c-bf05-459ff86ae9ea admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:18.460172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662799f7-f326-434c-bf05-459ff86ae9ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:18.463257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662799f7-f326-434c-bf05-459ff86ae9ea admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:18.470033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1002/2020] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:18 2022] DELETE /identity/v3/users/903934a4d3524d9f895146ca97de1e84 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:18.470817 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733a1c-51ca-4011-b302-741d36ee3700 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:18.472312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-65733a1c-51ca-4011-b302-741d36ee3700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:18.499763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1019/2021] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:18 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:18.504068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662799f7-f326-434c-bf05-459ff86ae9ea admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:18.507971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-662799f7-f326-434c-bf05-459ff86ae9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:18.563919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733a1c-51ca-4011-b302-741d36ee3700 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:18.616684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662799f7-f326-434c-bf05-459ff86ae9ea admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:18.623478 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83499cd-3bb5-4fe3-b634-57610cc0ed62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:18.624564 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83499cd-3bb5-4fe3-b634-57610cc0ed62 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:18.625114 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83499cd-3bb5-4fe3-b634-57610cc0ed62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:18.626070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83499cd-3bb5-4fe3-b634-57610cc0ed62 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:18.627523 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83499cd-3bb5-4fe3-b634-57610cc0ed62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:18.632625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83499cd-3bb5-4fe3-b634-57610cc0ed62 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:18.660513 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc88307-c0fd-4d43-b4af-bd91438882a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:18.660887 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1020/2022] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:18 2022] POST /identity/v3/users => generated 299 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:18.661227 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc88307-c0fd-4d43-b4af-bd91438882a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:18.661512 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc88307-c0fd-4d43-b4af-bd91438882a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:18.661788 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc88307-c0fd-4d43-b4af-bd91438882a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:18.662511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc88307-c0fd-4d43-b4af-bd91438882a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:18.664578 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc88307-c0fd-4d43-b4af-bd91438882a7 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:18.665069 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83499cd-3bb5-4fe3-b634-57610cc0ed62 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:18.681343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83499cd-3bb5-4fe3-b634-57610cc0ed62 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:18.691670 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b9c09-0d51-49e6-baee-4c7e28514b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:18.692982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b9c09-0d51-49e6-baee-4c7e28514b2e admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:18.693566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b9c09-0d51-49e6-baee-4c7e28514b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:18.694451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b9c09-0d51-49e6-baee-4c7e28514b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:18.695617 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1003/2023] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:18 2022] POST /identity/v3/projects => generated 371 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:18.696021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b9c09-0d51-49e6-baee-4c7e28514b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:18.698021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b9c09-0d51-49e6-baee-4c7e28514b2e admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:18.700703 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc88307-c0fd-4d43-b4af-bd91438882a7 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:18.710605 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1021/2024] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:18.714501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b9c09-0d51-49e6-baee-4c7e28514b2e admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:18.724945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b9c09-0d51-49e6-baee-4c7e28514b2e admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:18.788796 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc88307-c0fd-4d43-b4af-bd91438882a7 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:18.794097 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a08e29-def4-4a1f-8fe9-29f1f14847f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:18.795932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a08e29-def4-4a1f-8fe9-29f1f14847f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:18.796293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a08e29-def4-4a1f-8fe9-29f1f14847f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:18.796643 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a08e29-def4-4a1f-8fe9-29f1f14847f0 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:18.797443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a08e29-def4-4a1f-8fe9-29f1f14847f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:18.799908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a08e29-def4-4a1f-8fe9-29f1f14847f0 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:18.802765 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bf569-7d25-4049-9204-ba918f696350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:18.804436 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf569-7d25-4049-9204-ba918f696350 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:18.804876 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf569-7d25-4049-9204-ba918f696350 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:18.805496 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf569-7d25-4049-9204-ba918f696350 admin admin] PATH_INFO: `/v3/projects/b78dace149b443669e9b3fba893047ac/users/d45c45d3ee3c4350b6f7c7c9efbdfb0d/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:18.833146 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bf569-7d25-4049-9204-ba918f696350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78dace149b443669e9b3fba893047ac, user_id=d45c45d3ee3c4350b6f7c7c9efbdfb0d, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:18.836251 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bf569-7d25-4049-9204-ba918f696350 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:18.836400 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1004/2025] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:18 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:47:18.841129 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a08e29-def4-4a1f-8fe9-29f1f14847f0 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:18.856288 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a08e29-def4-4a1f-8fe9-29f1f14847f0 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:18.865488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1022/2026] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:18 2022] PUT /identity/v3/projects/b78dace149b443669e9b3fba893047ac/users/d45c45d3ee3c4350b6f7c7c9efbdfb0d/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:18.866752 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bf569-7d25-4049-9204-ba918f696350 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:18.922701 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e98eb-eda4-4798-a921-bece3b36f93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:18.923604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e98eb-eda4-4798-a921-bece3b36f93a admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:18.923964 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e98eb-eda4-4798-a921-bece3b36f93a admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:18.924345 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e98eb-eda4-4798-a921-bece3b36f93a admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:18.925182 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e98eb-eda4-4798-a921-bece3b36f93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:18.926909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e98eb-eda4-4798-a921-bece3b36f93a admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:18.937494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1005/2027] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:18.938445 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e98eb-eda4-4798-a921-bece3b36f93a admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:18.941489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-267e98eb-eda4-4798-a921-bece3b36f93a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:18.945539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bf569-7d25-4049-9204-ba918f696350 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:18.951077 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afc143-77da-4aae-9039-53b1a24157b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:18.951466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afc143-77da-4aae-9039-53b1a24157b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:18.951756 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afc143-77da-4aae-9039-53b1a24157b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:18.952030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afc143-77da-4aae-9039-53b1a24157b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:18.952961 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afc143-77da-4aae-9039-53b1a24157b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:18.954615 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afc143-77da-4aae-9039-53b1a24157b2 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:18.955856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e98eb-eda4-4798-a921-bece3b36f93a admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:18.960872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883d4bf-593f-4e19-876a-fdfc4b9a90a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:18.961792 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883d4bf-593f-4e19-876a-fdfc4b9a90a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:18.962078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883d4bf-593f-4e19-876a-fdfc4b9a90a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:18.962406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883d4bf-593f-4e19-876a-fdfc4b9a90a0 admin admin] PATH_INFO: `/v3/projects/ba10241698a349fdb683b06e477fa832` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:18.963625 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883d4bf-593f-4e19-876a-fdfc4b9a90a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba10241698a349fdb683b06e477fa832)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:18.965540 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883d4bf-593f-4e19-876a-fdfc4b9a90a0 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:18.965862 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1023/2028] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:18.966753 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afc143-77da-4aae-9039-53b1a24157b2 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:18.980507 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afc143-77da-4aae-9039-53b1a24157b2 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:18.987702 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d3245-fdf0-471c-a3e4-ab54491cd25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:18.988377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d3245-fdf0-471c-a3e4-ab54491cd25c admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:18.988999 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d3245-fdf0-471c-a3e4-ab54491cd25c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:18.988999 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d3245-fdf0-471c-a3e4-ab54491cd25c admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:18.989632 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d3245-fdf0-471c-a3e4-ab54491cd25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:18.991302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d3245-fdf0-471c-a3e4-ab54491cd25c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:19.005651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1024/2029] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:19.005651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d3245-fdf0-471c-a3e4-ab54491cd25c admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:19.013222 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d3245-fdf0-471c-a3e4-ab54491cd25c admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:19.019720 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5883d4bf-593f-4e19-876a-fdfc4b9a90a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba10241698a349fdb683b06e477fa832', 'request_id': 'req-5883d4bf-593f-4e19-876a-fdfc4b9a90a0'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:19.026853 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5883d4bf-593f-4e19-876a-fdfc4b9a90a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba10241698a349fdb683b06e477fa832', 'request_id': 'req-5883d4bf-593f-4e19-876a-fdfc4b9a90a0'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:19.035924 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5883d4bf-593f-4e19-876a-fdfc4b9a90a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba10241698a349fdb683b06e477fa832', 'request_id': 'req-5883d4bf-593f-4e19-876a-fdfc4b9a90a0'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:19.052113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5883d4bf-593f-4e19-876a-fdfc4b9a90a0 admin admin] The token cache is being invalidate because project ba10241698a349fdb683b06e477fa832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:19.052514 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5883d4bf-593f-4e19-876a-fdfc4b9a90a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:19.053185 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5883d4bf-593f-4e19-876a-fdfc4b9a90a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:19.057929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1006/2030] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:18 2022] DELETE /identity/v3/projects/ba10241698a349fdb683b06e477fa832 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:19.057929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883d4bf-593f-4e19-876a-fdfc4b9a90a0 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:19.057929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-5883d4bf-593f-4e19-876a-fdfc4b9a90a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:19.078650 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3b03a-4c65-418a-b77a-865968c70a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:19.079561 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3b03a-4c65-418a-b77a-865968c70a62 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:19.079843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3b03a-4c65-418a-b77a-865968c70a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:19.080165 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3b03a-4c65-418a-b77a-865968c70a62 admin admin] PATH_INFO: `/v3/projects/b78dace149b443669e9b3fba893047ac/users/d45c45d3ee3c4350b6f7c7c9efbdfb0d/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:19.082283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3b03a-4c65-418a-b77a-865968c70a62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78dace149b443669e9b3fba893047ac, user_id=d45c45d3ee3c4350b6f7c7c9efbdfb0d, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:19.085079 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3b03a-4c65-418a-b77a-865968c70a62 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:19.097100 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1025/2031] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:19 2022] PUT /identity/v3/projects/b78dace149b443669e9b3fba893047ac/users/d45c45d3ee3c4350b6f7c7c9efbdfb0d/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:19.098345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3b03a-4c65-418a-b77a-865968c70a62 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:19.100679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-88d3b03a-4c65-418a-b77a-865968c70a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:19.126751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883d4bf-593f-4e19-876a-fdfc4b9a90a0 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:19.169289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3b03a-4c65-418a-b77a-865968c70a62 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:19.174453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde840d0-3d85-46dc-a174-300c6c857812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:19.175451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde840d0-3d85-46dc-a174-300c6c857812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:19.175849 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde840d0-3d85-46dc-a174-300c6c857812 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:19.176188 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde840d0-3d85-46dc-a174-300c6c857812 admin admin] PATH_INFO: `/v3/users/6d0964cc25354679b06cd47c6ba73fd6` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:19.177535 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde840d0-3d85-46dc-a174-300c6c857812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d0964cc25354679b06cd47c6ba73fd6)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:19.179874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde840d0-3d85-46dc-a174-300c6c857812 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:19.192944 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369eca1-c947-4997-abe6-18d3cfe1d1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:19.193954 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369eca1-c947-4997-abe6-18d3cfe1d1cc admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:19.194344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369eca1-c947-4997-abe6-18d3cfe1d1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:19.194697 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369eca1-c947-4997-abe6-18d3cfe1d1cc admin admin] PATH_INFO: `/v3/projects/09a9485c5c7a4652b30cf5b9f0e47286/users/75668e57663e4779b9d630b04fe94e0a/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:19.211197 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369eca1-c947-4997-abe6-18d3cfe1d1cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=09a9485c5c7a4652b30cf5b9f0e47286, user_id=75668e57663e4779b9d630b04fe94e0a, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:19.214553 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369eca1-c947-4997-abe6-18d3cfe1d1cc admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:19.246319 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1007/2032] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:19 2022] PUT /identity/v3/projects/09a9485c5c7a4652b30cf5b9f0e47286/users/75668e57663e4779b9d630b04fe94e0a/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:19.248484 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6532bd-6aac-496a-893d-646588c1bb39 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:19.248841 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6532bd-6aac-496a-893d-646588c1bb39 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:19.249183 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6532bd-6aac-496a-893d-646588c1bb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:19.261996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-bde840d0-3d85-46dc-a174-300c6c857812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d0964cc25354679b06cd47c6ba73fd6'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:19.268961 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-bde840d0-3d85-46dc-a174-300c6c857812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d0964cc25354679b06cd47c6ba73fd6'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:19.269860 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-bde840d0-3d85-46dc-a174-300c6c857812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d0964cc25354679b06cd47c6ba73fd6'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:19.282650 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-bde840d0-3d85-46dc-a174-300c6c857812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d0964cc25354679b06cd47c6ba73fd6'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:19.284158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-0c6532bd-6aac-496a-893d-646588c1bb39 None None] MFA Rules not processed for user `d45c45d3ee3c4350b6f7c7c9efbdfb0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:19.285757 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-0c6532bd-6aac-496a-893d-646588c1bb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:19.296612 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-bde840d0-3d85-46dc-a174-300c6c857812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d0964cc25354679b06cd47c6ba73fd6'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:19.305520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1026/2033] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:19 2022] DELETE /identity/v3/users/6d0964cc25354679b06cd47c6ba73fd6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:19.307023 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09596b-3522-4db1-9f19-642fa647fb7a None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:19.310313 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09596b-3522-4db1-9f19-642fa647fb7a None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:19.310774 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09596b-3522-4db1-9f19-642fa647fb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:19.346285 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-1f09596b-3522-4db1-9f19-642fa647fb7a None None] MFA Rules not processed for user `75668e57663e4779b9d630b04fe94e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:19.347649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-1f09596b-3522-4db1-9f19-642fa647fb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:19.389656 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1008/2034] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:19.402961 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6532bd-6aac-496a-893d-646588c1bb39 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:19.404848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-0c6532bd-6aac-496a-893d-646588c1bb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:19.443461 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1027/2035] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:19.456194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09596b-3522-4db1-9f19-642fa647fb7a None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:19.457590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-1f09596b-3522-4db1-9f19-642fa647fb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:19.487593 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6532bd-6aac-496a-893d-646588c1bb39 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:19.542926 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09596b-3522-4db1-9f19-642fa647fb7a None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:19.549266 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa07d6-aa5f-4621-bf1d-f45bff4bb16e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:19.550434 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa07d6-aa5f-4621-bf1d-f45bff4bb16e service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:19.550864 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa07d6-aa5f-4621-bf1d-f45bff4bb16e service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:19.551316 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa07d6-aa5f-4621-bf1d-f45bff4bb16e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:19.559760 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5c8b2-fbe1-4519-8c91-fe630d2c7f9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:19.560938 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5c8b2-fbe1-4519-8c91-fe630d2c7f9c service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:19.561376 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5c8b2-fbe1-4519-8c91-fe630d2c7f9c service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:19.562129 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5c8b2-fbe1-4519-8c91-fe630d2c7f9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:19.563601 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-27a5c8b2-fbe1-4519-8c91-fe630d2c7f9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:19.564262 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa07d6-aa5f-4621-bf1d-f45bff4bb16e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:19.565718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa07d6-aa5f-4621-bf1d-f45bff4bb16e service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:19.581735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1028/2036] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:47:19.617083 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa07d6-aa5f-4621-bf1d-f45bff4bb16e service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:19.620762 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-3eaa07d6-aa5f-4621-bf1d-f45bff4bb16e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:19.636610 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5c8b2-fbe1-4519-8c91-fe630d2c7f9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:19.638077 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5c8b2-fbe1-4519-8c91-fe630d2c7f9c service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:19.648520 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1009/2037] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:19.682586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5c8b2-fbe1-4519-8c91-fe630d2c7f9c service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:19.684284 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-27a5c8b2-fbe1-4519-8c91-fe630d2c7f9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:19.721536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa07d6-aa5f-4621-bf1d-f45bff4bb16e service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:19.727105 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c5c7e-c149-41ec-9a85-df324c177165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:19.728183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5c7e-c149-41ec-9a85-df324c177165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:19.728538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5c7e-c149-41ec-9a85-df324c177165 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:19.728886 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5c7e-c149-41ec-9a85-df324c177165 admin admin] PATH_INFO: `/v3/users/75668e57663e4779b9d630b04fe94e0a` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:19.730321 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c5c7e-c149-41ec-9a85-df324c177165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75668e57663e4779b9d630b04fe94e0a)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:19.740692 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c5c7e-c149-41ec-9a85-df324c177165 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:19.767292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5c8b2-fbe1-4519-8c91-fe630d2c7f9c service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:19.774813 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15f3a0-acf1-45b3-8898-e701b54344da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:19.775894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15f3a0-acf1-45b3-8898-e701b54344da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:19.776227 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15f3a0-acf1-45b3-8898-e701b54344da admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:19.776568 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15f3a0-acf1-45b3-8898-e701b54344da admin admin] PATH_INFO: `/v3/projects/5c53393887bc4499954af8f61be1c4f9` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:19.777979 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15f3a0-acf1-45b3-8898-e701b54344da admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c53393887bc4499954af8f61be1c4f9)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:19.780251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15f3a0-acf1-45b3-8898-e701b54344da admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:19.804799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d72c5c7e-c149-41ec-9a85-df324c177165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75668e57663e4779b9d630b04fe94e0a'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:19.814173 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d72c5c7e-c149-41ec-9a85-df324c177165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75668e57663e4779b9d630b04fe94e0a'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:19.815070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d72c5c7e-c149-41ec-9a85-df324c177165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75668e57663e4779b9d630b04fe94e0a'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:19.839084 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d72c5c7e-c149-41ec-9a85-df324c177165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75668e57663e4779b9d630b04fe94e0a'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:19.839952 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1c15f3a0-acf1-45b3-8898-e701b54344da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c53393887bc4499954af8f61be1c4f9', 'request_id': 'req-1c15f3a0-acf1-45b3-8898-e701b54344da'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:19.847545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1c15f3a0-acf1-45b3-8898-e701b54344da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c53393887bc4499954af8f61be1c4f9', 'request_id': 'req-1c15f3a0-acf1-45b3-8898-e701b54344da'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:19.849418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d72c5c7e-c149-41ec-9a85-df324c177165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75668e57663e4779b9d630b04fe94e0a'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:19.856592 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1029/2038] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:19 2022] DELETE /identity/v3/users/75668e57663e4779b9d630b04fe94e0a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:19.857275 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1c15f3a0-acf1-45b3-8898-e701b54344da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c53393887bc4499954af8f61be1c4f9', 'request_id': 'req-1c15f3a0-acf1-45b3-8898-e701b54344da'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:19.862341 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7319f7-bc11-4537-aceb-fa9952065874 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:19.863292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7319f7-bc11-4537-aceb-fa9952065874 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:19.863292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7319f7-bc11-4537-aceb-fa9952065874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:19.872177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1c15f3a0-acf1-45b3-8898-e701b54344da admin admin] The token cache is being invalidate because project 5c53393887bc4499954af8f61be1c4f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:19.872177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1c15f3a0-acf1-45b3-8898-e701b54344da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:19.872490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1c15f3a0-acf1-45b3-8898-e701b54344da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:19.877808 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1010/2039] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:19 2022] DELETE /identity/v3/projects/5c53393887bc4499954af8f61be1c4f9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:19.879273 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be84f4-ffd9-43c1-93ad-64ca21576015 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:19.879562 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be84f4-ffd9-43c1-93ad-64ca21576015 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:19.879837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be84f4-ffd9-43c1-93ad-64ca21576015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:19.888511 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-ec7319f7-bc11-4537-aceb-fa9952065874 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:19.890210 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ec7319f7-bc11-4537-aceb-fa9952065874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:19.899992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-98be84f4-ffd9-43c1-93ad-64ca21576015 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:19.901511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-98be84f4-ffd9-43c1-93ad-64ca21576015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:19.962804 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1030/2040] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:19.969979 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1011/2041] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:19.975145 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7319f7-bc11-4537-aceb-fa9952065874 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:19.977522 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ec7319f7-bc11-4537-aceb-fa9952065874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:19.978732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9519b-e424-444f-8f3b-e1264f287ca3 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:19.979031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9519b-e424-444f-8f3b-e1264f287ca3 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:19.979330 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9519b-e424-444f-8f3b-e1264f287ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:20.000314 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-eea9519b-e424-444f-8f3b-e1264f287ca3 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:20.001613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-eea9519b-e424-444f-8f3b-e1264f287ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:20.013914 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1012/2042] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:20.014808 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9519b-e424-444f-8f3b-e1264f287ca3 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:20.029705 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9519b-e424-444f-8f3b-e1264f287ca3 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:20.035662 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400f3f7-27dd-4110-90db-bf030169b2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:20.036293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400f3f7-27dd-4110-90db-bf030169b2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:20.036605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400f3f7-27dd-4110-90db-bf030169b2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:20.036887 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400f3f7-27dd-4110-90db-bf030169b2d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:20.037616 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400f3f7-27dd-4110-90db-bf030169b2d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:47:20.038287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400f3f7-27dd-4110-90db-bf030169b2d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:20.039962 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400f3f7-27dd-4110-90db-bf030169b2d8 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:20.044883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7319f7-bc11-4537-aceb-fa9952065874 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:20.050370 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57ce52-cd18-4634-9015-69229ef03c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:20.051549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57ce52-cd18-4634-9015-69229ef03c12 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:20.051843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57ce52-cd18-4634-9015-69229ef03c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:20.052122 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57ce52-cd18-4634-9015-69229ef03c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:20.053029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1013/2043] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:47:20.057498 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400f3f7-27dd-4110-90db-bf030169b2d8 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:20.063034 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57ce52-cd18-4634-9015-69229ef03c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:20.064648 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57ce52-cd18-4634-9015-69229ef03c12 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:20.072937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400f3f7-27dd-4110-90db-bf030169b2d8 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:20.076705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1031/2044] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:20.086956 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39815d5-77bb-4eb6-b348-aa5094b330b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:20.087915 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39815d5-77bb-4eb6-b348-aa5094b330b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:20.088109 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39815d5-77bb-4eb6-b348-aa5094b330b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:20.088602 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39815d5-77bb-4eb6-b348-aa5094b330b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:20.089516 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39815d5-77bb-4eb6-b348-aa5094b330b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:20.092828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39815d5-77bb-4eb6-b348-aa5094b330b5 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:20.127295 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1014/2045] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:20 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:20.131350 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57ce52-cd18-4634-9015-69229ef03c12 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:20.150971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57ce52-cd18-4634-9015-69229ef03c12 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:20.221021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53f9b3-5e94-4e1f-8633-a2f56bf705ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:20.221705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53f9b3-5e94-4e1f-8633-a2f56bf705ce admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:20.221994 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53f9b3-5e94-4e1f-8633-a2f56bf705ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:20.222268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53f9b3-5e94-4e1f-8633-a2f56bf705ce admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:20.222984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53f9b3-5e94-4e1f-8633-a2f56bf705ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:20.224949 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53f9b3-5e94-4e1f-8633-a2f56bf705ce admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:20.247201 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1032/2046] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:20 2022] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:20.251009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39815d5-77bb-4eb6-b348-aa5094b330b5 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:20.262244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39815d5-77bb-4eb6-b348-aa5094b330b5 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:20.267192 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee3987-2db6-45e0-b758-f4090f633f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:20.267950 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee3987-2db6-45e0-b758-f4090f633f96 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:20.268298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee3987-2db6-45e0-b758-f4090f633f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:20.268637 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee3987-2db6-45e0-b758-f4090f633f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:20.269433 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee3987-2db6-45e0-b758-f4090f633f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:20.271183 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee3987-2db6-45e0-b758-f4090f633f96 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:20.281901 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1015/2047] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:20.286059 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53f9b3-5e94-4e1f-8633-a2f56bf705ce admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:20.296004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53f9b3-5e94-4e1f-8633-a2f56bf705ce admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:20.301492 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349eac13-330b-4edb-92d1-e466b8d2d606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:20.302281 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eac13-330b-4edb-92d1-e466b8d2d606 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:20.302548 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eac13-330b-4edb-92d1-e466b8d2d606 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:20.302864 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eac13-330b-4edb-92d1-e466b8d2d606 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:20.303760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349eac13-330b-4edb-92d1-e466b8d2d606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:20.305360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349eac13-330b-4edb-92d1-e466b8d2d606 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:20.315810 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1033/2048] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:20.320304 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee3987-2db6-45e0-b758-f4090f633f96 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:20.330863 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee3987-2db6-45e0-b758-f4090f633f96 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:20.335822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37422007-9152-4a6c-856b-812ee7d6ece3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:20.336711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37422007-9152-4a6c-856b-812ee7d6ece3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:20.336985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37422007-9152-4a6c-856b-812ee7d6ece3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:20.337253 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37422007-9152-4a6c-856b-812ee7d6ece3 admin admin] PATH_INFO: `/v3/projects/c602a3571f6d4d48ad6de57d1f302bb1/users/a850681b05804936bfe9f3988b34241c/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:20.353196 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37422007-9152-4a6c-856b-812ee7d6ece3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c602a3571f6d4d48ad6de57d1f302bb1, user_id=a850681b05804936bfe9f3988b34241c, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:20.356012 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37422007-9152-4a6c-856b-812ee7d6ece3 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:20.373440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1016/2049] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:20 2022] PUT /identity/v3/projects/c602a3571f6d4d48ad6de57d1f302bb1/users/a850681b05804936bfe9f3988b34241c/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:20.380315 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349eac13-330b-4edb-92d1-e466b8d2d606 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:20.382402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-349eac13-330b-4edb-92d1-e466b8d2d606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:20.385363 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8ca1e-6700-41af-aafe-434bb4f2bf27 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:20.385927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8ca1e-6700-41af-aafe-434bb4f2bf27 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:20.386614 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8ca1e-6700-41af-aafe-434bb4f2bf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:20.396872 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349eac13-330b-4edb-92d1-e466b8d2d606 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:20.424230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-26d8ca1e-6700-41af-aafe-434bb4f2bf27 None None] MFA Rules not processed for user `a850681b05804936bfe9f3988b34241c`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:20.425593 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-26d8ca1e-6700-41af-aafe-434bb4f2bf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:20.459309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30439faf-1c2d-4c58-9861-2897476cbb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:20.460225 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30439faf-1c2d-4c58-9861-2897476cbb4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:20.460484 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30439faf-1c2d-4c58-9861-2897476cbb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:20.460759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30439faf-1c2d-4c58-9861-2897476cbb4e admin admin] PATH_INFO: `/v3/projects/09a9485c5c7a4652b30cf5b9f0e47286` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:20.461987 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30439faf-1c2d-4c58-9861-2897476cbb4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=09a9485c5c7a4652b30cf5b9f0e47286)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:20.463953 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30439faf-1c2d-4c58-9861-2897476cbb4e admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:20.489366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1017/2050] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:20.501669 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8ca1e-6700-41af-aafe-434bb4f2bf27 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:20.503073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-26d8ca1e-6700-41af-aafe-434bb4f2bf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:20.512915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-30439faf-1c2d-4c58-9861-2897476cbb4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09a9485c5c7a4652b30cf5b9f0e47286', 'request_id': 'req-30439faf-1c2d-4c58-9861-2897476cbb4e'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:20.521604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-30439faf-1c2d-4c58-9861-2897476cbb4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09a9485c5c7a4652b30cf5b9f0e47286', 'request_id': 'req-30439faf-1c2d-4c58-9861-2897476cbb4e'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:20.528499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-30439faf-1c2d-4c58-9861-2897476cbb4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09a9485c5c7a4652b30cf5b9f0e47286', 'request_id': 'req-30439faf-1c2d-4c58-9861-2897476cbb4e'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:20.539302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-30439faf-1c2d-4c58-9861-2897476cbb4e admin admin] The token cache is being invalidate because project 09a9485c5c7a4652b30cf5b9f0e47286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:20.539589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-30439faf-1c2d-4c58-9861-2897476cbb4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:20.540310 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-30439faf-1c2d-4c58-9861-2897476cbb4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:20.541955 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1034/2051] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:20 2022] DELETE /identity/v3/projects/09a9485c5c7a4652b30cf5b9f0e47286 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:20.547761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e49b2-712b-4c21-8313-738ad10a76b8 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:20.548049 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e49b2-712b-4c21-8313-738ad10a76b8 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:20.548329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e49b2-712b-4c21-8313-738ad10a76b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:20.560378 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8ca1e-6700-41af-aafe-434bb4f2bf27 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:20.565466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-cc8e49b2-712b-4c21-8313-738ad10a76b8 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:20.566710 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-cc8e49b2-712b-4c21-8313-738ad10a76b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:20.609626 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9ff6e-5f8e-42a3-b8a0-93dc4d21c0a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c61205d7e96f496ab9f8ca84ab9408b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:20.610282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9ff6e-5f8e-42a3-b8a0-93dc4d21c0a8 service glance] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:20.610562 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9ff6e-5f8e-42a3-b8a0-93dc4d21c0a8 service glance] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:20.610832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9ff6e-5f8e-42a3-b8a0-93dc4d21c0a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:20.612745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-61b9ff6e-5f8e-42a3-b8a0-93dc4d21c0a8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:20.626381 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1035/2052] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:47:20.634330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7e4f8-4153-448d-a943-ea300572b0db None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:20.634623 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7e4f8-4153-448d-a943-ea300572b0db None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:20.634905 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7e4f8-4153-448d-a943-ea300572b0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:20.652388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-d8f7e4f8-4153-448d-a943-ea300572b0db None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:20.653589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-d8f7e4f8-4153-448d-a943-ea300572b0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:20.662230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1036/2053] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:20.666492 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7e4f8-4153-448d-a943-ea300572b0db None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:20.669909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9ff6e-5f8e-42a3-b8a0-93dc4d21c0a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:20.671384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9ff6e-5f8e-42a3-b8a0-93dc4d21c0a8 service glance] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:20.675510 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7e4f8-4153-448d-a943-ea300572b0db None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:20.680447 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a0664-5aab-4beb-a027-f06d365e2dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:20.680841 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1018/2054] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:20 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:47:20.681162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a0664-5aab-4beb-a027-f06d365e2dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:20.681446 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a0664-5aab-4beb-a027-f06d365e2dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:20.681722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a0664-5aab-4beb-a027-f06d365e2dc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:20.682514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a0664-5aab-4beb-a027-f06d365e2dc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:47:20.682831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a0664-5aab-4beb-a027-f06d365e2dc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:20.684503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a0664-5aab-4beb-a027-f06d365e2dc1 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:20.696653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1037/2055] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:47:20.701060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9ff6e-5f8e-42a3-b8a0-93dc4d21c0a8 service glance] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:20.711977 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9ff6e-5f8e-42a3-b8a0-93dc4d21c0a8 service glance] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:20.717443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a86c8-a729-4220-907e-8384c9b7be4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:20.718092 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a86c8-a729-4220-907e-8384c9b7be4b admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:20.718382 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a86c8-a729-4220-907e-8384c9b7be4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:20.718972 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a86c8-a729-4220-907e-8384c9b7be4b admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:20.719751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a86c8-a729-4220-907e-8384c9b7be4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:20.721698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a86c8-a729-4220-907e-8384c9b7be4b admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:20.755530 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1019/2056] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:20 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:20.756749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a0664-5aab-4beb-a027-f06d365e2dc1 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:20.769531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a0664-5aab-4beb-a027-f06d365e2dc1 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:20.833838 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9f12c-5e5e-4435-b321-eb4f5678318b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:20.834512 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9f12c-5e5e-4435-b321-eb4f5678318b admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:20.834963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9f12c-5e5e-4435-b321-eb4f5678318b admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:20.835212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9f12c-5e5e-4435-b321-eb4f5678318b admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:20.835915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9f12c-5e5e-4435-b321-eb4f5678318b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:20.837941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9f12c-5e5e-4435-b321-eb4f5678318b admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:20.859317 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1038/2057] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:20 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:47:20.863640 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a86c8-a729-4220-907e-8384c9b7be4b admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:20.876574 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a86c8-a729-4220-907e-8384c9b7be4b admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:20.882568 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acebaf-f7bf-473f-b2a4-7107e5907631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:20.883592 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acebaf-f7bf-473f-b2a4-7107e5907631 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:20.883797 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acebaf-f7bf-473f-b2a4-7107e5907631 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:20.884185 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acebaf-f7bf-473f-b2a4-7107e5907631 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:20.885042 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acebaf-f7bf-473f-b2a4-7107e5907631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:20.886714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acebaf-f7bf-473f-b2a4-7107e5907631 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:20.899352 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1020/2058] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:20.902882 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9f12c-5e5e-4435-b321-eb4f5678318b admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:20.916767 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9f12c-5e5e-4435-b321-eb4f5678318b admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:20.922675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fb7c4-2c51-4e7b-b93a-5a169f4a9d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:20.923436 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fb7c4-2c51-4e7b-b93a-5a169f4a9d81 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:20.923720 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fb7c4-2c51-4e7b-b93a-5a169f4a9d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:20.923996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fb7c4-2c51-4e7b-b93a-5a169f4a9d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:20.924739 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fb7c4-2c51-4e7b-b93a-5a169f4a9d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:20.926374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fb7c4-2c51-4e7b-b93a-5a169f4a9d81 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:20.944600 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1039/2059] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:20.945635 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acebaf-f7bf-473f-b2a4-7107e5907631 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:20.957698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acebaf-f7bf-473f-b2a4-7107e5907631 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:20.963814 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470df34-5b7e-49de-8567-69e92800aed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:20.964899 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470df34-5b7e-49de-8567-69e92800aed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:20.965660 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470df34-5b7e-49de-8567-69e92800aed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:20.965771 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470df34-5b7e-49de-8567-69e92800aed7 admin admin] PATH_INFO: `/v3/projects/4fc90c4b11dc453d8ea66d758a8eee93/users/465837857c38418d9b58500ff6bf637c/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:20.984915 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470df34-5b7e-49de-8567-69e92800aed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc90c4b11dc453d8ea66d758a8eee93, user_id=465837857c38418d9b58500ff6bf637c, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:20.987707 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470df34-5b7e-49de-8567-69e92800aed7 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:21.011084 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1021/2060] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:20 2022] PUT /identity/v3/projects/4fc90c4b11dc453d8ea66d758a8eee93/users/465837857c38418d9b58500ff6bf637c/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:47:21.013108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5340ed-17ee-4235-8f4c-e416df9d0f11 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:21.013476 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5340ed-17ee-4235-8f4c-e416df9d0f11 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:21.013823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5340ed-17ee-4235-8f4c-e416df9d0f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:21.045425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-ca5340ed-17ee-4235-8f4c-e416df9d0f11 None None] MFA Rules not processed for user `465837857c38418d9b58500ff6bf637c`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:21.046622 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ca5340ed-17ee-4235-8f4c-e416df9d0f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:21.115736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1040/2061] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:47:21.127954 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470df34-5b7e-49de-8567-69e92800aed7 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:21.130524 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e470df34-5b7e-49de-8567-69e92800aed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:21.227794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470df34-5b7e-49de-8567-69e92800aed7 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:21.233231 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84caf1d1-59ec-4d83-a01d-0fb83679d133 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c61205d7e96f496ab9f8ca84ab9408b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:21.233892 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84caf1d1-59ec-4d83-a01d-0fb83679d133 service glance] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:21.234178 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84caf1d1-59ec-4d83-a01d-0fb83679d133 service glance] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:21.234458 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84caf1d1-59ec-4d83-a01d-0fb83679d133 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:21.244177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84caf1d1-59ec-4d83-a01d-0fb83679d133 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:21.246008 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84caf1d1-59ec-4d83-a01d-0fb83679d133 service glance] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:21.257279 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1022/2062] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:24.043900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5340ed-17ee-4235-8f4c-e416df9d0f11 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:24.045609 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ca5340ed-17ee-4235-8f4c-e416df9d0f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:24.103621 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5340ed-17ee-4235-8f4c-e416df9d0f11 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:24.107727 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3f89a-6e7d-44af-8580-719b09ad4b32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:24.108373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3f89a-6e7d-44af-8580-719b09ad4b32 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:24.108658 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3f89a-6e7d-44af-8580-719b09ad4b32 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:24.108934 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3f89a-6e7d-44af-8580-719b09ad4b32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:24.110863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-3df3f89a-6e7d-44af-8580-719b09ad4b32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:24.183617 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3f89a-6e7d-44af-8580-719b09ad4b32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:24.185052 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3f89a-6e7d-44af-8580-719b09ad4b32 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:24.194426 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1041/2063] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:24.423202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84caf1d1-59ec-4d83-a01d-0fb83679d133 service glance] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:24.424935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-84caf1d1-59ec-4d83-a01d-0fb83679d133 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:24.504107 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84caf1d1-59ec-4d83-a01d-0fb83679d133 service glance] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:24.510618 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776fe3c-d6c9-40b0-8caa-3f1f4fd1ba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:24.511762 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776fe3c-d6c9-40b0-8caa-3f1f4fd1ba11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:24.512070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776fe3c-d6c9-40b0-8caa-3f1f4fd1ba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:24.512522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776fe3c-d6c9-40b0-8caa-3f1f4fd1ba11 admin admin] PATH_INFO: `/v3/users/12fd15b985614e8287fb8ab0a111a237` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:24.516032 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776fe3c-d6c9-40b0-8caa-3f1f4fd1ba11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12fd15b985614e8287fb8ab0a111a237)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:24.518420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776fe3c-d6c9-40b0-8caa-3f1f4fd1ba11 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:24.575469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0776fe3c-d6c9-40b0-8caa-3f1f4fd1ba11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12fd15b985614e8287fb8ab0a111a237'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:24.590351 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0776fe3c-d6c9-40b0-8caa-3f1f4fd1ba11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12fd15b985614e8287fb8ab0a111a237'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:24.598001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0776fe3c-d6c9-40b0-8caa-3f1f4fd1ba11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12fd15b985614e8287fb8ab0a111a237'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:24.599375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0776fe3c-d6c9-40b0-8caa-3f1f4fd1ba11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12fd15b985614e8287fb8ab0a111a237'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:24.600132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0776fe3c-d6c9-40b0-8caa-3f1f4fd1ba11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12fd15b985614e8287fb8ab0a111a237'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:24.622568 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1023/2064] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:24 2022] DELETE /identity/v3/users/12fd15b985614e8287fb8ab0a111a237 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:24.628376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b5193-3f12-4d19-80fc-3a8ab22c5561 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:24.628666 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b5193-3f12-4d19-80fc-3a8ab22c5561 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:24.628948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b5193-3f12-4d19-80fc-3a8ab22c5561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:24.645966 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-1c7b5193-3f12-4d19-80fc-3a8ab22c5561 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:24.647568 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-1c7b5193-3f12-4d19-80fc-3a8ab22c5561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:24.705854 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1042/2065] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:24.715565 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776fe3c-d6c9-40b0-8caa-3f1f4fd1ba11 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:24.716989 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-0776fe3c-d6c9-40b0-8caa-3f1f4fd1ba11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:24.772758 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776fe3c-d6c9-40b0-8caa-3f1f4fd1ba11 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:24.776880 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659b2ce-9c1e-4508-9ce6-85832b75da1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:24.777537 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659b2ce-9c1e-4508-9ce6-85832b75da1f service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:24.777819 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659b2ce-9c1e-4508-9ce6-85832b75da1f service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:24.778091 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659b2ce-9c1e-4508-9ce6-85832b75da1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:24.787655 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659b2ce-9c1e-4508-9ce6-85832b75da1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:24.789386 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659b2ce-9c1e-4508-9ce6-85832b75da1f service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:24.798764 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1024/2066] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:47:25.083907 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b5193-3f12-4d19-80fc-3a8ab22c5561 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:25.085501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-1c7b5193-3f12-4d19-80fc-3a8ab22c5561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:25.099264 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b5193-3f12-4d19-80fc-3a8ab22c5561 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:25.108136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738029a-19ed-4453-9c67-a3c2b9dd531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:25.109033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738029a-19ed-4453-9c67-a3c2b9dd531c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:25.109334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738029a-19ed-4453-9c67-a3c2b9dd531c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:25.109605 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738029a-19ed-4453-9c67-a3c2b9dd531c admin admin] PATH_INFO: `/v3/projects/bc3818f1b6e949afaaf3228e0d442318` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:25.111317 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738029a-19ed-4453-9c67-a3c2b9dd531c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc3818f1b6e949afaaf3228e0d442318)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:25.113365 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738029a-19ed-4453-9c67-a3c2b9dd531c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:25.161768 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d738029a-19ed-4453-9c67-a3c2b9dd531c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc3818f1b6e949afaaf3228e0d442318', 'request_id': 'req-d738029a-19ed-4453-9c67-a3c2b9dd531c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:25.172660 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d738029a-19ed-4453-9c67-a3c2b9dd531c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc3818f1b6e949afaaf3228e0d442318', 'request_id': 'req-d738029a-19ed-4453-9c67-a3c2b9dd531c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:25.180488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d738029a-19ed-4453-9c67-a3c2b9dd531c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc3818f1b6e949afaaf3228e0d442318', 'request_id': 'req-d738029a-19ed-4453-9c67-a3c2b9dd531c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:25.191494 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d738029a-19ed-4453-9c67-a3c2b9dd531c admin admin] The token cache is being invalidate because project bc3818f1b6e949afaaf3228e0d442318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:25.191779 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d738029a-19ed-4453-9c67-a3c2b9dd531c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:25.192501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d738029a-19ed-4453-9c67-a3c2b9dd531c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:25.194179 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1043/2067] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:25 2022] DELETE /identity/v3/projects/bc3818f1b6e949afaaf3228e0d442318 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:25.199284 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8881ff-6f58-4be5-81cb-4002d0f52ca3 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:25.199666 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8881ff-6f58-4be5-81cb-4002d0f52ca3 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:25.199985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8881ff-6f58-4be5-81cb-4002d0f52ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:25.218256 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-5a8881ff-6f58-4be5-81cb-4002d0f52ca3 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:25.219921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-5a8881ff-6f58-4be5-81cb-4002d0f52ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:25.286370 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1025/2068] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:47:25.294258 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d3475-3506-4c9e-86f3-9a2ca9f05c05 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:25.294547 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d3475-3506-4c9e-86f3-9a2ca9f05c05 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:25.294819 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d3475-3506-4c9e-86f3-9a2ca9f05c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:25.313299 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-120d3475-3506-4c9e-86f3-9a2ca9f05c05 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:25.314509 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-120d3475-3506-4c9e-86f3-9a2ca9f05c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:25.323751 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1044/2069] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:25.328094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8881ff-6f58-4be5-81cb-4002d0f52ca3 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:25.337856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8881ff-6f58-4be5-81cb-4002d0f52ca3 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:25.344423 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2362b04-5a8e-411a-be0e-075ef9079181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:25.345140 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2362b04-5a8e-411a-be0e-075ef9079181 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:25.345505 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2362b04-5a8e-411a-be0e-075ef9079181 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:25.345810 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2362b04-5a8e-411a-be0e-075ef9079181 admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:25.346723 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2362b04-5a8e-411a-be0e-075ef9079181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:47:25.347064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2362b04-5a8e-411a-be0e-075ef9079181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:25.348729 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2362b04-5a8e-411a-be0e-075ef9079181 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:25.361062 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1026/2070] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:47:25.365599 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d3475-3506-4c9e-86f3-9a2ca9f05c05 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:25.374851 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d3475-3506-4c9e-86f3-9a2ca9f05c05 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:25.379968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2029aa0-e4ad-4e2b-b18a-0391aedf47a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:25.380755 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2029aa0-e4ad-4e2b-b18a-0391aedf47a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:25.381054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2029aa0-e4ad-4e2b-b18a-0391aedf47a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:25.381444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2029aa0-e4ad-4e2b-b18a-0391aedf47a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:25.382111 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2029aa0-e4ad-4e2b-b18a-0391aedf47a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:25.384135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2029aa0-e4ad-4e2b-b18a-0391aedf47a4 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:25.419496 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1045/2071] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:25 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:25.423416 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2362b04-5a8e-411a-be0e-075ef9079181 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:25.433478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2362b04-5a8e-411a-be0e-075ef9079181 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:25.496385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23293c-02a0-48f6-b220-c88ba76fa424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:25.496669 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23293c-02a0-48f6-b220-c88ba76fa424 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:25.496838 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23293c-02a0-48f6-b220-c88ba76fa424 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:25.497131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23293c-02a0-48f6-b220-c88ba76fa424 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:25.497823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23293c-02a0-48f6-b220-c88ba76fa424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:25.499803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23293c-02a0-48f6-b220-c88ba76fa424 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:25.536115 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1027/2072] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:25 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:25.537793 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2029aa0-e4ad-4e2b-b18a-0391aedf47a4 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:25.549484 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2029aa0-e4ad-4e2b-b18a-0391aedf47a4 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:25.556818 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75ea48-cb07-4d9d-b451-fd4bcf6fc909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:25.557624 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75ea48-cb07-4d9d-b451-fd4bcf6fc909 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:25.557910 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75ea48-cb07-4d9d-b451-fd4bcf6fc909 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:25.558166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75ea48-cb07-4d9d-b451-fd4bcf6fc909 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:25.558907 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75ea48-cb07-4d9d-b451-fd4bcf6fc909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:25.560537 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75ea48-cb07-4d9d-b451-fd4bcf6fc909 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:25.580740 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1046/2073] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:25.584198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23293c-02a0-48f6-b220-c88ba76fa424 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:25.604514 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23293c-02a0-48f6-b220-c88ba76fa424 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:25.612991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ba2f6-5199-4442-8648-83e02866ca34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:25.614087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ba2f6-5199-4442-8648-83e02866ca34 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:25.614601 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ba2f6-5199-4442-8648-83e02866ca34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:25.615197 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ba2f6-5199-4442-8648-83e02866ca34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:25.616278 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ba2f6-5199-4442-8648-83e02866ca34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:25.618137 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ba2f6-5199-4442-8648-83e02866ca34 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:25.629359 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1028/2074] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:47:25.633277 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75ea48-cb07-4d9d-b451-fd4bcf6fc909 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:25.646863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75ea48-cb07-4d9d-b451-fd4bcf6fc909 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:25.652346 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b3313-89f9-4e6e-88e1-fc884eac1b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:25.653586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b3313-89f9-4e6e-88e1-fc884eac1b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:25.653870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b3313-89f9-4e6e-88e1-fc884eac1b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:25.654142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b3313-89f9-4e6e-88e1-fc884eac1b9c admin admin] PATH_INFO: `/v3/projects/212b184bc9f44d2bb1aaa700e903bdbb/users/5def64c2af134b1b9ba39c12a30908b7/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:25.670016 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b3313-89f9-4e6e-88e1-fc884eac1b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=212b184bc9f44d2bb1aaa700e903bdbb, user_id=5def64c2af134b1b9ba39c12a30908b7, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:25.672783 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b3313-89f9-4e6e-88e1-fc884eac1b9c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:25.698435 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1047/2075] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:25 2022] PUT /identity/v3/projects/212b184bc9f44d2bb1aaa700e903bdbb/users/5def64c2af134b1b9ba39c12a30908b7/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:25.710942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3c665-a971-4864-abb6-d440214c37da None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:25.711378 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3c665-a971-4864-abb6-d440214c37da None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:25.711673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3c665-a971-4864-abb6-d440214c37da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:25.757737 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-e6f3c665-a971-4864-abb6-d440214c37da None None] MFA Rules not processed for user `5def64c2af134b1b9ba39c12a30908b7`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:25.759059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e6f3c665-a971-4864-abb6-d440214c37da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:25.867348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1029/2076] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:25.871671 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b3313-89f9-4e6e-88e1-fc884eac1b9c admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:25.942548 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b3313-89f9-4e6e-88e1-fc884eac1b9c admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:25.948794 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8a7c0-d33f-40b7-841a-dbff440380f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:25.949530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8a7c0-d33f-40b7-841a-dbff440380f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:25.949877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8a7c0-d33f-40b7-841a-dbff440380f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:25.950606 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8a7c0-d33f-40b7-841a-dbff440380f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:25.951380 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8a7c0-d33f-40b7-841a-dbff440380f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:25.953679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8a7c0-d33f-40b7-841a-dbff440380f9 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:25.999151 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1048/2077] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:25 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:26.003485 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3c665-a971-4864-abb6-d440214c37da None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:26.028714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3c665-a971-4864-abb6-d440214c37da None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:26.130767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8258e1-64c0-4415-a7ac-160b26c2d2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:26.131529 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8258e1-64c0-4415-a7ac-160b26c2d2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:26.131971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8258e1-64c0-4415-a7ac-160b26c2d2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:26.132214 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8258e1-64c0-4415-a7ac-160b26c2d2d7 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:26.133607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8258e1-64c0-4415-a7ac-160b26c2d2d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:26.137214 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8258e1-64c0-4415-a7ac-160b26c2d2d7 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:26.178692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1030/2078] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:26 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:26.182004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8a7c0-d33f-40b7-841a-dbff440380f9 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:26.195260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8a7c0-d33f-40b7-841a-dbff440380f9 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:26.203730 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfcccd-98ae-486d-9719-d2905b3bdcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:26.203730 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfcccd-98ae-486d-9719-d2905b3bdcb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:26.203730 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfcccd-98ae-486d-9719-d2905b3bdcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:26.203730 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfcccd-98ae-486d-9719-d2905b3bdcb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:26.204276 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfcccd-98ae-486d-9719-d2905b3bdcb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:26.204913 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfcccd-98ae-486d-9719-d2905b3bdcb0 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:26.216851 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1049/2079] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:26.221500 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8258e1-64c0-4415-a7ac-160b26c2d2d7 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:26.232421 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8258e1-64c0-4415-a7ac-160b26c2d2d7 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:26.239173 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275660b3-dbe4-4227-baab-422eae96657a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:26.240768 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275660b3-dbe4-4227-baab-422eae96657a admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:26.241268 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275660b3-dbe4-4227-baab-422eae96657a admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:26.241565 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275660b3-dbe4-4227-baab-422eae96657a admin admin] PATH_INFO: `/v3/projects/7c0b9c5a94284267b91e0f5cb1fa7c23/users/553e902b6f0e4ac495f8d0fc85b9c122/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:26.258201 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275660b3-dbe4-4227-baab-422eae96657a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0b9c5a94284267b91e0f5cb1fa7c23, user_id=553e902b6f0e4ac495f8d0fc85b9c122, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:26.260985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275660b3-dbe4-4227-baab-422eae96657a admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:26.277568 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1031/2080] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:26 2022] PUT /identity/v3/projects/7c0b9c5a94284267b91e0f5cb1fa7c23/users/553e902b6f0e4ac495f8d0fc85b9c122/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:26.282410 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfcccd-98ae-486d-9719-d2905b3bdcb0 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:26.295431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfcccd-98ae-486d-9719-d2905b3bdcb0 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:26.358710 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86718bbd-8a93-4023-9168-4b5354fbabc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:26.359431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86718bbd-8a93-4023-9168-4b5354fbabc5 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:26.359716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86718bbd-8a93-4023-9168-4b5354fbabc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:26.359994 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86718bbd-8a93-4023-9168-4b5354fbabc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:26.360759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86718bbd-8a93-4023-9168-4b5354fbabc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:26.362391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86718bbd-8a93-4023-9168-4b5354fbabc5 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:26.376520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1050/2081] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:47:26.377980 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275660b3-dbe4-4227-baab-422eae96657a admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:26.388387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275660b3-dbe4-4227-baab-422eae96657a admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:26.393182 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5d9f2-1dc5-486d-bb71-bd06453b7b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:26.394141 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5d9f2-1dc5-486d-bb71-bd06453b7b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:26.394486 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5d9f2-1dc5-486d-bb71-bd06453b7b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:26.394825 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5d9f2-1dc5-486d-bb71-bd06453b7b0f admin admin] PATH_INFO: `/v3/projects/7c0b9c5a94284267b91e0f5cb1fa7c23/users/553e902b6f0e4ac495f8d0fc85b9c122/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:26.397000 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5d9f2-1dc5-486d-bb71-bd06453b7b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0b9c5a94284267b91e0f5cb1fa7c23, user_id=553e902b6f0e4ac495f8d0fc85b9c122, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:26.399818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5d9f2-1dc5-486d-bb71-bd06453b7b0f admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:26.410926 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1032/2082] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:26 2022] PUT /identity/v3/projects/7c0b9c5a94284267b91e0f5cb1fa7c23/users/553e902b6f0e4ac495f8d0fc85b9c122/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:26.422703 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01973e6-13d7-4522-b031-c13fe0cd970e None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:26.423176 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01973e6-13d7-4522-b031-c13fe0cd970e None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:26.423528 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01973e6-13d7-4522-b031-c13fe0cd970e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:26.457143 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-f01973e6-13d7-4522-b031-c13fe0cd970e None None] MFA Rules not processed for user `553e902b6f0e4ac495f8d0fc85b9c122`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:26.459023 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-f01973e6-13d7-4522-b031-c13fe0cd970e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:26.533638 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1051/2083] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:26.544562 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5d9f2-1dc5-486d-bb71-bd06453b7b0f admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:26.546568 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-afe5d9f2-1dc5-486d-bb71-bd06453b7b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:26.603408 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5d9f2-1dc5-486d-bb71-bd06453b7b0f admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:26.608175 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c606449-2d5e-4abc-b163-de37a7c0b2d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:26.608852 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c606449-2d5e-4abc-b163-de37a7c0b2d8 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:26.609135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c606449-2d5e-4abc-b163-de37a7c0b2d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:26.609410 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c606449-2d5e-4abc-b163-de37a7c0b2d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:26.670248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c606449-2d5e-4abc-b163-de37a7c0b2d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:26.671736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c606449-2d5e-4abc-b163-de37a7c0b2d8 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:26.682968 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1033/2084] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:29.262118 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01973e6-13d7-4522-b031-c13fe0cd970e None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:29.333008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01973e6-13d7-4522-b031-c13fe0cd970e None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:29.339250 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83821158-a972-47ad-91d2-0eb836ca2d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:29.340235 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83821158-a972-47ad-91d2-0eb836ca2d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:29.340525 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83821158-a972-47ad-91d2-0eb836ca2d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:29.340803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83821158-a972-47ad-91d2-0eb836ca2d40 admin admin] PATH_INFO: `/v3/users/5def64c2af134b1b9ba39c12a30908b7` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:29.342412 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83821158-a972-47ad-91d2-0eb836ca2d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5def64c2af134b1b9ba39c12a30908b7)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:29.344945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83821158-a972-47ad-91d2-0eb836ca2d40 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:29.374948 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c606449-2d5e-4abc-b163-de37a7c0b2d8 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:29.376431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-7c606449-2d5e-4abc-b163-de37a7c0b2d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:29.390649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c606449-2d5e-4abc-b163-de37a7c0b2d8 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:29.395142 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63b3a8-a1a0-42e6-aec6-24436308088f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:29.396013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63b3a8-a1a0-42e6-aec6-24436308088f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:29.396297 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63b3a8-a1a0-42e6-aec6-24436308088f admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:29.396669 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63b3a8-a1a0-42e6-aec6-24436308088f admin admin] PATH_INFO: `/v3/users/aed5bd46215c423c91a6f839c653e5a5` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:29.398036 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63b3a8-a1a0-42e6-aec6-24436308088f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aed5bd46215c423c91a6f839c653e5a5)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:29.399380 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-83821158-a972-47ad-91d2-0eb836ca2d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5def64c2af134b1b9ba39c12a30908b7'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:29.400043 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63b3a8-a1a0-42e6-aec6-24436308088f admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:29.406304 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-83821158-a972-47ad-91d2-0eb836ca2d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5def64c2af134b1b9ba39c12a30908b7'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:29.407852 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-83821158-a972-47ad-91d2-0eb836ca2d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5def64c2af134b1b9ba39c12a30908b7'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:29.421127 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-83821158-a972-47ad-91d2-0eb836ca2d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5def64c2af134b1b9ba39c12a30908b7'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:29.429814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-83821158-a972-47ad-91d2-0eb836ca2d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5def64c2af134b1b9ba39c12a30908b7'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:29.436407 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1052/2085] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:29 2022] DELETE /identity/v3/users/5def64c2af134b1b9ba39c12a30908b7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:29.441166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078b831-b1cf-4157-9fc4-be30d9375f68 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:29.441698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078b831-b1cf-4157-9fc4-be30d9375f68 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:29.442086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078b831-b1cf-4157-9fc4-be30d9375f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:29.450636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1f63b3a8-a1a0-42e6-aec6-24436308088f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aed5bd46215c423c91a6f839c653e5a5'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:29.459135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1f63b3a8-a1a0-42e6-aec6-24436308088f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aed5bd46215c423c91a6f839c653e5a5'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:29.460023 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-0078b831-b1cf-4157-9fc4-be30d9375f68 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:29.461267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-0078b831-b1cf-4157-9fc4-be30d9375f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:29.466099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1f63b3a8-a1a0-42e6-aec6-24436308088f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aed5bd46215c423c91a6f839c653e5a5'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:29.466794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1f63b3a8-a1a0-42e6-aec6-24436308088f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aed5bd46215c423c91a6f839c653e5a5'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:29.467713 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1f63b3a8-a1a0-42e6-aec6-24436308088f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aed5bd46215c423c91a6f839c653e5a5'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:29.485204 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1034/2086] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:29 2022] DELETE /identity/v3/users/aed5bd46215c423c91a6f839c653e5a5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:47:29.490136 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dd6fa-cccd-4a6e-927d-c6befb58dd24 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:29.490401 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dd6fa-cccd-4a6e-927d-c6befb58dd24 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:29.490704 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dd6fa-cccd-4a6e-927d-c6befb58dd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:29.510509 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-b55dd6fa-cccd-4a6e-927d-c6befb58dd24 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:29.515546 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b55dd6fa-cccd-4a6e-927d-c6befb58dd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:29.528224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1053/2087] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:47:29.541301 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078b831-b1cf-4157-9fc4-be30d9375f68 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:29.544733 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-0078b831-b1cf-4157-9fc4-be30d9375f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:29.602544 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1035/2088] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:47:29.606368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55dd6fa-cccd-4a6e-927d-c6befb58dd24 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:29.607825 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b55dd6fa-cccd-4a6e-927d-c6befb58dd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:29.619963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078b831-b1cf-4157-9fc4-be30d9375f68 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:29.688193 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fb545-fb17-4665-87a0-d0603598e238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:29.688775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fb545-fb17-4665-87a0-d0603598e238 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:29.689061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fb545-fb17-4665-87a0-d0603598e238 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:29.689342 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fb545-fb17-4665-87a0-d0603598e238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:29.705404 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fb545-fb17-4665-87a0-d0603598e238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:29.706666 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55dd6fa-cccd-4a6e-927d-c6befb58dd24 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:29.708523 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fb545-fb17-4665-87a0-d0603598e238 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:29.711372 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307e4f-97c2-49d5-9c49-189b5514dfb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:29.712039 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307e4f-97c2-49d5-9c49-189b5514dfb7 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:29.712327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307e4f-97c2-49d5-9c49-189b5514dfb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:29.713164 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307e4f-97c2-49d5-9c49-189b5514dfb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:29.727896 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14307e4f-97c2-49d5-9c49-189b5514dfb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:29.729352 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14307e4f-97c2-49d5-9c49-189b5514dfb7 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:29.730217 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1054/2089] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:47:29.740915 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1036/2090] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:30.268802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fb545-fb17-4665-87a0-d0603598e238 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:30.270208 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-119fb545-fb17-4665-87a0-d0603598e238 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:30.289299 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fb545-fb17-4665-87a0-d0603598e238 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:30.297335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09861d16-a217-41c8-ad70-f195d6ff8fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:30.298227 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09861d16-a217-41c8-ad70-f195d6ff8fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:30.298572 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09861d16-a217-41c8-ad70-f195d6ff8fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:30.298854 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09861d16-a217-41c8-ad70-f195d6ff8fa5 admin admin] PATH_INFO: `/v3/projects/212b184bc9f44d2bb1aaa700e903bdbb` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:30.300166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09861d16-a217-41c8-ad70-f195d6ff8fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=212b184bc9f44d2bb1aaa700e903bdbb)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:30.302078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09861d16-a217-41c8-ad70-f195d6ff8fa5 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:30.359092 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-09861d16-a217-41c8-ad70-f195d6ff8fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '212b184bc9f44d2bb1aaa700e903bdbb', 'request_id': 'req-09861d16-a217-41c8-ad70-f195d6ff8fa5'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:30.369451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-09861d16-a217-41c8-ad70-f195d6ff8fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '212b184bc9f44d2bb1aaa700e903bdbb', 'request_id': 'req-09861d16-a217-41c8-ad70-f195d6ff8fa5'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:30.376632 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-09861d16-a217-41c8-ad70-f195d6ff8fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '212b184bc9f44d2bb1aaa700e903bdbb', 'request_id': 'req-09861d16-a217-41c8-ad70-f195d6ff8fa5'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:30.388410 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-09861d16-a217-41c8-ad70-f195d6ff8fa5 admin admin] The token cache is being invalidate because project 212b184bc9f44d2bb1aaa700e903bdbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:30.388724 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-09861d16-a217-41c8-ad70-f195d6ff8fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:30.389950 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-09861d16-a217-41c8-ad70-f195d6ff8fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:30.394977 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1055/2091] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:30 2022] DELETE /identity/v3/projects/212b184bc9f44d2bb1aaa700e903bdbb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:30.396448 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307e4f-97c2-49d5-9c49-189b5514dfb7 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:30.420678 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307e4f-97c2-49d5-9c49-189b5514dfb7 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:30.492877 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8a55c-f7b3-4ece-a9c1-95842d0afd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:30.493752 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8a55c-f7b3-4ece-a9c1-95842d0afd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:30.494027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8a55c-f7b3-4ece-a9c1-95842d0afd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:30.494297 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8a55c-f7b3-4ece-a9c1-95842d0afd46 admin admin] PATH_INFO: `/v3/users/553e902b6f0e4ac495f8d0fc85b9c122` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:30.495518 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8a55c-f7b3-4ece-a9c1-95842d0afd46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=553e902b6f0e4ac495f8d0fc85b9c122)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:30.497560 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8a55c-f7b3-4ece-a9c1-95842d0afd46 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:30.554763 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-2ff8a55c-f7b3-4ece-a9c1-95842d0afd46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553e902b6f0e4ac495f8d0fc85b9c122'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:30.565627 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-2ff8a55c-f7b3-4ece-a9c1-95842d0afd46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553e902b6f0e4ac495f8d0fc85b9c122'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:30.568405 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09861d16-a217-41c8-ad70-f195d6ff8fa5 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:30.573795 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-09861d16-a217-41c8-ad70-f195d6ff8fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:30.575715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-2ff8a55c-f7b3-4ece-a9c1-95842d0afd46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553e902b6f0e4ac495f8d0fc85b9c122'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:30.575715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-2ff8a55c-f7b3-4ece-a9c1-95842d0afd46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553e902b6f0e4ac495f8d0fc85b9c122'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:30.576136 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-2ff8a55c-f7b3-4ece-a9c1-95842d0afd46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553e902b6f0e4ac495f8d0fc85b9c122'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:30.588869 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09861d16-a217-41c8-ad70-f195d6ff8fa5 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:30.597779 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabb5da-c9bd-4535-95dc-159d912d3864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:30.598788 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb5da-c9bd-4535-95dc-159d912d3864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:30.599287 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb5da-c9bd-4535-95dc-159d912d3864 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:30.599520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb5da-c9bd-4535-95dc-159d912d3864 admin admin] PATH_INFO: `/v3/users/1177da2d74a5427492e15695896e725c` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:30.604057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1037/2092] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:30 2022] DELETE /identity/v3/users/553e902b6f0e4ac495f8d0fc85b9c122 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:30.604497 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabb5da-c9bd-4535-95dc-159d912d3864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1177da2d74a5427492e15695896e725c)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:30.605118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8a55c-f7b3-4ece-a9c1-95842d0afd46 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:30.605199 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabb5da-c9bd-4535-95dc-159d912d3864 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:30.615726 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-2ff8a55c-f7b3-4ece-a9c1-95842d0afd46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:30.670010 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-2cabb5da-c9bd-4535-95dc-159d912d3864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1177da2d74a5427492e15695896e725c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:30.680333 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-2cabb5da-c9bd-4535-95dc-159d912d3864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1177da2d74a5427492e15695896e725c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:30.681088 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-2cabb5da-c9bd-4535-95dc-159d912d3864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1177da2d74a5427492e15695896e725c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:30.695683 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-2cabb5da-c9bd-4535-95dc-159d912d3864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1177da2d74a5427492e15695896e725c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:30.702446 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8a55c-f7b3-4ece-a9c1-95842d0afd46 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:30.704347 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-2cabb5da-c9bd-4535-95dc-159d912d3864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1177da2d74a5427492e15695896e725c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:30.707814 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa0270-50f2-4d33-b1c4-a3b1f2e9cdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:30.708695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa0270-50f2-4d33-b1c4-a3b1f2e9cdb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:30.708978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa0270-50f2-4d33-b1c4-a3b1f2e9cdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:30.709372 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa0270-50f2-4d33-b1c4-a3b1f2e9cdb7 admin admin] PATH_INFO: `/v3/projects/66463edce61342058f7c0774cb8f5e21` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:30.710647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa0270-50f2-4d33-b1c4-a3b1f2e9cdb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66463edce61342058f7c0774cb8f5e21)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:30.716056 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa0270-50f2-4d33-b1c4-a3b1f2e9cdb7 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:30.716239 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1056/2093] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:30 2022] DELETE /identity/v3/users/1177da2d74a5427492e15695896e725c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:30.779085 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c7aa0270-50f2-4d33-b1c4-a3b1f2e9cdb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66463edce61342058f7c0774cb8f5e21', 'request_id': 'req-c7aa0270-50f2-4d33-b1c4-a3b1f2e9cdb7'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:30.787941 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c7aa0270-50f2-4d33-b1c4-a3b1f2e9cdb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66463edce61342058f7c0774cb8f5e21', 'request_id': 'req-c7aa0270-50f2-4d33-b1c4-a3b1f2e9cdb7'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:30.811601 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c7aa0270-50f2-4d33-b1c4-a3b1f2e9cdb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66463edce61342058f7c0774cb8f5e21', 'request_id': 'req-c7aa0270-50f2-4d33-b1c4-a3b1f2e9cdb7'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:30.837652 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c7aa0270-50f2-4d33-b1c4-a3b1f2e9cdb7 admin admin] The token cache is being invalidate because project 66463edce61342058f7c0774cb8f5e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:30.839459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c7aa0270-50f2-4d33-b1c4-a3b1f2e9cdb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:30.840260 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c7aa0270-50f2-4d33-b1c4-a3b1f2e9cdb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:30.847390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1038/2094] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:30 2022] DELETE /identity/v3/projects/66463edce61342058f7c0774cb8f5e21 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:30.852138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabb5da-c9bd-4535-95dc-159d912d3864 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:30.855081 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-2cabb5da-c9bd-4535-95dc-159d912d3864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:30.957222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa0270-50f2-4d33-b1c4-a3b1f2e9cdb7 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:30.958828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c7aa0270-50f2-4d33-b1c4-a3b1f2e9cdb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:30.959929 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabb5da-c9bd-4535-95dc-159d912d3864 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:31.039816 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53875d-e676-4d77-9bc5-6dca6ff0e645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:31.040849 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53875d-e676-4d77-9bc5-6dca6ff0e645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.041134 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53875d-e676-4d77-9bc5-6dca6ff0e645 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.041404 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53875d-e676-4d77-9bc5-6dca6ff0e645 admin admin] PATH_INFO: `/v3/users/d45c45d3ee3c4350b6f7c7c9efbdfb0d` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.042926 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53875d-e676-4d77-9bc5-6dca6ff0e645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d45c45d3ee3c4350b6f7c7c9efbdfb0d)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:31.044977 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53875d-e676-4d77-9bc5-6dca6ff0e645 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:31.049324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa0270-50f2-4d33-b1c4-a3b1f2e9cdb7 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:31.055753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9691fad-8bc6-4091-a2f8-aadf3ef63717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:31.056824 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9691fad-8bc6-4091-a2f8-aadf3ef63717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.059190 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9691fad-8bc6-4091-a2f8-aadf3ef63717 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.059625 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9691fad-8bc6-4091-a2f8-aadf3ef63717 admin admin] PATH_INFO: `/v3/projects/0fcecc72d42e4bc58aff85d4fc332215` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.070021 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9691fad-8bc6-4091-a2f8-aadf3ef63717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fcecc72d42e4bc58aff85d4fc332215)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:31.070021 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9691fad-8bc6-4091-a2f8-aadf3ef63717 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:31.110018 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ae53875d-e676-4d77-9bc5-6dca6ff0e645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd45c45d3ee3c4350b6f7c7c9efbdfb0d'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:31.117175 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ae53875d-e676-4d77-9bc5-6dca6ff0e645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd45c45d3ee3c4350b6f7c7c9efbdfb0d'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:31.117895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ae53875d-e676-4d77-9bc5-6dca6ff0e645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd45c45d3ee3c4350b6f7c7c9efbdfb0d'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:31.128555 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b9691fad-8bc6-4091-a2f8-aadf3ef63717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fcecc72d42e4bc58aff85d4fc332215', 'request_id': 'req-b9691fad-8bc6-4091-a2f8-aadf3ef63717'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:31.130255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ae53875d-e676-4d77-9bc5-6dca6ff0e645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd45c45d3ee3c4350b6f7c7c9efbdfb0d'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:31.134737 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b9691fad-8bc6-4091-a2f8-aadf3ef63717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fcecc72d42e4bc58aff85d4fc332215', 'request_id': 'req-b9691fad-8bc6-4091-a2f8-aadf3ef63717'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:31.138331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ae53875d-e676-4d77-9bc5-6dca6ff0e645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd45c45d3ee3c4350b6f7c7c9efbdfb0d'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:31.144168 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b9691fad-8bc6-4091-a2f8-aadf3ef63717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fcecc72d42e4bc58aff85d4fc332215', 'request_id': 'req-b9691fad-8bc6-4091-a2f8-aadf3ef63717'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:31.144634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1057/2095] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:30 2022] DELETE /identity/v3/users/d45c45d3ee3c4350b6f7c7c9efbdfb0d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:47:31.149586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53875d-e676-4d77-9bc5-6dca6ff0e645 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:31.152474 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ae53875d-e676-4d77-9bc5-6dca6ff0e645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:31.156209 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b9691fad-8bc6-4091-a2f8-aadf3ef63717 admin admin] The token cache is being invalidate because project 0fcecc72d42e4bc58aff85d4fc332215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:31.156342 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b9691fad-8bc6-4091-a2f8-aadf3ef63717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:31.156986 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b9691fad-8bc6-4091-a2f8-aadf3ef63717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:31.160342 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1039/2096] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:30 2022] DELETE /identity/v3/projects/0fcecc72d42e4bc58aff85d4fc332215 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:31.165821 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5793aeb-6cf3-42cc-83e7-abd88197df28 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.166257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5793aeb-6cf3-42cc-83e7-abd88197df28 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.166257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5793aeb-6cf3-42cc-83e7-abd88197df28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.192408 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-f5793aeb-6cf3-42cc-83e7-abd88197df28 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:31.193924 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f5793aeb-6cf3-42cc-83e7-abd88197df28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:31.237212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53875d-e676-4d77-9bc5-6dca6ff0e645 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:31.242422 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e6732-2d71-4176-a887-a05bf97470a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:31.243557 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e6732-2d71-4176-a887-a05bf97470a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.243557 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e6732-2d71-4176-a887-a05bf97470a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.243878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e6732-2d71-4176-a887-a05bf97470a5 admin admin] PATH_INFO: `/v3/projects/7c0b9c5a94284267b91e0f5cb1fa7c23` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.245067 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e6732-2d71-4176-a887-a05bf97470a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0b9c5a94284267b91e0f5cb1fa7c23)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:31.247074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e6732-2d71-4176-a887-a05bf97470a5 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:31.260464 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1040/2097] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:31.269339 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b87b9-c132-44a2-a084-d26d13f16719 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.269631 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b87b9-c132-44a2-a084-d26d13f16719 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.269912 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b87b9-c132-44a2-a084-d26d13f16719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.290696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-d53b87b9-c132-44a2-a084-d26d13f16719 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:31.295063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-d53b87b9-c132-44a2-a084-d26d13f16719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:31.308678 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1041/2098] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:47:31.309646 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b87b9-c132-44a2-a084-d26d13f16719 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:31.321268 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b87b9-c132-44a2-a084-d26d13f16719 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:31.346983 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-461e6732-2d71-4176-a887-a05bf97470a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0b9c5a94284267b91e0f5cb1fa7c23', 'request_id': 'req-461e6732-2d71-4176-a887-a05bf97470a5'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:31.363387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-461e6732-2d71-4176-a887-a05bf97470a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0b9c5a94284267b91e0f5cb1fa7c23', 'request_id': 'req-461e6732-2d71-4176-a887-a05bf97470a5'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:31.372378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-461e6732-2d71-4176-a887-a05bf97470a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0b9c5a94284267b91e0f5cb1fa7c23', 'request_id': 'req-461e6732-2d71-4176-a887-a05bf97470a5'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:31.383822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-461e6732-2d71-4176-a887-a05bf97470a5 admin admin] The token cache is being invalidate because project 7c0b9c5a94284267b91e0f5cb1fa7c23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:31.384459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-461e6732-2d71-4176-a887-a05bf97470a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:31.384648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf22337-4423-4544-b65d-d4b11e156205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:31.385139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-461e6732-2d71-4176-a887-a05bf97470a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:31.385329 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf22337-4423-4544-b65d-d4b11e156205 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.385587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf22337-4423-4544-b65d-d4b11e156205 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.385870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf22337-4423-4544-b65d-d4b11e156205 admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.386607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf22337-4423-4544-b65d-d4b11e156205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:47:31.386922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf22337-4423-4544-b65d-d4b11e156205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:31.387026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1058/2099] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:31 2022] DELETE /identity/v3/projects/7c0b9c5a94284267b91e0f5cb1fa7c23 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:31.388700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf22337-4423-4544-b65d-d4b11e156205 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:31.392498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a03e7f-3bd3-4dd7-b7e7-03a7aeae9038 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.393037 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a03e7f-3bd3-4dd7-b7e7-03a7aeae9038 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.393498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a03e7f-3bd3-4dd7-b7e7-03a7aeae9038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.402078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1042/2100] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:47:31.406892 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf22337-4423-4544-b65d-d4b11e156205 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:31.413718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-9cf22337-4423-4544-b65d-d4b11e156205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:31.425169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-68a03e7f-3bd3-4dd7-b7e7-03a7aeae9038 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:31.427232 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-68a03e7f-3bd3-4dd7-b7e7-03a7aeae9038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:31.428332 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf22337-4423-4544-b65d-d4b11e156205 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:31.434527 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f909438-6b03-4b29-b63e-92ad2593b247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:31.435322 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f909438-6b03-4b29-b63e-92ad2593b247 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.435666 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f909438-6b03-4b29-b63e-92ad2593b247 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.436020 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f909438-6b03-4b29-b63e-92ad2593b247 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.436984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f909438-6b03-4b29-b63e-92ad2593b247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:31.438994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f909438-6b03-4b29-b63e-92ad2593b247 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:31.439332 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1059/2101] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:47:31.455370 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bae3d-b388-480f-a6cc-b1cdb8fd3683 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.455776 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bae3d-b388-480f-a6cc-b1cdb8fd3683 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.456636 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bae3d-b388-480f-a6cc-b1cdb8fd3683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.482940 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-2f8bae3d-b388-480f-a6cc-b1cdb8fd3683 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:31.482940 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-2f8bae3d-b388-480f-a6cc-b1cdb8fd3683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:31.483634 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1043/2102] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:31 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:31.484441 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f909438-6b03-4b29-b63e-92ad2593b247 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:31.486031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-9f909438-6b03-4b29-b63e-92ad2593b247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:31.553054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1060/2103] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:31.553938 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bae3d-b388-480f-a6cc-b1cdb8fd3683 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:31.561968 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f909438-6b03-4b29-b63e-92ad2593b247 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:31.563648 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bae3d-b388-480f-a6cc-b1cdb8fd3683 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:31.567198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd0bc0-d63a-4e99-bdae-e7d3f334ce58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:31.568120 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd0bc0-d63a-4e99-bdae-e7d3f334ce58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.568433 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd0bc0-d63a-4e99-bdae-e7d3f334ce58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.568712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd0bc0-d63a-4e99-bdae-e7d3f334ce58 admin admin] PATH_INFO: `/v3/projects/b78dace149b443669e9b3fba893047ac` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.569708 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c71492-63af-4547-bc38-20fc17d3682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:31.570090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd0bc0-d63a-4e99-bdae-e7d3f334ce58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78dace149b443669e9b3fba893047ac)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:31.570881 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c71492-63af-4547-bc38-20fc17d3682a admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.571200 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c71492-63af-4547-bc38-20fc17d3682a admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.571478 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c71492-63af-4547-bc38-20fc17d3682a admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.572023 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd0bc0-d63a-4e99-bdae-e7d3f334ce58 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:31.572193 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c71492-63af-4547-bc38-20fc17d3682a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:31.574673 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c71492-63af-4547-bc38-20fc17d3682a admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:31.601278 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1061/2104] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:31 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:31.601278 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c71492-63af-4547-bc38-20fc17d3682a admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:31.609024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c71492-63af-4547-bc38-20fc17d3682a admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:31.614843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523879f-8c91-4af9-bf1a-0d203328be57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:31.618715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523879f-8c91-4af9-bf1a-0d203328be57 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.618715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523879f-8c91-4af9-bf1a-0d203328be57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.618715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523879f-8c91-4af9-bf1a-0d203328be57 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.618715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523879f-8c91-4af9-bf1a-0d203328be57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:47:31.618715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523879f-8c91-4af9-bf1a-0d203328be57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:31.619403 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523879f-8c91-4af9-bf1a-0d203328be57 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:31.637276 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1062/2105] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:47:31.637276 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523879f-8c91-4af9-bf1a-0d203328be57 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:31.637572 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-7abd0bc0-d63a-4e99-bdae-e7d3f334ce58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78dace149b443669e9b3fba893047ac', 'request_id': 'req-7abd0bc0-d63a-4e99-bdae-e7d3f334ce58'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:31.643738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-7abd0bc0-d63a-4e99-bdae-e7d3f334ce58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78dace149b443669e9b3fba893047ac', 'request_id': 'req-7abd0bc0-d63a-4e99-bdae-e7d3f334ce58'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:31.644895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523879f-8c91-4af9-bf1a-0d203328be57 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:31.652483 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-7abd0bc0-d63a-4e99-bdae-e7d3f334ce58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78dace149b443669e9b3fba893047ac', 'request_id': 'req-7abd0bc0-d63a-4e99-bdae-e7d3f334ce58'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:31.663006 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-7abd0bc0-d63a-4e99-bdae-e7d3f334ce58 admin admin] The token cache is being invalidate because project b78dace149b443669e9b3fba893047ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:31.663401 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-7abd0bc0-d63a-4e99-bdae-e7d3f334ce58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:31.664523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-7abd0bc0-d63a-4e99-bdae-e7d3f334ce58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:31.666088 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1044/2106] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:31 2022] DELETE /identity/v3/projects/b78dace149b443669e9b3fba893047ac => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:31.667875 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd0bc0-d63a-4e99-bdae-e7d3f334ce58 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:31.669313 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-7abd0bc0-d63a-4e99-bdae-e7d3f334ce58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:31.709275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bbab3-64fd-4f29-b99f-435bf80d5b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:31.709863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bbab3-64fd-4f29-b99f-435bf80d5b7f admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.710223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bbab3-64fd-4f29-b99f-435bf80d5b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.710498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bbab3-64fd-4f29-b99f-435bf80d5b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.711448 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bbab3-64fd-4f29-b99f-435bf80d5b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:31.713065 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bbab3-64fd-4f29-b99f-435bf80d5b7f admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:31.723601 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1063/2107] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:31.724840 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30214648-aefe-4dda-889d-1e7184e58e39 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.725127 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30214648-aefe-4dda-889d-1e7184e58e39 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.725406 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30214648-aefe-4dda-889d-1e7184e58e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.737553 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd0bc0-d63a-4e99-bdae-e7d3f334ce58 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:31.742886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15a6f0-78b2-4c4d-9b08-61bdfb1a1403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:31.743639 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15a6f0-78b2-4c4d-9b08-61bdfb1a1403 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.743930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15a6f0-78b2-4c4d-9b08-61bdfb1a1403 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.744209 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15a6f0-78b2-4c4d-9b08-61bdfb1a1403 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.744902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15a6f0-78b2-4c4d-9b08-61bdfb1a1403 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:31.745289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-30214648-aefe-4dda-889d-1e7184e58e39 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:31.746489 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-30214648-aefe-4dda-889d-1e7184e58e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:31.746847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15a6f0-78b2-4c4d-9b08-61bdfb1a1403 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:31.754367 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1064/2108] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:31.755497 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30214648-aefe-4dda-889d-1e7184e58e39 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:31.763983 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-30214648-aefe-4dda-889d-1e7184e58e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:31.775085 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1045/2109] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:31 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:31.775085 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5837a0-763b-4620-acde-c9092c0565d3 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.775371 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5837a0-763b-4620-acde-c9092c0565d3 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.775781 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5837a0-763b-4620-acde-c9092c0565d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.776919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30214648-aefe-4dda-889d-1e7184e58e39 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:31.793537 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-bb5837a0-763b-4620-acde-c9092c0565d3 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:31.794765 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-bb5837a0-763b-4620-acde-c9092c0565d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:31.841555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa51d5a-975b-4d91-9e20-ed1e6e094631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:31.842238 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa51d5a-975b-4d91-9e20-ed1e6e094631 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.842521 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa51d5a-975b-4d91-9e20-ed1e6e094631 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.842802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa51d5a-975b-4d91-9e20-ed1e6e094631 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.843902 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa51d5a-975b-4d91-9e20-ed1e6e094631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:31.845527 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa51d5a-975b-4d91-9e20-ed1e6e094631 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:31.855594 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1046/2110] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:31.859019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1065/2111] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:31.859217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5837a0-763b-4620-acde-c9092c0565d3 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:31.859735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa51d5a-975b-4d91-9e20-ed1e6e094631 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:31.866223 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5837a0-763b-4620-acde-c9092c0565d3 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:31.869745 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa51d5a-975b-4d91-9e20-ed1e6e094631 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:31.870932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88b464-d72e-42b9-b0a4-8b9b47060b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:31.871678 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88b464-d72e-42b9-b0a4-8b9b47060b84 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.871962 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88b464-d72e-42b9-b0a4-8b9b47060b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.872240 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88b464-d72e-42b9-b0a4-8b9b47060b84 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.872933 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88b464-d72e-42b9-b0a4-8b9b47060b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:31.874674 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0543d88-c834-4cd1-8137-380f2d4b2732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:31.874850 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88b464-d72e-42b9-b0a4-8b9b47060b84 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:31.875366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0543d88-c834-4cd1-8137-380f2d4b2732 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.875645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0543d88-c834-4cd1-8137-380f2d4b2732 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.875979 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0543d88-c834-4cd1-8137-380f2d4b2732 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.876641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0543d88-c834-4cd1-8137-380f2d4b2732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:47:31.876949 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0543d88-c834-4cd1-8137-380f2d4b2732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:31.878572 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0543d88-c834-4cd1-8137-380f2d4b2732 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:31.893246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1066/2112] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:47:31.894465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0543d88-c834-4cd1-8137-380f2d4b2732 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:31.905950 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1047/2113] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:31 2022] POST /identity/v3/users => generated 295 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:31.905950 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88b464-d72e-42b9-b0a4-8b9b47060b84 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:31.907764 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0543d88-c834-4cd1-8137-380f2d4b2732 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:31.913022 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b12495-c807-4ed6-b5a2-36e3e5cb5a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:31.914006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b12495-c807-4ed6-b5a2-36e3e5cb5a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.914370 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b12495-c807-4ed6-b5a2-36e3e5cb5a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.914717 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b12495-c807-4ed6-b5a2-36e3e5cb5a63 admin admin] PATH_INFO: `/v3/projects/5a76f68612f4461199c8ed4a718d2a8d/users/0196716439d4473498c7c4b15a1e1d24/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.917032 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88b464-d72e-42b9-b0a4-8b9b47060b84 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:31.929772 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b12495-c807-4ed6-b5a2-36e3e5cb5a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a76f68612f4461199c8ed4a718d2a8d, user_id=0196716439d4473498c7c4b15a1e1d24, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:31.930543 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e948778-1f9c-40b4-b57f-102a4a8764a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:31.931268 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e948778-1f9c-40b4-b57f-102a4a8764a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.931558 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e948778-1f9c-40b4-b57f-102a4a8764a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.931837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e948778-1f9c-40b4-b57f-102a4a8764a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.932549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b12495-c807-4ed6-b5a2-36e3e5cb5a63 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:31.932658 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e948778-1f9c-40b4-b57f-102a4a8764a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:31.935183 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e948778-1f9c-40b4-b57f-102a4a8764a4 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:31.946655 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1067/2114] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:31 2022] PUT /identity/v3/projects/5a76f68612f4461199c8ed4a718d2a8d/users/0196716439d4473498c7c4b15a1e1d24/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:31.947706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b12495-c807-4ed6-b5a2-36e3e5cb5a63 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:31.966714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1048/2115] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:31 2022] POST /identity/v3/projects => generated 357 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:31.966714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a22d2-985d-4df5-ba00-49a5484287d5 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:31.966714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a22d2-985d-4df5-ba00-49a5484287d5 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:31.966714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a22d2-985d-4df5-ba00-49a5484287d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:31.982945 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-8e2a22d2-985d-4df5-ba00-49a5484287d5 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:31.984381 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-8e2a22d2-985d-4df5-ba00-49a5484287d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:32.010667 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b12495-c807-4ed6-b5a2-36e3e5cb5a63 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:32.048553 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1049/2116] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:32.052556 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a22d2-985d-4df5-ba00-49a5484287d5 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:32.061834 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a22d2-985d-4df5-ba00-49a5484287d5 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:32.066815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0562b1-4167-4d4d-ae4c-6ee9e8b5a720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:32.067522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0562b1-4167-4d4d-ae4c-6ee9e8b5a720 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:32.067888 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0562b1-4167-4d4d-ae4c-6ee9e8b5a720 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:32.068206 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0562b1-4167-4d4d-ae4c-6ee9e8b5a720 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:32.068985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0562b1-4167-4d4d-ae4c-6ee9e8b5a720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:32.069276 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bbf67-7fc7-4465-8b98-44b4d84a285f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:32.070112 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bbf67-7fc7-4465-8b98-44b4d84a285f admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:32.070495 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bbf67-7fc7-4465-8b98-44b4d84a285f admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:32.072696 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bbf67-7fc7-4465-8b98-44b4d84a285f admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:32.073581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bbf67-7fc7-4465-8b98-44b4d84a285f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:32.075568 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bbf67-7fc7-4465-8b98-44b4d84a285f admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:32.076472 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0562b1-4167-4d4d-ae4c-6ee9e8b5a720 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:32.089873 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1068/2117] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:32.089873 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bbf67-7fc7-4465-8b98-44b4d84a285f admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:32.090949 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a63bbf67-7fc7-4465-8b98-44b4d84a285f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:32.102716 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1050/2118] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:32 2022] POST /identity/v3/users => generated 279 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:32.106586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0562b1-4167-4d4d-ae4c-6ee9e8b5a720 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:32.116730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0562b1-4167-4d4d-ae4c-6ee9e8b5a720 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:32.121830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ae3ab-21af-4a76-99aa-1caed55bc7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:32.122492 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ae3ab-21af-4a76-99aa-1caed55bc7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:32.122774 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ae3ab-21af-4a76-99aa-1caed55bc7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:32.123163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ae3ab-21af-4a76-99aa-1caed55bc7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:32.123914 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ae3ab-21af-4a76-99aa-1caed55bc7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:32.125524 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ae3ab-21af-4a76-99aa-1caed55bc7e3 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:32.139082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1051/2119] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:32.139082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ae3ab-21af-4a76-99aa-1caed55bc7e3 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:32.148779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ae3ab-21af-4a76-99aa-1caed55bc7e3 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:32.154353 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634602b-f0cc-40cb-91de-748dc2065e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:32.154353 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634602b-f0cc-40cb-91de-748dc2065e02 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:32.154659 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634602b-f0cc-40cb-91de-748dc2065e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:32.154918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634602b-f0cc-40cb-91de-748dc2065e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:32.155681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634602b-f0cc-40cb-91de-748dc2065e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:32.156885 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bbf67-7fc7-4465-8b98-44b4d84a285f admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:32.157542 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634602b-f0cc-40cb-91de-748dc2065e02 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:32.168641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb4c30-d099-422c-8ae7-c5142ce0df28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:32.169552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb4c30-d099-422c-8ae7-c5142ce0df28 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:32.169687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb4c30-d099-422c-8ae7-c5142ce0df28 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:32.170071 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb4c30-d099-422c-8ae7-c5142ce0df28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:32.174308 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1052/2120] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:32.179978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634602b-f0cc-40cb-91de-748dc2065e02 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:32.183546 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb4c30-d099-422c-8ae7-c5142ce0df28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:32.185128 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb4c30-d099-422c-8ae7-c5142ce0df28 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:32.191162 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634602b-f0cc-40cb-91de-748dc2065e02 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:32.196132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e1ac7-c843-4e15-9cfa-85abb14baa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:32.197026 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e1ac7-c843-4e15-9cfa-85abb14baa7c admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:32.197503 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e1ac7-c843-4e15-9cfa-85abb14baa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:32.197609 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1069/2121] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:32.197688 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e1ac7-c843-4e15-9cfa-85abb14baa7c admin admin] PATH_INFO: `/v3/projects/179c81d481f7446f808a0fa210576c03/users/2100b5ad592a41459eff21d03d893230/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:32.198265 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb4c30-d099-422c-8ae7-c5142ce0df28 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:32.207846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb4c30-d099-422c-8ae7-c5142ce0df28 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:32.215698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54cb67-f252-414a-a909-280a84e4641d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:32.217176 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54cb67-f252-414a-a909-280a84e4641d admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:32.217555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54cb67-f252-414a-a909-280a84e4641d admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:32.217755 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54cb67-f252-414a-a909-280a84e4641d admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:32.218844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54cb67-f252-414a-a909-280a84e4641d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:32.221070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54cb67-f252-414a-a909-280a84e4641d admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:32.224473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e1ac7-c843-4e15-9cfa-85abb14baa7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=179c81d481f7446f808a0fa210576c03, user_id=2100b5ad592a41459eff21d03d893230, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:32.230703 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e1ac7-c843-4e15-9cfa-85abb14baa7c admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:32.236195 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1070/2122] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:32.240412 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54cb67-f252-414a-a909-280a84e4641d admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:32.253380 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1053/2123] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:32 2022] PUT /identity/v3/projects/179c81d481f7446f808a0fa210576c03/users/2100b5ad592a41459eff21d03d893230/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:32.259068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54cb67-f252-414a-a909-280a84e4641d admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:32.266537 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be8fa8-ea95-4c3b-8d96-1729d9c0aae8 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:32.267268 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be8fa8-ea95-4c3b-8d96-1729d9c0aae8 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:32.267555 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be8fa8-ea95-4c3b-8d96-1729d9c0aae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:32.297199 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-c6be8fa8-ea95-4c3b-8d96-1729d9c0aae8 None None] MFA Rules not processed for user `2100b5ad592a41459eff21d03d893230`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:32.298420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c6be8fa8-ea95-4c3b-8d96-1729d9c0aae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:32.337973 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589fa94-3339-4521-b96b-623139c5aae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:32.338842 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589fa94-3339-4521-b96b-623139c5aae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:32.342386 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589fa94-3339-4521-b96b-623139c5aae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:32.342669 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589fa94-3339-4521-b96b-623139c5aae3 admin admin] PATH_INFO: `/v3/projects/9baa81ed6b14469b8ff227eece439875/users/593e819a31924d9d89d2d6d430a06959/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:32.360555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589fa94-3339-4521-b96b-623139c5aae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9baa81ed6b14469b8ff227eece439875, user_id=593e819a31924d9d89d2d6d430a06959, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:32.363740 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589fa94-3339-4521-b96b-623139c5aae3 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:32.380871 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1054/2124] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:32.393108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be8fa8-ea95-4c3b-8d96-1729d9c0aae8 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:32.394683 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1071/2125] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:32 2022] PUT /identity/v3/projects/9baa81ed6b14469b8ff227eece439875/users/593e819a31924d9d89d2d6d430a06959/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:47:32.395977 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c6be8fa8-ea95-4c3b-8d96-1729d9c0aae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:32.396601 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44468a1-c035-4b17-8013-01c2dede0a3f None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:32.396979 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44468a1-c035-4b17-8013-01c2dede0a3f None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:32.397352 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44468a1-c035-4b17-8013-01c2dede0a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:32.427534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-b44468a1-c035-4b17-8013-01c2dede0a3f None None] MFA Rules not processed for user `593e819a31924d9d89d2d6d430a06959`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:32.429206 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-b44468a1-c035-4b17-8013-01c2dede0a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:32.466061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be8fa8-ea95-4c3b-8d96-1729d9c0aae8 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:32.503591 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1072/2126] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:32 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:32.531013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316072fb-12eb-408d-90a6-cda164510ff3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:32.531757 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316072fb-12eb-408d-90a6-cda164510ff3 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:32.532043 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316072fb-12eb-408d-90a6-cda164510ff3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:32.532377 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316072fb-12eb-408d-90a6-cda164510ff3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:32.546199 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44468a1-c035-4b17-8013-01c2dede0a3f None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:32.547798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-b44468a1-c035-4b17-8013-01c2dede0a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:32.561395 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44468a1-c035-4b17-8013-01c2dede0a3f None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:32.565231 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca8426-2ddb-4a37-a5c5-2e76b9ce1dc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:32.565894 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca8426-2ddb-4a37-a5c5-2e76b9ce1dc3 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:32.575307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca8426-2ddb-4a37-a5c5-2e76b9ce1dc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:32.575742 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca8426-2ddb-4a37-a5c5-2e76b9ce1dc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:32.597100 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca8426-2ddb-4a37-a5c5-2e76b9ce1dc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:32.598590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca8426-2ddb-4a37-a5c5-2e76b9ce1dc3 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:32.624598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1073/2127] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:32 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:47:32.626667 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca8426-2ddb-4a37-a5c5-2e76b9ce1dc3 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:32.627455 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316072fb-12eb-408d-90a6-cda164510ff3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:32.629003 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316072fb-12eb-408d-90a6-cda164510ff3 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:32.639854 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1055/2128] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:32.713407 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca8426-2ddb-4a37-a5c5-2e76b9ce1dc3 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:32.718719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7b0ec-b748-4593-bf29-dffc1b3946a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:32.719636 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7b0ec-b748-4593-bf29-dffc1b3946a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:32.719919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7b0ec-b748-4593-bf29-dffc1b3946a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:32.720314 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7b0ec-b748-4593-bf29-dffc1b3946a4 admin admin] PATH_INFO: `/v3/users/593e819a31924d9d89d2d6d430a06959` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:32.721568 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7b0ec-b748-4593-bf29-dffc1b3946a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=593e819a31924d9d89d2d6d430a06959)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:32.723588 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7b0ec-b748-4593-bf29-dffc1b3946a4 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:32.777596 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a7b7b0ec-b748-4593-bf29-dffc1b3946a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '593e819a31924d9d89d2d6d430a06959'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:32.786896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a7b7b0ec-b748-4593-bf29-dffc1b3946a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '593e819a31924d9d89d2d6d430a06959'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:32.788063 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a7b7b0ec-b748-4593-bf29-dffc1b3946a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '593e819a31924d9d89d2d6d430a06959'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:32.804677 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a7b7b0ec-b748-4593-bf29-dffc1b3946a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '593e819a31924d9d89d2d6d430a06959'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:32.813889 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a7b7b0ec-b748-4593-bf29-dffc1b3946a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '593e819a31924d9d89d2d6d430a06959'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:32.825495 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1074/2129] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:32 2022] DELETE /identity/v3/users/593e819a31924d9d89d2d6d430a06959 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:47:32.830015 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f311d-96e6-4cf9-98df-e179981e7245 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:32.830423 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f311d-96e6-4cf9-98df-e179981e7245 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:32.830670 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f311d-96e6-4cf9-98df-e179981e7245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:32.849060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-af6f311d-96e6-4cf9-98df-e179981e7245 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:32.850209 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-af6f311d-96e6-4cf9-98df-e179981e7245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:32.916262 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1056/2130] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:47:32.923853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7b0ec-b748-4593-bf29-dffc1b3946a4 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:32.926093 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a7b7b0ec-b748-4593-bf29-dffc1b3946a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:33.060378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7b0ec-b748-4593-bf29-dffc1b3946a4 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:33.065927 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c944f9-7b6c-42cd-89dd-cdc62baa723c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:33.065927 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c944f9-7b6c-42cd-89dd-cdc62baa723c service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:33.066187 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c944f9-7b6c-42cd-89dd-cdc62baa723c service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:33.066477 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c944f9-7b6c-42cd-89dd-cdc62baa723c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:33.078359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c944f9-7b6c-42cd-89dd-cdc62baa723c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:33.079835 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c944f9-7b6c-42cd-89dd-cdc62baa723c service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:33.091948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1075/2131] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:47:33.725381 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f311d-96e6-4cf9-98df-e179981e7245 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:33.726935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-af6f311d-96e6-4cf9-98df-e179981e7245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:33.741093 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f311d-96e6-4cf9-98df-e179981e7245 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:33.748605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb180243-86c1-401d-9760-a320f93a588e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:33.749867 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb180243-86c1-401d-9760-a320f93a588e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:33.750204 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb180243-86c1-401d-9760-a320f93a588e admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:33.750538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb180243-86c1-401d-9760-a320f93a588e admin admin] PATH_INFO: `/v3/projects/9baa81ed6b14469b8ff227eece439875` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:33.752113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb180243-86c1-401d-9760-a320f93a588e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9baa81ed6b14469b8ff227eece439875)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:33.758386 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb180243-86c1-401d-9760-a320f93a588e admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:33.837344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-bb180243-86c1-401d-9760-a320f93a588e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9baa81ed6b14469b8ff227eece439875', 'request_id': 'req-bb180243-86c1-401d-9760-a320f93a588e'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:33.844450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-bb180243-86c1-401d-9760-a320f93a588e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9baa81ed6b14469b8ff227eece439875', 'request_id': 'req-bb180243-86c1-401d-9760-a320f93a588e'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:33.853436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-bb180243-86c1-401d-9760-a320f93a588e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9baa81ed6b14469b8ff227eece439875', 'request_id': 'req-bb180243-86c1-401d-9760-a320f93a588e'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:33.868654 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-bb180243-86c1-401d-9760-a320f93a588e admin admin] The token cache is being invalidate because project 9baa81ed6b14469b8ff227eece439875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:33.869004 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-bb180243-86c1-401d-9760-a320f93a588e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:33.869660 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-bb180243-86c1-401d-9760-a320f93a588e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:33.871546 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1057/2132] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:33 2022] DELETE /identity/v3/projects/9baa81ed6b14469b8ff227eece439875 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:33.877570 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ff1fc-f30e-4906-ad9c-760b803991a2 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:33.878098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ff1fc-f30e-4906-ad9c-760b803991a2 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:33.878291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ff1fc-f30e-4906-ad9c-760b803991a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:33.898186 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-3e7ff1fc-f30e-4906-ad9c-760b803991a2 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:33.899653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-3e7ff1fc-f30e-4906-ad9c-760b803991a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:33.998855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1076/2133] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:34.007251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2c46d-022a-4394-be15-7c011fe4fc48 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:34.007570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2c46d-022a-4394-be15-7c011fe4fc48 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:34.007860 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2c46d-022a-4394-be15-7c011fe4fc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:34.059791 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-81a2c46d-022a-4394-be15-7c011fe4fc48 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:34.061347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-81a2c46d-022a-4394-be15-7c011fe4fc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:34.079659 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1058/2134] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:34.083059 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ff1fc-f30e-4906-ad9c-760b803991a2 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:34.110717 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ff1fc-f30e-4906-ad9c-760b803991a2 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:34.140600 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0c8e1-44bf-48f1-b319-58301298a181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:34.141355 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0c8e1-44bf-48f1-b319-58301298a181 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:34.141708 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0c8e1-44bf-48f1-b319-58301298a181 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:34.142051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0c8e1-44bf-48f1-b319-58301298a181 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:34.142855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0c8e1-44bf-48f1-b319-58301298a181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:47:34.143280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0c8e1-44bf-48f1-b319-58301298a181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:34.145101 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0c8e1-44bf-48f1-b319-58301298a181 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:34.160605 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1077/2135] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:47:34.162880 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2c46d-022a-4394-be15-7c011fe4fc48 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:34.174170 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2c46d-022a-4394-be15-7c011fe4fc48 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:34.181450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde70aa4-0687-4aa0-a0b6-74137e244ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:34.182222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde70aa4-0687-4aa0-a0b6-74137e244ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:34.182611 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde70aa4-0687-4aa0-a0b6-74137e244ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:34.182960 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde70aa4-0687-4aa0-a0b6-74137e244ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:34.183783 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde70aa4-0687-4aa0-a0b6-74137e244ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:34.186601 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde70aa4-0687-4aa0-a0b6-74137e244ed4 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:34.243987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1059/2136] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:34 2022] POST /identity/v3/projects => generated 363 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:34.245247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0c8e1-44bf-48f1-b319-58301298a181 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:34.258868 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0c8e1-44bf-48f1-b319-58301298a181 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:34.351862 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d227b-a6e9-4984-af14-6a2a16f108ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:34.352563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d227b-a6e9-4984-af14-6a2a16f108ba admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:34.352925 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d227b-a6e9-4984-af14-6a2a16f108ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:34.353202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d227b-a6e9-4984-af14-6a2a16f108ba admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:34.354049 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d227b-a6e9-4984-af14-6a2a16f108ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:34.356294 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d227b-a6e9-4984-af14-6a2a16f108ba admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:34.408941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1078/2137] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:34 2022] POST /identity/v3/users => generated 282 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:34.410244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde70aa4-0687-4aa0-a0b6-74137e244ed4 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:34.426070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde70aa4-0687-4aa0-a0b6-74137e244ed4 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:34.432662 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10cf80-f958-4c1f-a519-9a422e60a16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:34.434044 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10cf80-f958-4c1f-a519-9a422e60a16f admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:34.434330 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10cf80-f958-4c1f-a519-9a422e60a16f admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:34.434618 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10cf80-f958-4c1f-a519-9a422e60a16f admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:34.439534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10cf80-f958-4c1f-a519-9a422e60a16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:34.439534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10cf80-f958-4c1f-a519-9a422e60a16f admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:34.453114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1060/2138] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:34.454289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d227b-a6e9-4984-af14-6a2a16f108ba admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:34.467334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d227b-a6e9-4984-af14-6a2a16f108ba admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:34.499034 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244be0bd-758d-47fd-a45e-8e1a153fb3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:34.499034 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244be0bd-758d-47fd-a45e-8e1a153fb3fa admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:34.499034 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244be0bd-758d-47fd-a45e-8e1a153fb3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:34.499034 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244be0bd-758d-47fd-a45e-8e1a153fb3fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:34.499482 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244be0bd-758d-47fd-a45e-8e1a153fb3fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:34.502489 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244be0bd-758d-47fd-a45e-8e1a153fb3fa admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:34.535645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1079/2139] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:47:34.536980 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10cf80-f958-4c1f-a519-9a422e60a16f admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:34.562942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10cf80-f958-4c1f-a519-9a422e60a16f admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:34.569770 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a2878-6448-4eed-b395-cec845f8d896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:34.570818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a2878-6448-4eed-b395-cec845f8d896 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:34.571253 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a2878-6448-4eed-b395-cec845f8d896 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:34.571632 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a2878-6448-4eed-b395-cec845f8d896 admin admin] PATH_INFO: `/v3/projects/4faa75c015664228bf946e70eb0a5b11/users/99b1ce7107a342a1b38bd86fd238e463/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:34.599331 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a2878-6448-4eed-b395-cec845f8d896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4faa75c015664228bf946e70eb0a5b11, user_id=99b1ce7107a342a1b38bd86fd238e463, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:34.602554 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a2878-6448-4eed-b395-cec845f8d896 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:34.619738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1061/2140] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:34 2022] PUT /identity/v3/projects/4faa75c015664228bf946e70eb0a5b11/users/99b1ce7107a342a1b38bd86fd238e463/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:34.631964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1bf7d-ca0e-4ca0-b32d-6a0b6b581962 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:34.632268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1bf7d-ca0e-4ca0-b32d-6a0b6b581962 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:34.632554 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1bf7d-ca0e-4ca0-b32d-6a0b6b581962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:34.667254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-86c1bf7d-ca0e-4ca0-b32d-6a0b6b581962 None None] MFA Rules not processed for user `99b1ce7107a342a1b38bd86fd238e463`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:34.668484 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-86c1bf7d-ca0e-4ca0-b32d-6a0b6b581962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:34.773894 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1080/2141] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:34.786785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a2878-6448-4eed-b395-cec845f8d896 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:34.788659 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f87a2878-6448-4eed-b395-cec845f8d896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:34.860629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a2878-6448-4eed-b395-cec845f8d896 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:34.865057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164362a3-2ce1-4364-af7a-2f58b2242804 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:34.865726 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164362a3-2ce1-4364-af7a-2f58b2242804 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:34.866013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164362a3-2ce1-4364-af7a-2f58b2242804 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:34.866357 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164362a3-2ce1-4364-af7a-2f58b2242804 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:34.877034 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164362a3-2ce1-4364-af7a-2f58b2242804 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:34.878528 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164362a3-2ce1-4364-af7a-2f58b2242804 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:34.888806 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1062/2142] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:34 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:37.220305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a6044-ef84-4cb7-8b1d-e2962d0f6da8 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:37.220814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a6044-ef84-4cb7-8b1d-e2962d0f6da8 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:37.221042 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a6044-ef84-4cb7-8b1d-e2962d0f6da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:37.250494 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-5b6a6044-ef84-4cb7-8b1d-e2962d0f6da8 None None] MFA Rules not processed for user `0196716439d4473498c7c4b15a1e1d24`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:37.251741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5b6a6044-ef84-4cb7-8b1d-e2962d0f6da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:37.347588 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1081/2143] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:37.354463 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164362a3-2ce1-4364-af7a-2f58b2242804 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:37.356117 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-164362a3-2ce1-4364-af7a-2f58b2242804 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:37.429131 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164362a3-2ce1-4364-af7a-2f58b2242804 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:37.435140 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b397d0-4e02-45a9-adaf-8968d56182f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:37.435860 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b397d0-4e02-45a9-adaf-8968d56182f6 service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:37.436277 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b397d0-4e02-45a9-adaf-8968d56182f6 service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:37.436585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b397d0-4e02-45a9-adaf-8968d56182f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:37.445093 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b397d0-4e02-45a9-adaf-8968d56182f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:37.446676 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b397d0-4e02-45a9-adaf-8968d56182f6 service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:37.455603 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1063/2144] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:39.401651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44446a-274a-4013-8567-8c8a1b38fb1e None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:39.402126 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44446a-274a-4013-8567-8c8a1b38fb1e None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:39.402205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44446a-274a-4013-8567-8c8a1b38fb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:39.434334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-7f44446a-274a-4013-8567-8c8a1b38fb1e None None] MFA Rules not processed for user `0196716439d4473498c7c4b15a1e1d24`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:39.436235 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-7f44446a-274a-4013-8567-8c8a1b38fb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:39.446140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1082/2145] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:55.624061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b397d0-4e02-45a9-adaf-8968d56182f6 service nova] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:55.625628 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-95b397d0-4e02-45a9-adaf-8968d56182f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:55.698413 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b397d0-4e02-45a9-adaf-8968d56182f6 service nova] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:55.704022 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7c17c-2c45-4a6c-aba2-a4532f25f1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:55.704992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7c17c-2c45-4a6c-aba2-a4532f25f1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:55.705278 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7c17c-2c45-4a6c-aba2-a4532f25f1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:55.705566 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7c17c-2c45-4a6c-aba2-a4532f25f1f9 admin admin] PATH_INFO: `/v3/users/2100b5ad592a41459eff21d03d893230` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:55.706829 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7c17c-2c45-4a6c-aba2-a4532f25f1f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2100b5ad592a41459eff21d03d893230)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:55.708810 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7c17c-2c45-4a6c-aba2-a4532f25f1f9 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:55.759247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-27f7c17c-2c45-4a6c-aba2-a4532f25f1f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2100b5ad592a41459eff21d03d893230'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:55.768444 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-27f7c17c-2c45-4a6c-aba2-a4532f25f1f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2100b5ad592a41459eff21d03d893230'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:55.778822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-27f7c17c-2c45-4a6c-aba2-a4532f25f1f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2100b5ad592a41459eff21d03d893230'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:55.779715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-27f7c17c-2c45-4a6c-aba2-a4532f25f1f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2100b5ad592a41459eff21d03d893230'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:55.780438 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-27f7c17c-2c45-4a6c-aba2-a4532f25f1f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2100b5ad592a41459eff21d03d893230'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:55.804907 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1064/2146] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:47:55 2022] DELETE /identity/v3/users/2100b5ad592a41459eff21d03d893230 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:55.812539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90c01b-2649-4e81-a4d5-d052f65fd7f4 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:55.813123 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90c01b-2649-4e81-a4d5-d052f65fd7f4 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:55.813123 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90c01b-2649-4e81-a4d5-d052f65fd7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:55.844463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-8f90c01b-2649-4e81-a4d5-d052f65fd7f4 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:55.845856 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-8f90c01b-2649-4e81-a4d5-d052f65fd7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:55.919544 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1083/2147] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:55.929474 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7c17c-2c45-4a6c-aba2-a4532f25f1f9 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:55.931108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-27f7c17c-2c45-4a6c-aba2-a4532f25f1f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:55.992816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7c17c-2c45-4a6c-aba2-a4532f25f1f9 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:55.996740 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe7d5d-44ba-424e-af59-cd752ee50e80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:55.997300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe7d5d-44ba-424e-af59-cd752ee50e80 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:55.997512 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe7d5d-44ba-424e-af59-cd752ee50e80 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:55.997783 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe7d5d-44ba-424e-af59-cd752ee50e80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:56.009347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe7d5d-44ba-424e-af59-cd752ee50e80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:56.011778 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe7d5d-44ba-424e-af59-cd752ee50e80 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:56.024281 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1065/2148] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:56.346384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90c01b-2649-4e81-a4d5-d052f65fd7f4 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:56.348304 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-8f90c01b-2649-4e81-a4d5-d052f65fd7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:56.371105 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90c01b-2649-4e81-a4d5-d052f65fd7f4 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:56.376091 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b72bf-f8ff-4759-a67e-cbdd159010a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:56.377107 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b72bf-f8ff-4759-a67e-cbdd159010a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:56.377462 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b72bf-f8ff-4759-a67e-cbdd159010a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:56.377814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b72bf-f8ff-4759-a67e-cbdd159010a6 admin admin] PATH_INFO: `/v3/projects/179c81d481f7446f808a0fa210576c03` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:56.380683 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b72bf-f8ff-4759-a67e-cbdd159010a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=179c81d481f7446f808a0fa210576c03)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:56.382377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b72bf-f8ff-4759-a67e-cbdd159010a6 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:56.430159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-df8b72bf-f8ff-4759-a67e-cbdd159010a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '179c81d481f7446f808a0fa210576c03', 'request_id': 'req-df8b72bf-f8ff-4759-a67e-cbdd159010a6'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:56.439572 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-df8b72bf-f8ff-4759-a67e-cbdd159010a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '179c81d481f7446f808a0fa210576c03', 'request_id': 'req-df8b72bf-f8ff-4759-a67e-cbdd159010a6'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:56.446592 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-df8b72bf-f8ff-4759-a67e-cbdd159010a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '179c81d481f7446f808a0fa210576c03', 'request_id': 'req-df8b72bf-f8ff-4759-a67e-cbdd159010a6'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:56.457577 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-df8b72bf-f8ff-4759-a67e-cbdd159010a6 admin admin] The token cache is being invalidate because project 179c81d481f7446f808a0fa210576c03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:47:56.457864 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-df8b72bf-f8ff-4759-a67e-cbdd159010a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:56.458509 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-df8b72bf-f8ff-4759-a67e-cbdd159010a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:47:56.460105 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1084/2149] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:47:56 2022] DELETE /identity/v3/projects/179c81d481f7446f808a0fa210576c03 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:56.465368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9e75f-5f7a-4894-aac8-9f416e2c66de None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:56.465658 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9e75f-5f7a-4894-aac8-9f416e2c66de None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:56.465937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9e75f-5f7a-4894-aac8-9f416e2c66de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:56.484832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-28d9e75f-5f7a-4894-aac8-9f416e2c66de None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:56.485964 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-28d9e75f-5f7a-4894-aac8-9f416e2c66de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:56.548054 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1066/2150] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:47:56.556247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc95f6-4a18-4b1a-ab9d-58f4b037ecbe None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:56.556838 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc95f6-4a18-4b1a-ab9d-58f4b037ecbe None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:56.557122 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc95f6-4a18-4b1a-ab9d-58f4b037ecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:56.576727 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-09fc95f6-4a18-4b1a-ab9d-58f4b037ecbe None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:56.577931 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-09fc95f6-4a18-4b1a-ab9d-58f4b037ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:56.586898 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1085/2151] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:56.591351 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9e75f-5f7a-4894-aac8-9f416e2c66de None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:56.601394 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9e75f-5f7a-4894-aac8-9f416e2c66de None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:56.606767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d8cba-6ff0-44ad-ba7b-0b227f1de467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:56.607472 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d8cba-6ff0-44ad-ba7b-0b227f1de467 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:56.607754 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d8cba-6ff0-44ad-ba7b-0b227f1de467 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:56.608031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d8cba-6ff0-44ad-ba7b-0b227f1de467 admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:56.608763 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d8cba-6ff0-44ad-ba7b-0b227f1de467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:47:56.609076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d8cba-6ff0-44ad-ba7b-0b227f1de467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:56.610689 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d8cba-6ff0-44ad-ba7b-0b227f1de467 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:56.623402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1067/2152] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:47:56.629556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc95f6-4a18-4b1a-ab9d-58f4b037ecbe None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:56.643803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc95f6-4a18-4b1a-ab9d-58f4b037ecbe None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:56.651269 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a137d-c220-4c0c-b4ad-d53f7112542c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:56.651979 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a137d-c220-4c0c-b4ad-d53f7112542c admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:56.652288 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a137d-c220-4c0c-b4ad-d53f7112542c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:56.652560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a137d-c220-4c0c-b4ad-d53f7112542c admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:56.653352 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a137d-c220-4c0c-b4ad-d53f7112542c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:56.655316 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a137d-c220-4c0c-b4ad-d53f7112542c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:56.701228 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1086/2153] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:47:56 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:56.707133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d8cba-6ff0-44ad-ba7b-0b227f1de467 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:56.718884 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d8cba-6ff0-44ad-ba7b-0b227f1de467 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:56.784029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476ee55-a682-4a96-8303-16b08936c3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:56.784707 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476ee55-a682-4a96-8303-16b08936c3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:56.784995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476ee55-a682-4a96-8303-16b08936c3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:56.785277 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476ee55-a682-4a96-8303-16b08936c3e9 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:56.786005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476ee55-a682-4a96-8303-16b08936c3e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:56.788026 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476ee55-a682-4a96-8303-16b08936c3e9 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:56.811398 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1068/2154] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:47:56 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:47:56.816411 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a137d-c220-4c0c-b4ad-d53f7112542c admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:56.827642 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a137d-c220-4c0c-b4ad-d53f7112542c admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:56.833476 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6249e99-dfa7-416a-9de9-78b6ab5b1479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:56.834143 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6249e99-dfa7-416a-9de9-78b6ab5b1479 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:56.834426 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6249e99-dfa7-416a-9de9-78b6ab5b1479 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:56.834708 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6249e99-dfa7-416a-9de9-78b6ab5b1479 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:56.835468 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6249e99-dfa7-416a-9de9-78b6ab5b1479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:56.837067 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6249e99-dfa7-416a-9de9-78b6ab5b1479 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:56.851105 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1087/2155] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:56.856565 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476ee55-a682-4a96-8303-16b08936c3e9 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:56.867506 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476ee55-a682-4a96-8303-16b08936c3e9 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:56.872869 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd15b4-99f8-451f-bd34-e7f0eca3d728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:56.873542 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd15b4-99f8-451f-bd34-e7f0eca3d728 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:56.873822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd15b4-99f8-451f-bd34-e7f0eca3d728 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:56.874099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd15b4-99f8-451f-bd34-e7f0eca3d728 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:56.874821 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd15b4-99f8-451f-bd34-e7f0eca3d728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:56.876582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd15b4-99f8-451f-bd34-e7f0eca3d728 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:56.890205 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1069/2156] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:47:56.896152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6249e99-dfa7-416a-9de9-78b6ab5b1479 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:56.909358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6249e99-dfa7-416a-9de9-78b6ab5b1479 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:56.915402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5434e47-b801-47a5-b237-f38bc4fc627e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:56.916803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5434e47-b801-47a5-b237-f38bc4fc627e admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:56.917090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5434e47-b801-47a5-b237-f38bc4fc627e admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:56.917374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5434e47-b801-47a5-b237-f38bc4fc627e admin admin] PATH_INFO: `/v3/projects/df1112183d9b427aab35174082d08212/users/620b3bc722474b14b933c6c8ce20dafe/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:56.936764 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5434e47-b801-47a5-b237-f38bc4fc627e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1112183d9b427aab35174082d08212, user_id=620b3bc722474b14b933c6c8ce20dafe, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:56.940499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5434e47-b801-47a5-b237-f38bc4fc627e admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:56.963399 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1088/2157] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:47:56 2022] PUT /identity/v3/projects/df1112183d9b427aab35174082d08212/users/620b3bc722474b14b933c6c8ce20dafe/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:47:56.971009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcb629-1b1e-4b50-b65d-988435f4786b None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:56.971330 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcb629-1b1e-4b50-b65d-988435f4786b None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:56.971610 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcb629-1b1e-4b50-b65d-988435f4786b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:56.990740 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-38fcb629-1b1e-4b50-b65d-988435f4786b None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:56.991878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-38fcb629-1b1e-4b50-b65d-988435f4786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:57.048840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1070/2158] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:57.059197 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5434e47-b801-47a5-b237-f38bc4fc627e admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:57.061115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-f5434e47-b801-47a5-b237-f38bc4fc627e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:57.118339 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5434e47-b801-47a5-b237-f38bc4fc627e admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:57.122286 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9a369-aac3-4009-87dc-dd456f2016b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:57.122886 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a369-aac3-4009-87dc-dd456f2016b1 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:57.123218 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a369-aac3-4009-87dc-dd456f2016b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:57.123501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a369-aac3-4009-87dc-dd456f2016b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:57.132819 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9a369-aac3-4009-87dc-dd456f2016b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:57.134259 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9a369-aac3-4009-87dc-dd456f2016b1 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:57.144307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1089/2159] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:02.020616 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123281b4-d328-4f39-a972-6092d33e67a3 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:02.021484 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123281b4-d328-4f39-a972-6092d33e67a3 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:02.021962 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123281b4-d328-4f39-a972-6092d33e67a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:02.052625 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-123281b4-d328-4f39-a972-6092d33e67a3 None None] MFA Rules not processed for user `620b3bc722474b14b933c6c8ce20dafe`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:02.053860 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-123281b4-d328-4f39-a972-6092d33e67a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:02.163366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1071/2160] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:02.168784 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9a369-aac3-4009-87dc-dd456f2016b1 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:02.186817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9a369-aac3-4009-87dc-dd456f2016b1 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:02.192492 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874b4db-5dbd-474d-8401-40198c4ff55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:02.193384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874b4db-5dbd-474d-8401-40198c4ff55b admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:02.193891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874b4db-5dbd-474d-8401-40198c4ff55b admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:02.194383 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874b4db-5dbd-474d-8401-40198c4ff55b admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:02.195312 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874b4db-5dbd-474d-8401-40198c4ff55b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:02.197542 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874b4db-5dbd-474d-8401-40198c4ff55b admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:02.226843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1090/2161] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:48:02 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:02.231623 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123281b4-d328-4f39-a972-6092d33e67a3 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:02.246758 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123281b4-d328-4f39-a972-6092d33e67a3 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:02.305474 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cf0d5-650b-41d7-86e1-30861414d445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:02.306457 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cf0d5-650b-41d7-86e1-30861414d445 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:02.306747 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cf0d5-650b-41d7-86e1-30861414d445 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:02.307023 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cf0d5-650b-41d7-86e1-30861414d445 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:02.307776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700cf0d5-650b-41d7-86e1-30861414d445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:02.309694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700cf0d5-650b-41d7-86e1-30861414d445 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:02.331537 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1072/2162] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:48:02 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:02.335748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874b4db-5dbd-474d-8401-40198c4ff55b admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:02.346523 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874b4db-5dbd-474d-8401-40198c4ff55b admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:02.351130 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02451090-08e4-4dd3-a6a4-fe9e482aa777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:02.351794 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02451090-08e4-4dd3-a6a4-fe9e482aa777 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:02.352078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02451090-08e4-4dd3-a6a4-fe9e482aa777 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:02.352373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02451090-08e4-4dd3-a6a4-fe9e482aa777 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:02.353284 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02451090-08e4-4dd3-a6a4-fe9e482aa777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:02.355240 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02451090-08e4-4dd3-a6a4-fe9e482aa777 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:02.367439 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1091/2163] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:02.373046 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cf0d5-650b-41d7-86e1-30861414d445 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:02.385066 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cf0d5-650b-41d7-86e1-30861414d445 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:02.390212 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f18095-a2b0-4665-8f1d-70c8a551b065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:02.391231 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f18095-a2b0-4665-8f1d-70c8a551b065 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:02.391573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f18095-a2b0-4665-8f1d-70c8a551b065 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:02.391915 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f18095-a2b0-4665-8f1d-70c8a551b065 admin admin] PATH_INFO: `/v3/projects/311eafe6fcb74845af20139a0cf26d2b/users/3552097ba0194960a6ab9a1a94736077/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:02.407677 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f18095-a2b0-4665-8f1d-70c8a551b065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=311eafe6fcb74845af20139a0cf26d2b, user_id=3552097ba0194960a6ab9a1a94736077, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:02.410477 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f18095-a2b0-4665-8f1d-70c8a551b065 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:02.431436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1073/2164] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:48:02 2022] PUT /identity/v3/projects/311eafe6fcb74845af20139a0cf26d2b/users/3552097ba0194960a6ab9a1a94736077/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:02.434565 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02451090-08e4-4dd3-a6a4-fe9e482aa777 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:02.449567 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02451090-08e4-4dd3-a6a4-fe9e482aa777 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:02.522283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706dab09-9151-43ee-8da5-3ab11dd56391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:02.523028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dab09-9151-43ee-8da5-3ab11dd56391 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:02.523438 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dab09-9151-43ee-8da5-3ab11dd56391 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:02.523738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dab09-9151-43ee-8da5-3ab11dd56391 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:02.524931 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706dab09-9151-43ee-8da5-3ab11dd56391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:02.526541 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706dab09-9151-43ee-8da5-3ab11dd56391 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:02.538004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1092/2165] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:02.542420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f18095-a2b0-4665-8f1d-70c8a551b065 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:02.553151 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f18095-a2b0-4665-8f1d-70c8a551b065 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:02.558308 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bdacc-144f-46f6-8b8e-79e0c57f1c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:02.560491 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bdacc-144f-46f6-8b8e-79e0c57f1c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:02.561046 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bdacc-144f-46f6-8b8e-79e0c57f1c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:02.561340 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bdacc-144f-46f6-8b8e-79e0c57f1c41 admin admin] PATH_INFO: `/v3/projects/311eafe6fcb74845af20139a0cf26d2b/users/3552097ba0194960a6ab9a1a94736077/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:02.564523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bdacc-144f-46f6-8b8e-79e0c57f1c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=311eafe6fcb74845af20139a0cf26d2b, user_id=3552097ba0194960a6ab9a1a94736077, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:02.572933 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bdacc-144f-46f6-8b8e-79e0c57f1c41 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:02.603121 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1074/2166] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:48:02 2022] PUT /identity/v3/projects/311eafe6fcb74845af20139a0cf26d2b/users/3552097ba0194960a6ab9a1a94736077/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:08.521291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb3e80-22c6-4348-b66f-eb0c6ff5f86f None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:08.522295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb3e80-22c6-4348-b66f-eb0c6ff5f86f None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:08.522724 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb3e80-22c6-4348-b66f-eb0c6ff5f86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:08.558835 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-bdcb3e80-22c6-4348-b66f-eb0c6ff5f86f None None] MFA Rules not processed for user `3552097ba0194960a6ab9a1a94736077`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:08.560648 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-bdcb3e80-22c6-4348-b66f-eb0c6ff5f86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:08.655740 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1093/2167] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:08.666427 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bdacc-144f-46f6-8b8e-79e0c57f1c41 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:08.668299 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-2e3bdacc-144f-46f6-8b8e-79e0c57f1c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:08.750670 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bdacc-144f-46f6-8b8e-79e0c57f1c41 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:08.758351 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb5af1-047c-40c0-8dac-f559527ca892 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c61205d7e96f496ab9f8ca84ab9408b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:08.759618 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb5af1-047c-40c0-8dac-f559527ca892 service glance] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:08.766414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb5af1-047c-40c0-8dac-f559527ca892 service glance] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:08.766414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb5af1-047c-40c0-8dac-f559527ca892 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:08.829506 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb5af1-047c-40c0-8dac-f559527ca892 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:08.831905 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb5af1-047c-40c0-8dac-f559527ca892 service glance] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:08.843637 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1075/2168] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:48:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:09.009047 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d8d4d-9e2d-48e5-9374-7d90e69b5fee None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:09.009582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d8d4d-9e2d-48e5-9374-7d90e69b5fee None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:09.009863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d8d4d-9e2d-48e5-9374-7d90e69b5fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:09.029270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-a31d8d4d-9e2d-48e5-9374-7d90e69b5fee None None] MFA Rules not processed for user `82b2e79995f94ab880f5d798ddd649b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:09.030722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a31d8d4d-9e2d-48e5-9374-7d90e69b5fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:09.097072 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1094/2169] 10.222.0.11 () {58 vars in 1009 bytes} [Wed May 4 21:48:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:09.146588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb5af1-047c-40c0-8dac-f559527ca892 service glance] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:09.148191 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-2dfb5af1-047c-40c0-8dac-f559527ca892 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:09.224327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb5af1-047c-40c0-8dac-f559527ca892 service glance] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:09.229442 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7a56b-42c7-49b7-ada9-5be6ee1c8cdd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8358da535a104873ad9f5676989a9e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:09.230095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7a56b-42c7-49b7-ada9-5be6ee1c8cdd service swift] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:09.230373 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7a56b-42c7-49b7-ada9-5be6ee1c8cdd service swift] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:09.230647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7a56b-42c7-49b7-ada9-5be6ee1c8cdd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:09.239067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7a56b-42c7-49b7-ada9-5be6ee1c8cdd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:09.240671 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7a56b-42c7-49b7-ada9-5be6ee1c8cdd service swift] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:09.248939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1076/2170] 10.222.0.11 () {60 vars in 1384 bytes} [Wed May 4 21:48:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:48:17.379482 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d8d4d-9e2d-48e5-9374-7d90e69b5fee None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:17.381592 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a31d8d4d-9e2d-48e5-9374-7d90e69b5fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:17.468893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d8d4d-9e2d-48e5-9374-7d90e69b5fee None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:17.473808 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467908f-3e7a-4b4f-b510-b660c586bfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:17.474690 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467908f-3e7a-4b4f-b510-b660c586bfac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:17.474967 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467908f-3e7a-4b4f-b510-b660c586bfac admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:17.475325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467908f-3e7a-4b4f-b510-b660c586bfac admin admin] PATH_INFO: `/v3/users/a850681b05804936bfe9f3988b34241c` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:17.476609 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467908f-3e7a-4b4f-b510-b660c586bfac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a850681b05804936bfe9f3988b34241c)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:17.478999 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467908f-3e7a-4b4f-b510-b660c586bfac admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:17.530606 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-9467908f-3e7a-4b4f-b510-b660c586bfac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a850681b05804936bfe9f3988b34241c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:17.538673 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-9467908f-3e7a-4b4f-b510-b660c586bfac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a850681b05804936bfe9f3988b34241c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:17.539676 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-9467908f-3e7a-4b4f-b510-b660c586bfac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a850681b05804936bfe9f3988b34241c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:17.557054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-9467908f-3e7a-4b4f-b510-b660c586bfac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a850681b05804936bfe9f3988b34241c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:17.565503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-9467908f-3e7a-4b4f-b510-b660c586bfac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a850681b05804936bfe9f3988b34241c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:17.572483 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1095/2171] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:48:17 2022] DELETE /identity/v3/users/a850681b05804936bfe9f3988b34241c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:17.577245 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ced74-5f53-4827-af1e-335da31116a1 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:17.577785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ced74-5f53-4827-af1e-335da31116a1 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:17.577785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ced74-5f53-4827-af1e-335da31116a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:17.596486 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-ea4ced74-5f53-4827-af1e-335da31116a1 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:17.597838 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ea4ced74-5f53-4827-af1e-335da31116a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:17.671594 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1077/2172] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:17.682340 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467908f-3e7a-4b4f-b510-b660c586bfac admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:17.683827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-9467908f-3e7a-4b4f-b510-b660c586bfac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:17.746998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467908f-3e7a-4b4f-b510-b660c586bfac admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:17.750608 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a912a-7812-4eeb-9f8f-62b1962bd34a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:17.751305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a912a-7812-4eeb-9f8f-62b1962bd34a service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:17.751588 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a912a-7812-4eeb-9f8f-62b1962bd34a service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:17.751862 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a912a-7812-4eeb-9f8f-62b1962bd34a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:17.765997 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a912a-7812-4eeb-9f8f-62b1962bd34a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:17.770900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a912a-7812-4eeb-9f8f-62b1962bd34a service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:17.791483 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1096/2173] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:48:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:18.117111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ced74-5f53-4827-af1e-335da31116a1 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:18.118572 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ea4ced74-5f53-4827-af1e-335da31116a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:18.131446 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ced74-5f53-4827-af1e-335da31116a1 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:18.137002 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414dba7-babd-4380-9b75-b95774139b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:18.137879 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414dba7-babd-4380-9b75-b95774139b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:18.138160 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414dba7-babd-4380-9b75-b95774139b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:18.138440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414dba7-babd-4380-9b75-b95774139b6a admin admin] PATH_INFO: `/v3/projects/c602a3571f6d4d48ad6de57d1f302bb1` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:18.139771 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414dba7-babd-4380-9b75-b95774139b6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c602a3571f6d4d48ad6de57d1f302bb1)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:18.141936 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414dba7-babd-4380-9b75-b95774139b6a admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:18.200605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-6414dba7-babd-4380-9b75-b95774139b6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c602a3571f6d4d48ad6de57d1f302bb1', 'request_id': 'req-6414dba7-babd-4380-9b75-b95774139b6a'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:18.207630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-6414dba7-babd-4380-9b75-b95774139b6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c602a3571f6d4d48ad6de57d1f302bb1', 'request_id': 'req-6414dba7-babd-4380-9b75-b95774139b6a'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:18.227669 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-6414dba7-babd-4380-9b75-b95774139b6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c602a3571f6d4d48ad6de57d1f302bb1', 'request_id': 'req-6414dba7-babd-4380-9b75-b95774139b6a'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:18.242215 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-6414dba7-babd-4380-9b75-b95774139b6a admin admin] The token cache is being invalidate because project c602a3571f6d4d48ad6de57d1f302bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:48:18.243866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-6414dba7-babd-4380-9b75-b95774139b6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:18.244621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-6414dba7-babd-4380-9b75-b95774139b6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:18.249646 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1078/2174] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:48:18 2022] DELETE /identity/v3/projects/c602a3571f6d4d48ad6de57d1f302bb1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:18.252440 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9206dc5-8242-419a-8007-5135b6cd2800 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:18.252731 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9206dc5-8242-419a-8007-5135b6cd2800 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:18.253006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9206dc5-8242-419a-8007-5135b6cd2800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:18.281262 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-f9206dc5-8242-419a-8007-5135b6cd2800 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:18.282635 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-f9206dc5-8242-419a-8007-5135b6cd2800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:18.351698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1097/2175] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:18.359480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278d628-54a4-4031-9068-7bbd382092ff None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:18.359745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278d628-54a4-4031-9068-7bbd382092ff None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:18.360020 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278d628-54a4-4031-9068-7bbd382092ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:18.396232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-2278d628-54a4-4031-9068-7bbd382092ff None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:18.398065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-2278d628-54a4-4031-9068-7bbd382092ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:18.413350 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9206dc5-8242-419a-8007-5135b6cd2800 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:18.418686 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1079/2176] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:18.424491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9206dc5-8242-419a-8007-5135b6cd2800 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:18.430115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbdafc-d940-40d0-be4d-854beeefff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:18.430836 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbdafc-d940-40d0-be4d-854beeefff32 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:18.431202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbdafc-d940-40d0-be4d-854beeefff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:18.431432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbdafc-d940-40d0-be4d-854beeefff32 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:18.432164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbdafc-d940-40d0-be4d-854beeefff32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:48:18.432661 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbdafc-d940-40d0-be4d-854beeefff32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:18.434622 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbdafc-d940-40d0-be4d-854beeefff32 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:18.448300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1098/2177] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:48:18.452788 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278d628-54a4-4031-9068-7bbd382092ff None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:18.466180 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278d628-54a4-4031-9068-7bbd382092ff None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:18.471528 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72e5a2-6ea5-4adb-b93a-b417de42cfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:18.472174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72e5a2-6ea5-4adb-b93a-b417de42cfb9 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:18.472469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72e5a2-6ea5-4adb-b93a-b417de42cfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:18.472888 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72e5a2-6ea5-4adb-b93a-b417de42cfb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:18.473894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72e5a2-6ea5-4adb-b93a-b417de42cfb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:18.476138 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72e5a2-6ea5-4adb-b93a-b417de42cfb9 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:18.512941 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1080/2178] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:48:18 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:48:18.517940 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbdafc-d940-40d0-be4d-854beeefff32 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:18.532344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbdafc-d940-40d0-be4d-854beeefff32 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:18.611244 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce285d9-cf9f-477d-a55a-7845c29f4f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:18.612080 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce285d9-cf9f-477d-a55a-7845c29f4f15 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:18.612365 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce285d9-cf9f-477d-a55a-7845c29f4f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:18.612640 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce285d9-cf9f-477d-a55a-7845c29f4f15 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:18.613336 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce285d9-cf9f-477d-a55a-7845c29f4f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:18.615307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce285d9-cf9f-477d-a55a-7845c29f4f15 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:18.639096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1099/2179] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:48:18 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:18.643222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72e5a2-6ea5-4adb-b93a-b417de42cfb9 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:18.654591 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72e5a2-6ea5-4adb-b93a-b417de42cfb9 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:18.659430 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5a03b-1403-413b-9b41-35383e10b288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:18.660302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5a03b-1403-413b-9b41-35383e10b288 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:18.660656 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5a03b-1403-413b-9b41-35383e10b288 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:18.660989 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5a03b-1403-413b-9b41-35383e10b288 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:18.661980 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5a03b-1403-413b-9b41-35383e10b288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:18.663696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5a03b-1403-413b-9b41-35383e10b288 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:18.675461 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1081/2180] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:18.679587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce285d9-cf9f-477d-a55a-7845c29f4f15 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:18.691902 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce285d9-cf9f-477d-a55a-7845c29f4f15 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:18.697810 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927a4d8-dc8e-4ca3-b64f-5d6db101090b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:18.698491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927a4d8-dc8e-4ca3-b64f-5d6db101090b admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:18.698775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927a4d8-dc8e-4ca3-b64f-5d6db101090b admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:18.699067 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927a4d8-dc8e-4ca3-b64f-5d6db101090b admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:18.699811 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927a4d8-dc8e-4ca3-b64f-5d6db101090b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:18.701551 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927a4d8-dc8e-4ca3-b64f-5d6db101090b admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:18.714921 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1100/2181] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:18.719402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5a03b-1403-413b-9b41-35383e10b288 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:18.733941 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5a03b-1403-413b-9b41-35383e10b288 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:18.739168 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c003e00-8dc3-4a8c-a736-8f13a6498eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:18.740180 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c003e00-8dc3-4a8c-a736-8f13a6498eda admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:18.740608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c003e00-8dc3-4a8c-a736-8f13a6498eda admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:18.740920 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c003e00-8dc3-4a8c-a736-8f13a6498eda admin admin] PATH_INFO: `/v3/projects/e180541a835d480584748f32d0db1fb0/users/8e7cda548875441fac18f3b62ae70399/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:18.758306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c003e00-8dc3-4a8c-a736-8f13a6498eda admin admin] RBAC: Authorizing `identity:create_grant(project_id=e180541a835d480584748f32d0db1fb0, user_id=8e7cda548875441fac18f3b62ae70399, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:18.762122 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c003e00-8dc3-4a8c-a736-8f13a6498eda admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:18.789754 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1082/2182] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:48:18 2022] PUT /identity/v3/projects/e180541a835d480584748f32d0db1fb0/users/8e7cda548875441fac18f3b62ae70399/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:48:18.802140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ed97d-4806-4462-977a-80cc62a2675c None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:18.806170 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ed97d-4806-4462-977a-80cc62a2675c None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:18.806709 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ed97d-4806-4462-977a-80cc62a2675c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:18.841516 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-644ed97d-4806-4462-977a-80cc62a2675c None None] MFA Rules not processed for user `8e7cda548875441fac18f3b62ae70399`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:18.843377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-644ed97d-4806-4462-977a-80cc62a2675c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:18.934832 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1101/2183] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:18.947986 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c003e00-8dc3-4a8c-a736-8f13a6498eda admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:18.949759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-0c003e00-8dc3-4a8c-a736-8f13a6498eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:19.025737 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c003e00-8dc3-4a8c-a736-8f13a6498eda admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:19.030951 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16410d1-b589-44ba-b79d-3db842c38cb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:19.031689 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16410d1-b589-44ba-b79d-3db842c38cb5 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:19.031978 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16410d1-b589-44ba-b79d-3db842c38cb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:19.032261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16410d1-b589-44ba-b79d-3db842c38cb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:19.043267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16410d1-b589-44ba-b79d-3db842c38cb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:19.045296 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16410d1-b589-44ba-b79d-3db842c38cb5 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:19.070107 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1083/2184] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:48:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:20.451878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c2f33-f940-4c84-8183-c2b8484c02e2 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:20.452540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c2f33-f940-4c84-8183-c2b8484c02e2 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:20.452540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c2f33-f940-4c84-8183-c2b8484c02e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:20.471820 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-979c2f33-f940-4c84-8183-c2b8484c02e2 None None] MFA Rules not processed for user `620b3bc722474b14b933c6c8ce20dafe`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:20.473036 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-979c2f33-f940-4c84-8183-c2b8484c02e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:20.532287 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1102/2185] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:20.744038 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16410d1-b589-44ba-b79d-3db842c38cb5 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:20.745578 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f16410d1-b589-44ba-b79d-3db842c38cb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:20.811075 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16410d1-b589-44ba-b79d-3db842c38cb5 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:20.815848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b80caf-94d4-42a0-951d-26907e87c3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:20.816730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b80caf-94d4-42a0-951d-26907e87c3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:20.817020 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b80caf-94d4-42a0-951d-26907e87c3da admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:20.817323 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b80caf-94d4-42a0-951d-26907e87c3da admin admin] PATH_INFO: `/v3/users/465837857c38418d9b58500ff6bf637c` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:20.818501 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b80caf-94d4-42a0-951d-26907e87c3da admin admin] RBAC: Authorizing `identity:delete_user(user_id=465837857c38418d9b58500ff6bf637c)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:20.820476 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b80caf-94d4-42a0-951d-26907e87c3da admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:20.871623 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-03b80caf-94d4-42a0-951d-26907e87c3da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '465837857c38418d9b58500ff6bf637c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:20.881413 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-03b80caf-94d4-42a0-951d-26907e87c3da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '465837857c38418d9b58500ff6bf637c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:20.916198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-03b80caf-94d4-42a0-951d-26907e87c3da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '465837857c38418d9b58500ff6bf637c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:20.917281 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-03b80caf-94d4-42a0-951d-26907e87c3da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '465837857c38418d9b58500ff6bf637c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:20.918125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-03b80caf-94d4-42a0-951d-26907e87c3da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '465837857c38418d9b58500ff6bf637c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:20.941178 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1084/2186] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:48:20 2022] DELETE /identity/v3/users/465837857c38418d9b58500ff6bf637c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:20.945512 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7931e-7b56-481d-8c66-e72706277978 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:20.945869 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7931e-7b56-481d-8c66-e72706277978 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:20.946221 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7931e-7b56-481d-8c66-e72706277978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:20.965650 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-ddb7931e-7b56-481d-8c66-e72706277978 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:20.966853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ddb7931e-7b56-481d-8c66-e72706277978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:21.039543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1103/2187] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:48:21.049924 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b80caf-94d4-42a0-951d-26907e87c3da admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:21.051389 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-03b80caf-94d4-42a0-951d-26907e87c3da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:21.108475 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b80caf-94d4-42a0-951d-26907e87c3da admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:21.116142 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7eb192-4833-42fb-93b5-f723fcb85b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:21.116142 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb192-4833-42fb-93b5-f723fcb85b18 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.116142 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb192-4833-42fb-93b5-f723fcb85b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.116142 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb192-4833-42fb-93b5-f723fcb85b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:21.128257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7eb192-4833-42fb-93b5-f723fcb85b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:21.129705 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7eb192-4833-42fb-93b5-f723fcb85b18 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:21.139905 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1085/2188] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:48:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:21.459966 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7931e-7b56-481d-8c66-e72706277978 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:21.461482 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ddb7931e-7b56-481d-8c66-e72706277978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:21.482534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7931e-7b56-481d-8c66-e72706277978 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:21.489579 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aea10-0b24-46a1-8c01-834eefa6be6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:21.490631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aea10-0b24-46a1-8c01-834eefa6be6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.491005 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aea10-0b24-46a1-8c01-834eefa6be6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.491377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aea10-0b24-46a1-8c01-834eefa6be6a admin admin] PATH_INFO: `/v3/projects/4fc90c4b11dc453d8ea66d758a8eee93` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:21.492655 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741aea10-0b24-46a1-8c01-834eefa6be6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc90c4b11dc453d8ea66d758a8eee93)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:21.495314 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741aea10-0b24-46a1-8c01-834eefa6be6a admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:21.550090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-741aea10-0b24-46a1-8c01-834eefa6be6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc90c4b11dc453d8ea66d758a8eee93', 'request_id': 'req-741aea10-0b24-46a1-8c01-834eefa6be6a'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:21.557687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-741aea10-0b24-46a1-8c01-834eefa6be6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc90c4b11dc453d8ea66d758a8eee93', 'request_id': 'req-741aea10-0b24-46a1-8c01-834eefa6be6a'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:21.564373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-741aea10-0b24-46a1-8c01-834eefa6be6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc90c4b11dc453d8ea66d758a8eee93', 'request_id': 'req-741aea10-0b24-46a1-8c01-834eefa6be6a'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:21.578359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-741aea10-0b24-46a1-8c01-834eefa6be6a admin admin] The token cache is being invalidate because project 4fc90c4b11dc453d8ea66d758a8eee93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:48:21.578697 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-741aea10-0b24-46a1-8c01-834eefa6be6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:21.579365 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-741aea10-0b24-46a1-8c01-834eefa6be6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:21.581023 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1104/2189] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:48:21 2022] DELETE /identity/v3/projects/4fc90c4b11dc453d8ea66d758a8eee93 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:21.586697 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c01437-9b3b-428f-9043-05d13ed8d146 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.587253 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c01437-9b3b-428f-9043-05d13ed8d146 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.587631 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c01437-9b3b-428f-9043-05d13ed8d146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:21.606504 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-05c01437-9b3b-428f-9043-05d13ed8d146 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:21.607802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-05c01437-9b3b-428f-9043-05d13ed8d146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:21.671760 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1086/2190] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:21.679491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2278ae-a1e8-463c-ae71-d335414cfdc7 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.679785 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2278ae-a1e8-463c-ae71-d335414cfdc7 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.680092 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2278ae-a1e8-463c-ae71-d335414cfdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:21.698795 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-7e2278ae-a1e8-463c-ae71-d335414cfdc7 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:21.700028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-7e2278ae-a1e8-463c-ae71-d335414cfdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:21.708445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1105/2191] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:21.712845 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c01437-9b3b-428f-9043-05d13ed8d146 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:21.725693 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c01437-9b3b-428f-9043-05d13ed8d146 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:21.731467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c518b-a1be-46cf-8c51-816ce357a63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:21.732226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c518b-a1be-46cf-8c51-816ce357a63c admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.732573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c518b-a1be-46cf-8c51-816ce357a63c admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.732941 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c518b-a1be-46cf-8c51-816ce357a63c admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:21.733784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c518b-a1be-46cf-8c51-816ce357a63c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:48:21.734162 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c518b-a1be-46cf-8c51-816ce357a63c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:21.735854 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c518b-a1be-46cf-8c51-816ce357a63c admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:21.748744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1087/2192] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:48:21.753055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2278ae-a1e8-463c-ae71-d335414cfdc7 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:21.765062 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2278ae-a1e8-463c-ae71-d335414cfdc7 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:21.770075 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165af56-257c-4b51-b88b-01125e818959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:21.770857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165af56-257c-4b51-b88b-01125e818959 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.771236 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165af56-257c-4b51-b88b-01125e818959 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.771517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165af56-257c-4b51-b88b-01125e818959 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:21.772516 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165af56-257c-4b51-b88b-01125e818959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:21.774712 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165af56-257c-4b51-b88b-01125e818959 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:21.802039 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1106/2193] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:48:21 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:48:21.806361 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c518b-a1be-46cf-8c51-816ce357a63c admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:21.817023 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c518b-a1be-46cf-8c51-816ce357a63c admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:21.876547 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de569e9b-a2fe-4a89-ae78-da3b23cd0b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:21.877223 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de569e9b-a2fe-4a89-ae78-da3b23cd0b16 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.877511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de569e9b-a2fe-4a89-ae78-da3b23cd0b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.877793 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de569e9b-a2fe-4a89-ae78-da3b23cd0b16 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:21.878502 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de569e9b-a2fe-4a89-ae78-da3b23cd0b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:21.880460 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de569e9b-a2fe-4a89-ae78-da3b23cd0b16 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:21.902531 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1088/2194] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:48:21 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:21.906257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165af56-257c-4b51-b88b-01125e818959 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:21.916972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165af56-257c-4b51-b88b-01125e818959 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:21.921632 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaed61a-302d-488c-a3c9-5651f5f60d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:21.922300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaed61a-302d-488c-a3c9-5651f5f60d10 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.922588 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaed61a-302d-488c-a3c9-5651f5f60d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.922869 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaed61a-302d-488c-a3c9-5651f5f60d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:21.923643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaed61a-302d-488c-a3c9-5651f5f60d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:21.925256 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaed61a-302d-488c-a3c9-5651f5f60d10 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:21.936345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1107/2195] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:21.940293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de569e9b-a2fe-4a89-ae78-da3b23cd0b16 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:21.951634 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de569e9b-a2fe-4a89-ae78-da3b23cd0b16 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:21.957101 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8df71-53e9-4d7f-ab91-ee55a9a00f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:21.957824 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8df71-53e9-4d7f-ab91-ee55a9a00f9d admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.958110 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8df71-53e9-4d7f-ab91-ee55a9a00f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.958385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8df71-53e9-4d7f-ab91-ee55a9a00f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:21.959149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8df71-53e9-4d7f-ab91-ee55a9a00f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:21.960743 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8df71-53e9-4d7f-ab91-ee55a9a00f9d admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:21.971814 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1089/2196] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:21.976225 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaed61a-302d-488c-a3c9-5651f5f60d10 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:21.986480 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaed61a-302d-488c-a3c9-5651f5f60d10 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:21.991472 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55f440-1b23-4dc9-8c38-13908531a748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:21.992387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55f440-1b23-4dc9-8c38-13908531a748 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.992678 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55f440-1b23-4dc9-8c38-13908531a748 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.992944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55f440-1b23-4dc9-8c38-13908531a748 admin admin] PATH_INFO: `/v3/projects/c0022ceeb35049c586796931a90af7b4/users/8f0858932cdd4a2991c21169ab07cb28/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:22.007848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55f440-1b23-4dc9-8c38-13908531a748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0022ceeb35049c586796931a90af7b4, user_id=8f0858932cdd4a2991c21169ab07cb28, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:22.011449 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55f440-1b23-4dc9-8c38-13908531a748 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:22.027409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1108/2197] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:48:21 2022] PUT /identity/v3/projects/c0022ceeb35049c586796931a90af7b4/users/8f0858932cdd4a2991c21169ab07cb28/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:22.037684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06208dbf-ff34-430f-9d23-06c77160e820 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:22.039582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06208dbf-ff34-430f-9d23-06c77160e820 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:22.039582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06208dbf-ff34-430f-9d23-06c77160e820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:22.071177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-06208dbf-ff34-430f-9d23-06c77160e820 None None] MFA Rules not processed for user `8f0858932cdd4a2991c21169ab07cb28`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:22.071177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-06208dbf-ff34-430f-9d23-06c77160e820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:22.133500 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1090/2198] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:22.162176 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55f440-1b23-4dc9-8c38-13908531a748 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:22.164250 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-af55f440-1b23-4dc9-8c38-13908531a748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:22.263803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55f440-1b23-4dc9-8c38-13908531a748 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:22.272038 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a61f56-15d0-4bc4-b1d3-d617fb3443d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:22.272689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a61f56-15d0-4bc4-b1d3-d617fb3443d3 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:22.273020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a61f56-15d0-4bc4-b1d3-d617fb3443d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:22.273255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a61f56-15d0-4bc4-b1d3-d617fb3443d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:22.290487 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a61f56-15d0-4bc4-b1d3-d617fb3443d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:22.292503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a61f56-15d0-4bc4-b1d3-d617fb3443d3 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:22.307781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1109/2199] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:48:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:22.551696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9baebc7-89a3-47ab-8421-d2b7a1d574c6 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:22.552322 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9baebc7-89a3-47ab-8421-d2b7a1d574c6 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:22.552602 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9baebc7-89a3-47ab-8421-d2b7a1d574c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:22.576960 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-e9baebc7-89a3-47ab-8421-d2b7a1d574c6 None None] MFA Rules not processed for user `82b2e79995f94ab880f5d798ddd649b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:22.578524 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e9baebc7-89a3-47ab-8421-d2b7a1d574c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:22.659592 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1091/2200] 10.222.0.11 () {58 vars in 1009 bytes} [Wed May 4 21:48:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:22.675900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a61f56-15d0-4bc4-b1d3-d617fb3443d3 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:22.677764 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-46a61f56-15d0-4bc4-b1d3-d617fb3443d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:22.754106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a61f56-15d0-4bc4-b1d3-d617fb3443d3 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:22.759486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8ba7b-8646-437d-993f-3a51c8aed9c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8358da535a104873ad9f5676989a9e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:22.760135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8ba7b-8646-437d-993f-3a51c8aed9c8 service swift] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:22.760487 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8ba7b-8646-437d-993f-3a51c8aed9c8 service swift] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:22.760882 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8ba7b-8646-437d-993f-3a51c8aed9c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:22.769649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8ba7b-8646-437d-993f-3a51c8aed9c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:22.771272 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8ba7b-8646-437d-993f-3a51c8aed9c8 service swift] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:22.780549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1110/2201] 10.222.0.11 () {60 vars in 1384 bytes} [Wed May 4 21:48:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:48:23.761813 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9d0b6-e8e1-4675-960e-a2f0c10d6137 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:23.762310 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9d0b6-e8e1-4675-960e-a2f0c10d6137 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:23.762426 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9d0b6-e8e1-4675-960e-a2f0c10d6137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:23.784375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-c6e9d0b6-e8e1-4675-960e-a2f0c10d6137 None None] MFA Rules not processed for user `8f0858932cdd4a2991c21169ab07cb28`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:23.785660 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c6e9d0b6-e8e1-4675-960e-a2f0c10d6137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:23.792705 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1092/2202] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:29.629425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8ba7b-8646-437d-993f-3a51c8aed9c8 service swift] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:29.630951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-78d8ba7b-8646-437d-993f-3a51c8aed9c8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:29.705266 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8ba7b-8646-437d-993f-3a51c8aed9c8 service swift] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:29.711974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8053a3-1211-4125-a083-46d0a143330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:29.714387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8053a3-1211-4125-a083-46d0a143330a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:29.714682 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8053a3-1211-4125-a083-46d0a143330a admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:29.714970 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8053a3-1211-4125-a083-46d0a143330a admin admin] PATH_INFO: `/v3/users/8e7cda548875441fac18f3b62ae70399` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:29.716269 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8053a3-1211-4125-a083-46d0a143330a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e7cda548875441fac18f3b62ae70399)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:29.719033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8053a3-1211-4125-a083-46d0a143330a admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:29.783449 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3a8053a3-1211-4125-a083-46d0a143330a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e7cda548875441fac18f3b62ae70399'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:29.791715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3a8053a3-1211-4125-a083-46d0a143330a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e7cda548875441fac18f3b62ae70399'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:29.792574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3a8053a3-1211-4125-a083-46d0a143330a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e7cda548875441fac18f3b62ae70399'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:29.807479 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3a8053a3-1211-4125-a083-46d0a143330a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e7cda548875441fac18f3b62ae70399'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:29.818693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-3a8053a3-1211-4125-a083-46d0a143330a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e7cda548875441fac18f3b62ae70399'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:29.830953 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1111/2203] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:48:29 2022] DELETE /identity/v3/users/8e7cda548875441fac18f3b62ae70399 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:29.832726 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60d44b-d1ee-4d62-84e7-5f3dd73f1458 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:29.833241 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60d44b-d1ee-4d62-84e7-5f3dd73f1458 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:29.833364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60d44b-d1ee-4d62-84e7-5f3dd73f1458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:29.868692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-6a60d44b-d1ee-4d62-84e7-5f3dd73f1458 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:29.870468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-6a60d44b-d1ee-4d62-84e7-5f3dd73f1458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:29.937676 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1093/2204] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:29.947465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8053a3-1211-4125-a083-46d0a143330a admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:29.948903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-3a8053a3-1211-4125-a083-46d0a143330a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:30.007383 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8053a3-1211-4125-a083-46d0a143330a admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:30.011780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dac22-b30a-4b51-94e8-a186456b7c49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:30.012435 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dac22-b30a-4b51-94e8-a186456b7c49 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:30.012719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dac22-b30a-4b51-94e8-a186456b7c49 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:30.012996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dac22-b30a-4b51-94e8-a186456b7c49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:30.022758 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82dac22-b30a-4b51-94e8-a186456b7c49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:30.024237 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82dac22-b30a-4b51-94e8-a186456b7c49 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:30.034865 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1112/2205] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:30.330360 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60d44b-d1ee-4d62-84e7-5f3dd73f1458 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:30.332059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-6a60d44b-d1ee-4d62-84e7-5f3dd73f1458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:30.344580 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60d44b-d1ee-4d62-84e7-5f3dd73f1458 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:30.350203 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7d10b-52ef-4cfd-91b3-de477dafb7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:30.351088 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7d10b-52ef-4cfd-91b3-de477dafb7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:30.351371 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7d10b-52ef-4cfd-91b3-de477dafb7de admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:30.351644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7d10b-52ef-4cfd-91b3-de477dafb7de admin admin] PATH_INFO: `/v3/projects/e180541a835d480584748f32d0db1fb0` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:30.352957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7d10b-52ef-4cfd-91b3-de477dafb7de admin admin] RBAC: Authorizing `identity:delete_project(project_id=e180541a835d480584748f32d0db1fb0)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:30.354937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7d10b-52ef-4cfd-91b3-de477dafb7de admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:30.404044 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-03e7d10b-52ef-4cfd-91b3-de477dafb7de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e180541a835d480584748f32d0db1fb0', 'request_id': 'req-03e7d10b-52ef-4cfd-91b3-de477dafb7de'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:30.410144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-03e7d10b-52ef-4cfd-91b3-de477dafb7de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e180541a835d480584748f32d0db1fb0', 'request_id': 'req-03e7d10b-52ef-4cfd-91b3-de477dafb7de'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:30.418818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-03e7d10b-52ef-4cfd-91b3-de477dafb7de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e180541a835d480584748f32d0db1fb0', 'request_id': 'req-03e7d10b-52ef-4cfd-91b3-de477dafb7de'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:30.429844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-03e7d10b-52ef-4cfd-91b3-de477dafb7de admin admin] The token cache is being invalidate because project e180541a835d480584748f32d0db1fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:48:30.430141 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-03e7d10b-52ef-4cfd-91b3-de477dafb7de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:30.430805 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-03e7d10b-52ef-4cfd-91b3-de477dafb7de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:30.432403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1094/2206] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:48:30 2022] DELETE /identity/v3/projects/e180541a835d480584748f32d0db1fb0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:30.438832 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f1659-4142-4d07-aec5-5436f58c7c9c None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:30.439161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f1659-4142-4d07-aec5-5436f58c7c9c None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:30.439442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f1659-4142-4d07-aec5-5436f58c7c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:30.457851 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-7a5f1659-4142-4d07-aec5-5436f58c7c9c None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:30.458989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-7a5f1659-4142-4d07-aec5-5436f58c7c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:30.556868 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1113/2207] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:48:30.564942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fb893-5711-4c87-b48e-dc820562599a None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:30.565230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fb893-5711-4c87-b48e-dc820562599a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:30.565512 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fb893-5711-4c87-b48e-dc820562599a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:30.594723 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-585fb893-5711-4c87-b48e-dc820562599a None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:30.596147 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-585fb893-5711-4c87-b48e-dc820562599a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:30.607136 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1095/2208] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:30.609061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f1659-4142-4d07-aec5-5436f58c7c9c None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:30.628428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f1659-4142-4d07-aec5-5436f58c7c9c None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:30.648747 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e186456-af59-4654-8f48-c7a91af49418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:30.649565 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e186456-af59-4654-8f48-c7a91af49418 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:30.649973 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e186456-af59-4654-8f48-c7a91af49418 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:30.650378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e186456-af59-4654-8f48-c7a91af49418 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:30.653582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e186456-af59-4654-8f48-c7a91af49418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:48:30.653582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e186456-af59-4654-8f48-c7a91af49418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:30.654122 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e186456-af59-4654-8f48-c7a91af49418 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:30.666644 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1114/2209] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:48:30.671312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fb893-5711-4c87-b48e-dc820562599a None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:30.680905 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fb893-5711-4c87-b48e-dc820562599a None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:30.686032 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741de57-6265-4ff3-b926-0793d3a53368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:30.686896 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741de57-6265-4ff3-b926-0793d3a53368 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:30.687222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741de57-6265-4ff3-b926-0793d3a53368 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:30.687528 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741de57-6265-4ff3-b926-0793d3a53368 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:30.688255 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741de57-6265-4ff3-b926-0793d3a53368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:30.690577 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741de57-6265-4ff3-b926-0793d3a53368 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:30.720842 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1096/2210] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:48:30 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:30.724952 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e186456-af59-4654-8f48-c7a91af49418 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:30.738002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e186456-af59-4654-8f48-c7a91af49418 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:30.805540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8d9c6-207c-4840-9779-988572cbfcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:30.806384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8d9c6-207c-4840-9779-988572cbfcc1 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:30.806810 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8d9c6-207c-4840-9779-988572cbfcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:30.807227 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8d9c6-207c-4840-9779-988572cbfcc1 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:30.808913 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8d9c6-207c-4840-9779-988572cbfcc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:30.812006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8d9c6-207c-4840-9779-988572cbfcc1 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:30.839950 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1115/2211] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:48:30 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:48:30.844215 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741de57-6265-4ff3-b926-0793d3a53368 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:30.858161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741de57-6265-4ff3-b926-0793d3a53368 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:30.867188 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fda06-6489-4f49-9c17-95ef903118a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:30.867883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fda06-6489-4f49-9c17-95ef903118a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:30.868159 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fda06-6489-4f49-9c17-95ef903118a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:30.868541 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fda06-6489-4f49-9c17-95ef903118a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:30.869169 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fda06-6489-4f49-9c17-95ef903118a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:30.870853 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fda06-6489-4f49-9c17-95ef903118a2 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:30.883626 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1097/2212] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:48:30.888232 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8d9c6-207c-4840-9779-988572cbfcc1 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:30.902342 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8d9c6-207c-4840-9779-988572cbfcc1 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:30.908111 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976d943-8a5c-4ec4-888e-0a310ad54df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:30.909125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d943-8a5c-4ec4-888e-0a310ad54df2 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:30.909626 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d943-8a5c-4ec4-888e-0a310ad54df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:30.910370 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d943-8a5c-4ec4-888e-0a310ad54df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:30.911701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976d943-8a5c-4ec4-888e-0a310ad54df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:30.913884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976d943-8a5c-4ec4-888e-0a310ad54df2 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:30.925532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1116/2213] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:30.929985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fda06-6489-4f49-9c17-95ef903118a2 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:30.940755 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fda06-6489-4f49-9c17-95ef903118a2 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:30.945860 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6872431-9c31-4e23-9c9f-a35d4c05d02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:30.946753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6872431-9c31-4e23-9c9f-a35d4c05d02b admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:30.947067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6872431-9c31-4e23-9c9f-a35d4c05d02b admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:30.947343 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6872431-9c31-4e23-9c9f-a35d4c05d02b admin admin] PATH_INFO: `/v3/projects/2385454f60464c12a03d1184053a2e98/users/5bd12d925fbc44d69886993e247f7464/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:30.963181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6872431-9c31-4e23-9c9f-a35d4c05d02b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2385454f60464c12a03d1184053a2e98, user_id=5bd12d925fbc44d69886993e247f7464, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:30.966095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6872431-9c31-4e23-9c9f-a35d4c05d02b admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:30.991686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec019ce-92c5-4164-b02a-45411f9f71a6 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:30.991978 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec019ce-92c5-4164-b02a-45411f9f71a6 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:30.992261 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec019ce-92c5-4164-b02a-45411f9f71a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:30.992428 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1098/2214] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:48:30 2022] PUT /identity/v3/projects/2385454f60464c12a03d1184053a2e98/users/5bd12d925fbc44d69886993e247f7464/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:48:31.019050 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-1ec019ce-92c5-4164-b02a-45411f9f71a6 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:31.020273 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-1ec019ce-92c5-4164-b02a-45411f9f71a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:31.093255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1117/2215] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:31.103840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6872431-9c31-4e23-9c9f-a35d4c05d02b admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:31.105745 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-d6872431-9c31-4e23-9c9f-a35d4c05d02b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:31.196875 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6872431-9c31-4e23-9c9f-a35d4c05d02b admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:31.200573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febf3b4-1ee0-4336-a130-f29cd40bf2a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:31.201224 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febf3b4-1ee0-4336-a130-f29cd40bf2a2 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:31.201505 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febf3b4-1ee0-4336-a130-f29cd40bf2a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:31.201778 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febf3b4-1ee0-4336-a130-f29cd40bf2a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:31.211105 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febf3b4-1ee0-4336-a130-f29cd40bf2a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:31.212525 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febf3b4-1ee0-4336-a130-f29cd40bf2a2 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:31.222587 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1099/2216] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:48:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:32.928507 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec019ce-92c5-4164-b02a-45411f9f71a6 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:32.929974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-1ec019ce-92c5-4164-b02a-45411f9f71a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:32.942507 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec019ce-92c5-4164-b02a-45411f9f71a6 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:32.952989 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96dbfa-e253-4f7b-ad1e-7b0f674d4d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:32.954916 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96dbfa-e253-4f7b-ad1e-7b0f674d4d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:32.956207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96dbfa-e253-4f7b-ad1e-7b0f674d4d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:32.956335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96dbfa-e253-4f7b-ad1e-7b0f674d4d69 admin admin] PATH_INFO: `/v3/users/99b1ce7107a342a1b38bd86fd238e463` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:32.957693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96dbfa-e253-4f7b-ad1e-7b0f674d4d69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99b1ce7107a342a1b38bd86fd238e463)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:32.960267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96dbfa-e253-4f7b-ad1e-7b0f674d4d69 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:33.042250 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ed96dbfa-e253-4f7b-ad1e-7b0f674d4d69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99b1ce7107a342a1b38bd86fd238e463'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:33.049866 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ed96dbfa-e253-4f7b-ad1e-7b0f674d4d69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99b1ce7107a342a1b38bd86fd238e463'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:33.050598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ed96dbfa-e253-4f7b-ad1e-7b0f674d4d69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99b1ce7107a342a1b38bd86fd238e463'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:33.066794 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ed96dbfa-e253-4f7b-ad1e-7b0f674d4d69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99b1ce7107a342a1b38bd86fd238e463'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:33.081107 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ed96dbfa-e253-4f7b-ad1e-7b0f674d4d69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99b1ce7107a342a1b38bd86fd238e463'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:33.089961 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1118/2217] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:48:32 2022] DELETE /identity/v3/users/99b1ce7107a342a1b38bd86fd238e463 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:33.094890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37d706-3acf-46a4-a23e-1c0519cee104 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:33.095508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37d706-3acf-46a4-a23e-1c0519cee104 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:33.095613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37d706-3acf-46a4-a23e-1c0519cee104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:33.116898 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-3d37d706-3acf-46a4-a23e-1c0519cee104 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:33.118671 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-3d37d706-3acf-46a4-a23e-1c0519cee104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:33.207501 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1100/2218] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:48:33.217442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96dbfa-e253-4f7b-ad1e-7b0f674d4d69 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:33.220223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ed96dbfa-e253-4f7b-ad1e-7b0f674d4d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:33.371131 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96dbfa-e253-4f7b-ad1e-7b0f674d4d69 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:33.374950 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63304ac1-d148-469c-9af4-1b6b4379a6c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:33.375698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304ac1-d148-469c-9af4-1b6b4379a6c4 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:33.375982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304ac1-d148-469c-9af4-1b6b4379a6c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:33.376260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304ac1-d148-469c-9af4-1b6b4379a6c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:33.387956 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63304ac1-d148-469c-9af4-1b6b4379a6c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:33.393902 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63304ac1-d148-469c-9af4-1b6b4379a6c4 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:33.406821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1119/2219] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:48:33.763265 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37d706-3acf-46a4-a23e-1c0519cee104 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:33.766384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-3d37d706-3acf-46a4-a23e-1c0519cee104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:33.788934 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37d706-3acf-46a4-a23e-1c0519cee104 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:33.813291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa083e-d1e1-42d0-8dd9-39b8d1a1248f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:33.815059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa083e-d1e1-42d0-8dd9-39b8d1a1248f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:33.817518 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa083e-d1e1-42d0-8dd9-39b8d1a1248f admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:33.819692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa083e-d1e1-42d0-8dd9-39b8d1a1248f admin admin] PATH_INFO: `/v3/projects/4faa75c015664228bf946e70eb0a5b11` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:33.821526 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa083e-d1e1-42d0-8dd9-39b8d1a1248f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4faa75c015664228bf946e70eb0a5b11)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:33.823865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa083e-d1e1-42d0-8dd9-39b8d1a1248f admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:33.919815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4efa083e-d1e1-42d0-8dd9-39b8d1a1248f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4faa75c015664228bf946e70eb0a5b11', 'request_id': 'req-4efa083e-d1e1-42d0-8dd9-39b8d1a1248f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:33.930016 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4efa083e-d1e1-42d0-8dd9-39b8d1a1248f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4faa75c015664228bf946e70eb0a5b11', 'request_id': 'req-4efa083e-d1e1-42d0-8dd9-39b8d1a1248f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:33.963569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4efa083e-d1e1-42d0-8dd9-39b8d1a1248f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4faa75c015664228bf946e70eb0a5b11', 'request_id': 'req-4efa083e-d1e1-42d0-8dd9-39b8d1a1248f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:33.988397 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4efa083e-d1e1-42d0-8dd9-39b8d1a1248f admin admin] The token cache is being invalidate because project 4faa75c015664228bf946e70eb0a5b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:48:33.988710 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4efa083e-d1e1-42d0-8dd9-39b8d1a1248f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:33.989353 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4efa083e-d1e1-42d0-8dd9-39b8d1a1248f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:33.994526 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1101/2220] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:48:33 2022] DELETE /identity/v3/projects/4faa75c015664228bf946e70eb0a5b11 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:33.996304 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7f1bb-4a94-4169-86ae-d56fa2b7415b None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:33.996831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7f1bb-4a94-4169-86ae-d56fa2b7415b None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:33.996831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7f1bb-4a94-4169-86ae-d56fa2b7415b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:34.027676 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-32e7f1bb-4a94-4169-86ae-d56fa2b7415b None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:34.029814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-32e7f1bb-4a94-4169-86ae-d56fa2b7415b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:34.162317 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1120/2221] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:48:34.177295 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181f45f-0391-4916-8aa8-140b0d8ee8b8 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:34.177985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181f45f-0391-4916-8aa8-140b0d8ee8b8 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:34.177985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181f45f-0391-4916-8aa8-140b0d8ee8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:34.234276 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-1181f45f-0391-4916-8aa8-140b0d8ee8b8 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:34.236574 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-1181f45f-0391-4916-8aa8-140b0d8ee8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:34.247385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1102/2222] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:34.251814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7f1bb-4a94-4169-86ae-d56fa2b7415b None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:34.268480 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7f1bb-4a94-4169-86ae-d56fa2b7415b None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:34.275068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e644f-e718-4bb9-948e-d2d964333258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:34.275750 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e644f-e718-4bb9-948e-d2d964333258 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:34.276049 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e644f-e718-4bb9-948e-d2d964333258 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:34.276358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e644f-e718-4bb9-948e-d2d964333258 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:34.277122 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e644f-e718-4bb9-948e-d2d964333258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:48:34.277424 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e644f-e718-4bb9-948e-d2d964333258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:34.279103 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e644f-e718-4bb9-948e-d2d964333258 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:34.311282 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1121/2223] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:48:34.315731 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181f45f-0391-4916-8aa8-140b0d8ee8b8 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:34.329057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181f45f-0391-4916-8aa8-140b0d8ee8b8 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:34.341964 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ee0f7-f117-4a2b-b2ac-32ba7b5f89c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:34.343754 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ee0f7-f117-4a2b-b2ac-32ba7b5f89c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:34.344213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ee0f7-f117-4a2b-b2ac-32ba7b5f89c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:34.344640 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ee0f7-f117-4a2b-b2ac-32ba7b5f89c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:34.345514 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ee0f7-f117-4a2b-b2ac-32ba7b5f89c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:34.352510 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ee0f7-f117-4a2b-b2ac-32ba7b5f89c2 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:34.434009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1103/2224] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:48:34 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:34.438411 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e644f-e718-4bb9-948e-d2d964333258 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:34.467463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e644f-e718-4bb9-948e-d2d964333258 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:34.555376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19438b34-437e-4999-b12c-199de030f829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:34.556070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19438b34-437e-4999-b12c-199de030f829 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:34.556361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19438b34-437e-4999-b12c-199de030f829 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:34.556645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19438b34-437e-4999-b12c-199de030f829 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:34.557352 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19438b34-437e-4999-b12c-199de030f829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:34.559390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19438b34-437e-4999-b12c-199de030f829 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:34.604505 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1122/2225] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:48:34 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:34.608942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ee0f7-f117-4a2b-b2ac-32ba7b5f89c2 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:34.622271 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ee0f7-f117-4a2b-b2ac-32ba7b5f89c2 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:34.648179 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10998186-9050-46f0-8bc3-3f5b703e840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:34.649193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10998186-9050-46f0-8bc3-3f5b703e840a admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:34.649691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10998186-9050-46f0-8bc3-3f5b703e840a admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:34.650126 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10998186-9050-46f0-8bc3-3f5b703e840a admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:34.651124 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10998186-9050-46f0-8bc3-3f5b703e840a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:34.653602 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10998186-9050-46f0-8bc3-3f5b703e840a admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:34.693285 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1104/2226] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:34.697266 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19438b34-437e-4999-b12c-199de030f829 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:34.712317 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19438b34-437e-4999-b12c-199de030f829 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:34.732032 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d33b1b-6da1-499a-8a08-478792c6aa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:34.732646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d33b1b-6da1-499a-8a08-478792c6aa81 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:34.732935 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d33b1b-6da1-499a-8a08-478792c6aa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:34.733220 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d33b1b-6da1-499a-8a08-478792c6aa81 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:34.735663 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d33b1b-6da1-499a-8a08-478792c6aa81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:34.737857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d33b1b-6da1-499a-8a08-478792c6aa81 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:34.768708 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10998186-9050-46f0-8bc3-3f5b703e840a admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:34.769701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1123/2227] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:34.779135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10998186-9050-46f0-8bc3-3f5b703e840a admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:34.785684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e13c7-57ca-40da-a587-c8429a5b5249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:34.786934 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e13c7-57ca-40da-a587-c8429a5b5249 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:34.787268 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e13c7-57ca-40da-a587-c8429a5b5249 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:34.787966 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e13c7-57ca-40da-a587-c8429a5b5249 admin admin] PATH_INFO: `/v3/projects/c7896f6b8a2d404c8c230a4b44223ecb/users/ff11e001afbb49e7af8d95f52db2882b/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:34.816292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e13c7-57ca-40da-a587-c8429a5b5249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7896f6b8a2d404c8c230a4b44223ecb, user_id=ff11e001afbb49e7af8d95f52db2882b, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:34.819386 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e13c7-57ca-40da-a587-c8429a5b5249 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:34.844887 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1105/2228] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:48:34 2022] PUT /identity/v3/projects/c7896f6b8a2d404c8c230a4b44223ecb/users/ff11e001afbb49e7af8d95f52db2882b/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:48:34.850151 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b399361-a926-4139-85c3-e97491d17630 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:34.850444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b399361-a926-4139-85c3-e97491d17630 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:34.850720 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b399361-a926-4139-85c3-e97491d17630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:34.886710 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-0b399361-a926-4139-85c3-e97491d17630 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:34.887992 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-0b399361-a926-4139-85c3-e97491d17630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:35.047084 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1124/2229] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:48:35.054434 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e13c7-57ca-40da-a587-c8429a5b5249 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:35.056456 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-565e13c7-57ca-40da-a587-c8429a5b5249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:35.196646 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e13c7-57ca-40da-a587-c8429a5b5249 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:35.221694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b229c5-4b0e-4231-9c66-8a5f6ae44114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:35.222680 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b229c5-4b0e-4231-9c66-8a5f6ae44114 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:35.223448 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b229c5-4b0e-4231-9c66-8a5f6ae44114 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:35.223905 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b229c5-4b0e-4231-9c66-8a5f6ae44114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:35.246042 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b229c5-4b0e-4231-9c66-8a5f6ae44114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:35.249899 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b229c5-4b0e-4231-9c66-8a5f6ae44114 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:35.277804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1106/2230] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:48:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:36.888754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd028f9f-b682-490a-897a-79342b9305ca None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:36.889321 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd028f9f-b682-490a-897a-79342b9305ca None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:36.889321 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd028f9f-b682-490a-897a-79342b9305ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:36.999031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-cd028f9f-b682-490a-897a-79342b9305ca None None] MFA Rules not processed for user `ff11e001afbb49e7af8d95f52db2882b`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:37.000269 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-cd028f9f-b682-490a-897a-79342b9305ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:37.115706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1125/2231] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:37.129435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b229c5-4b0e-4231-9c66-8a5f6ae44114 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:37.132372 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-52b229c5-4b0e-4231-9c66-8a5f6ae44114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:37.288197 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b229c5-4b0e-4231-9c66-8a5f6ae44114 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:37.293782 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f7488-0403-4ad7-84bb-65b4d2974ee4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:37.294679 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f7488-0403-4ad7-84bb-65b4d2974ee4 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:37.295354 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f7488-0403-4ad7-84bb-65b4d2974ee4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:37.295959 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f7488-0403-4ad7-84bb-65b4d2974ee4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:37.314109 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f7488-0403-4ad7-84bb-65b4d2974ee4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:37.315999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f7488-0403-4ad7-84bb-65b4d2974ee4 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:37.330477 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1107/2232] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:48:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:38.627954 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccf568-f1c5-446a-ad8b-4ecce957e0ee None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:38.628655 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccf568-f1c5-446a-ad8b-4ecce957e0ee None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:38.628655 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccf568-f1c5-446a-ad8b-4ecce957e0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:38.659933 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-efccf568-f1c5-446a-ad8b-4ecce957e0ee None None] MFA Rules not processed for user `5bd12d925fbc44d69886993e247f7464`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:38.661481 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-efccf568-f1c5-446a-ad8b-4ecce957e0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:38.794080 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1126/2233] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:38.799109 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f7488-0403-4ad7-84bb-65b4d2974ee4 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:38.800589 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b82f7488-0403-4ad7-84bb-65b4d2974ee4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:38.823717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f7488-0403-4ad7-84bb-65b4d2974ee4 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:38.833198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285690ad-4dde-49c4-94ef-f388e1022180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:38.834634 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285690ad-4dde-49c4-94ef-f388e1022180 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:38.835148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285690ad-4dde-49c4-94ef-f388e1022180 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:38.835696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285690ad-4dde-49c4-94ef-f388e1022180 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:38.836701 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285690ad-4dde-49c4-94ef-f388e1022180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:38.843924 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285690ad-4dde-49c4-94ef-f388e1022180 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:38.916162 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1108/2234] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:48:38 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:38.920884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccf568-f1c5-446a-ad8b-4ecce957e0ee None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:38.940799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccf568-f1c5-446a-ad8b-4ecce957e0ee None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:39.036647 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757939f2-110a-4768-8da3-b0d8282cb47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:39.037889 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757939f2-110a-4768-8da3-b0d8282cb47d admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:39.038242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757939f2-110a-4768-8da3-b0d8282cb47d admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:39.038525 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757939f2-110a-4768-8da3-b0d8282cb47d admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:39.039331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757939f2-110a-4768-8da3-b0d8282cb47d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:39.041354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757939f2-110a-4768-8da3-b0d8282cb47d admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:39.042824 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec3716-fd98-4307-b137-7e27d649c01a None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:39.043671 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec3716-fd98-4307-b137-7e27d649c01a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:39.047162 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec3716-fd98-4307-b137-7e27d649c01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:39.070296 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-f8ec3716-fd98-4307-b137-7e27d649c01a None None] MFA Rules not processed for user `ff11e001afbb49e7af8d95f52db2882b`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:39.072900 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f8ec3716-fd98-4307-b137-7e27d649c01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:39.084823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1127/2235] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:48:38 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:39.086038 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757939f2-110a-4768-8da3-b0d8282cb47d admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:39.100756 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757939f2-110a-4768-8da3-b0d8282cb47d admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:39.106599 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0625f-b595-42a5-a9b7-b4b3751eb732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:39.107315 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0625f-b595-42a5-a9b7-b4b3751eb732 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:39.107598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0625f-b595-42a5-a9b7-b4b3751eb732 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:39.107882 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0625f-b595-42a5-a9b7-b4b3751eb732 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:39.109078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0625f-b595-42a5-a9b7-b4b3751eb732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:39.110772 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0625f-b595-42a5-a9b7-b4b3751eb732 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:39.124366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1128/2236] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:48:39.128770 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0625f-b595-42a5-a9b7-b4b3751eb732 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:39.143777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1109/2237] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:39.148657 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0625f-b595-42a5-a9b7-b4b3751eb732 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:39.154092 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1afd8-867f-40df-a193-8febc7f0d425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:39.155281 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1afd8-867f-40df-a193-8febc7f0d425 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:39.155738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1afd8-867f-40df-a193-8febc7f0d425 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:39.156412 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1afd8-867f-40df-a193-8febc7f0d425 admin admin] PATH_INFO: `/v3/projects/f78a1a4dccc8477e817be932abab2b16/users/45ab396e3b7840e6a90b1241fbd95010/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:39.179828 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1afd8-867f-40df-a193-8febc7f0d425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78a1a4dccc8477e817be932abab2b16, user_id=45ab396e3b7840e6a90b1241fbd95010, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:39.184264 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1afd8-867f-40df-a193-8febc7f0d425 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:39.202030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1129/2238] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:48:39 2022] PUT /identity/v3/projects/f78a1a4dccc8477e817be932abab2b16/users/45ab396e3b7840e6a90b1241fbd95010/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:39.206161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec3716-fd98-4307-b137-7e27d649c01a None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:39.219605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec3716-fd98-4307-b137-7e27d649c01a None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:39.319298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be9226-bdfa-47a8-be13-e8bd82846ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:39.320359 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be9226-bdfa-47a8-be13-e8bd82846ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:39.326011 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be9226-bdfa-47a8-be13-e8bd82846ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:39.326359 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be9226-bdfa-47a8-be13-e8bd82846ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:39.327163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be9226-bdfa-47a8-be13-e8bd82846ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:39.328948 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be9226-bdfa-47a8-be13-e8bd82846ee6 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:39.344929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1110/2239] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:39.349804 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1afd8-867f-40df-a193-8febc7f0d425 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:39.366823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1afd8-867f-40df-a193-8febc7f0d425 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:39.379834 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606c351-2a47-4ed5-8501-a0e50e5bcf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:39.381529 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606c351-2a47-4ed5-8501-a0e50e5bcf9f admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:39.381991 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606c351-2a47-4ed5-8501-a0e50e5bcf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:39.382346 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606c351-2a47-4ed5-8501-a0e50e5bcf9f admin admin] PATH_INFO: `/v3/projects/f78a1a4dccc8477e817be932abab2b16/users/45ab396e3b7840e6a90b1241fbd95010/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:39.386757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606c351-2a47-4ed5-8501-a0e50e5bcf9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78a1a4dccc8477e817be932abab2b16, user_id=45ab396e3b7840e6a90b1241fbd95010, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:39.390674 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606c351-2a47-4ed5-8501-a0e50e5bcf9f admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:39.408227 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1130/2240] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:48:39 2022] PUT /identity/v3/projects/f78a1a4dccc8477e817be932abab2b16/users/45ab396e3b7840e6a90b1241fbd95010/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:48.106290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f993d3-2d27-4026-9454-cc0ef8fb6542 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:48.107318 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f993d3-2d27-4026-9454-cc0ef8fb6542 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:48.107744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f993d3-2d27-4026-9454-cc0ef8fb6542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:48.203521 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-76f993d3-2d27-4026-9454-cc0ef8fb6542 None None] MFA Rules not processed for user `45ab396e3b7840e6a90b1241fbd95010`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:48.205764 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-76f993d3-2d27-4026-9454-cc0ef8fb6542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:48.349554 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1111/2241] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:48.479326 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606c351-2a47-4ed5-8501-a0e50e5bcf9f admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:48.484074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-6606c351-2a47-4ed5-8501-a0e50e5bcf9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:48.670401 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606c351-2a47-4ed5-8501-a0e50e5bcf9f admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:48.676298 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22331a8-c9f4-4713-b77a-2ed7eb4f212a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:48.677114 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22331a8-c9f4-4713-b77a-2ed7eb4f212a service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:48.677464 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22331a8-c9f4-4713-b77a-2ed7eb4f212a service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:48.677806 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22331a8-c9f4-4713-b77a-2ed7eb4f212a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:48.763826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22331a8-c9f4-4713-b77a-2ed7eb4f212a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:48.767160 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22331a8-c9f4-4713-b77a-2ed7eb4f212a service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:48.782774 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1131/2242] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:48:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:58.642837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e70ba-7780-49f8-8218-5ccd28fbed04 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:58.643457 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e70ba-7780-49f8-8218-5ccd28fbed04 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:58.643457 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e70ba-7780-49f8-8218-5ccd28fbed04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:58.661901 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-307e70ba-7780-49f8-8218-5ccd28fbed04 None None] MFA Rules not processed for user `440a9798bf914da4af0398483e23e33c`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:58.663130 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-307e70ba-7780-49f8-8218-5ccd28fbed04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:58.739319 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1112/2243] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:48:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:49:00.881779 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541cb22-c781-46b3-9fd4-4098adc0c406 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:00.882426 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541cb22-c781-46b3-9fd4-4098adc0c406 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:00.882426 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541cb22-c781-46b3-9fd4-4098adc0c406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:00.916818 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-4541cb22-c781-46b3-9fd4-4098adc0c406 None None] MFA Rules not processed for user `82b2e79995f94ab880f5d798ddd649b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:00.918220 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-4541cb22-c781-46b3-9fd4-4098adc0c406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:00.985005 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1132/2244] 10.222.0.11 () {58 vars in 1009 bytes} [Wed May 4 21:49:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:49:00.998170 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e70ba-7780-49f8-8218-5ccd28fbed04 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:00.999853 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-307e70ba-7780-49f8-8218-5ccd28fbed04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:01.077433 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e70ba-7780-49f8-8218-5ccd28fbed04 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:01.083170 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e9f79-d92a-4c3c-bf48-941e1b062b82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8358da535a104873ad9f5676989a9e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:01.083875 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e9f79-d92a-4c3c-bf48-941e1b062b82 service swift] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:01.084159 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e9f79-d92a-4c3c-bf48-941e1b062b82 service swift] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:01.084442 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e9f79-d92a-4c3c-bf48-941e1b062b82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:01.095674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e9f79-d92a-4c3c-bf48-941e1b062b82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:01.097425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e9f79-d92a-4c3c-bf48-941e1b062b82 service swift] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:01.108736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1113/2245] 10.222.0.11 () {60 vars in 1384 bytes} [Wed May 4 21:49:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:49:05.142912 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541cb22-c781-46b3-9fd4-4098adc0c406 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:05.274482 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541cb22-c781-46b3-9fd4-4098adc0c406 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:05.280206 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e29dc1-7bca-4ec8-83a6-f3c8988d038a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:05.281437 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e29dc1-7bca-4ec8-83a6-f3c8988d038a service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:05.281943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e29dc1-7bca-4ec8-83a6-f3c8988d038a service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:05.282848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e29dc1-7bca-4ec8-83a6-f3c8988d038a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:05.285328 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-b9e29dc1-7bca-4ec8-83a6-f3c8988d038a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:05.409839 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e29dc1-7bca-4ec8-83a6-f3c8988d038a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:05.411901 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e29dc1-7bca-4ec8-83a6-f3c8988d038a service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:05.430108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1133/2246] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:49:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:49:06.511938 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab0652-205e-4913-a58b-a70f6def2932 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:06.512589 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab0652-205e-4913-a58b-a70f6def2932 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:06.512589 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab0652-205e-4913-a58b-a70f6def2932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:06.545002 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-5fab0652-205e-4913-a58b-a70f6def2932 None None] MFA Rules not processed for user `82b2e79995f94ab880f5d798ddd649b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:06.547373 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-5fab0652-205e-4913-a58b-a70f6def2932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:06.599936 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1114/2247] 10.222.0.11 () {58 vars in 1009 bytes} [Wed May 4 21:49:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:49:06.620153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e29dc1-7bca-4ec8-83a6-f3c8988d038a service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:06.633236 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e29dc1-7bca-4ec8-83a6-f3c8988d038a service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:06.639656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39d18c-6888-4725-95de-4a35d7b3bc30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8358da535a104873ad9f5676989a9e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:06.640590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39d18c-6888-4725-95de-4a35d7b3bc30 service swift] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:06.641036 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39d18c-6888-4725-95de-4a35d7b3bc30 service swift] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:06.641472 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39d18c-6888-4725-95de-4a35d7b3bc30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:06.653745 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39d18c-6888-4725-95de-4a35d7b3bc30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:06.656978 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39d18c-6888-4725-95de-4a35d7b3bc30 service swift] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:06.666828 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1134/2248] 10.222.0.11 () {60 vars in 1384 bytes} [Wed May 4 21:49:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:49:12.197272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f7c4e-8284-4898-befe-104218658c05 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:12.198347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f7c4e-8284-4898-befe-104218658c05 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:12.198966 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f7c4e-8284-4898-befe-104218658c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:12.230360 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-2b6f7c4e-8284-4898-befe-104218658c05 None None] MFA Rules not processed for user `5bd12d925fbc44d69886993e247f7464`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:12.232218 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-2b6f7c4e-8284-4898-befe-104218658c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:12.245987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1115/2249] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:49:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:49:15.523850 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fa746-7aeb-4e3b-ad43-54488453a35b None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:15.524527 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fa746-7aeb-4e3b-ad43-54488453a35b None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:15.524661 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fa746-7aeb-4e3b-ad43-54488453a35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:15.546375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-8f9fa746-7aeb-4e3b-ad43-54488453a35b None None] MFA Rules not processed for user `82b2e79995f94ab880f5d798ddd649b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:15.547874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-8f9fa746-7aeb-4e3b-ad43-54488453a35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:15.555875 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1135/2250] 10.222.0.11 () {58 vars in 967 bytes} [Wed May 4 21:49:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:49:15.570190 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f7c4e-8284-4898-befe-104218658c05 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:15.604793 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f7c4e-8284-4898-befe-104218658c05 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:15.611728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b32a5-9116-427c-83a8-cf5096c1296f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8358da535a104873ad9f5676989a9e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:15.612529 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b32a5-9116-427c-83a8-cf5096c1296f service swift] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:15.612817 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b32a5-9116-427c-83a8-cf5096c1296f service swift] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:15.613090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b32a5-9116-427c-83a8-cf5096c1296f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:15.624465 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b32a5-9116-427c-83a8-cf5096c1296f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:15.626372 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b32a5-9116-427c-83a8-cf5096c1296f service swift] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:15.635709 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1116/2251] 10.222.0.11 () {60 vars in 1384 bytes} [Wed May 4 21:49:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:49:15.901265 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242ec27-c4a9-45f2-9ff2-3f04bdfb3bd7 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:15.902001 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242ec27-c4a9-45f2-9ff2-3f04bdfb3bd7 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:15.902466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242ec27-c4a9-45f2-9ff2-3f04bdfb3bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:15.927062 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-3242ec27-c4a9-45f2-9ff2-3f04bdfb3bd7 None None] MFA Rules not processed for user `82b2e79995f94ab880f5d798ddd649b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:15.928647 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-3242ec27-c4a9-45f2-9ff2-3f04bdfb3bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:15.937413 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1136/2252] 10.222.0.11 () {58 vars in 1009 bytes} [Wed May 4 21:49:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:49:15.952682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b32a5-9116-427c-83a8-cf5096c1296f service swift] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:15.964874 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b32a5-9116-427c-83a8-cf5096c1296f service swift] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:15.975767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96907a-0ac8-43d4-a367-7e413ca831e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8358da535a104873ad9f5676989a9e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:15.976653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96907a-0ac8-43d4-a367-7e413ca831e5 service swift] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:15.976987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96907a-0ac8-43d4-a367-7e413ca831e5 service swift] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:15.977319 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96907a-0ac8-43d4-a367-7e413ca831e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:15.986896 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96907a-0ac8-43d4-a367-7e413ca831e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:15.988519 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96907a-0ac8-43d4-a367-7e413ca831e5 service swift] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:15.997176 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1117/2253] 10.222.0.11 () {60 vars in 1384 bytes} [Wed May 4 21:49:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:49:16.356963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a3bed-bc4f-41ec-a3f9-6e991a05c8eb None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:16.357716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a3bed-bc4f-41ec-a3f9-6e991a05c8eb None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:16.358316 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a3bed-bc4f-41ec-a3f9-6e991a05c8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:16.393317 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-bd6a3bed-bc4f-41ec-a3f9-6e991a05c8eb None None] MFA Rules not processed for user `0196716439d4473498c7c4b15a1e1d24`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:16.395349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-bd6a3bed-bc4f-41ec-a3f9-6e991a05c8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:16.398851 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1bfaa-f829-412c-9038-de82ffbbb81c None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:16.399710 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1bfaa-f829-412c-9038-de82ffbbb81c None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:16.400061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1bfaa-f829-412c-9038-de82ffbbb81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:16.423968 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-86a1bfaa-f829-412c-9038-de82ffbbb81c None None] MFA Rules not processed for user `82b2e79995f94ab880f5d798ddd649b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:16.425673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-86a1bfaa-f829-412c-9038-de82ffbbb81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:16.437253 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1118/2254] 10.222.0.11 () {58 vars in 967 bytes} [Wed May 4 21:49:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:49:16.458871 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1bfaa-f829-412c-9038-de82ffbbb81c None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:16.474443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1bfaa-f829-412c-9038-de82ffbbb81c None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:16.479540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1137/2255] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:49:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:49:16.486632 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052afb5-2333-4b83-befd-cd2a9ea1cf7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8358da535a104873ad9f5676989a9e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:16.486632 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052afb5-2333-4b83-befd-cd2a9ea1cf7c service swift] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:16.487133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052afb5-2333-4b83-befd-cd2a9ea1cf7c service swift] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:16.487509 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052afb5-2333-4b83-befd-cd2a9ea1cf7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:16.497734 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052afb5-2333-4b83-befd-cd2a9ea1cf7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:16.499535 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052afb5-2333-4b83-befd-cd2a9ea1cf7c service swift] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:16.514318 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1119/2256] 10.222.0.11 () {60 vars in 1384 bytes} [Wed May 4 21:49:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:49:19.064643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a3bed-bc4f-41ec-a3f9-6e991a05c8eb None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:19.066972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-bd6a3bed-bc4f-41ec-a3f9-6e991a05c8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:19.197156 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a3bed-bc4f-41ec-a3f9-6e991a05c8eb None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:19.204243 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e63b9-7446-40ae-b31d-a2d02ba5e1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:19.206519 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e63b9-7446-40ae-b31d-a2d02ba5e1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:19.206954 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e63b9-7446-40ae-b31d-a2d02ba5e1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:19.207401 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e63b9-7446-40ae-b31d-a2d02ba5e1ef admin admin] PATH_INFO: `/v3/users/8f0858932cdd4a2991c21169ab07cb28` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:19.209162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e63b9-7446-40ae-b31d-a2d02ba5e1ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0858932cdd4a2991c21169ab07cb28)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:19.217369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e63b9-7446-40ae-b31d-a2d02ba5e1ef admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:19.352152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-cc6e63b9-7446-40ae-b31d-a2d02ba5e1ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0858932cdd4a2991c21169ab07cb28'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:19.374714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-cc6e63b9-7446-40ae-b31d-a2d02ba5e1ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0858932cdd4a2991c21169ab07cb28'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:19.375853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-cc6e63b9-7446-40ae-b31d-a2d02ba5e1ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0858932cdd4a2991c21169ab07cb28'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:19.402741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-cc6e63b9-7446-40ae-b31d-a2d02ba5e1ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0858932cdd4a2991c21169ab07cb28'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:19.414522 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-cc6e63b9-7446-40ae-b31d-a2d02ba5e1ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0858932cdd4a2991c21169ab07cb28'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:19.423911 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1138/2257] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:49:19 2022] DELETE /identity/v3/users/8f0858932cdd4a2991c21169ab07cb28 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:49:19.429371 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149e6bc-11e8-4c86-bddf-446ca8b2e2dc None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:19.430756 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149e6bc-11e8-4c86-bddf-446ca8b2e2dc None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:19.435575 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149e6bc-11e8-4c86-bddf-446ca8b2e2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:19.488099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-f149e6bc-11e8-4c86-bddf-446ca8b2e2dc None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:19.489352 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f149e6bc-11e8-4c86-bddf-446ca8b2e2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:19.645094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1120/2258] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:49:19.657172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e63b9-7446-40ae-b31d-a2d02ba5e1ef admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:19.658855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-cc6e63b9-7446-40ae-b31d-a2d02ba5e1ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:19.748002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e63b9-7446-40ae-b31d-a2d02ba5e1ef admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:19.755067 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1729c3-d118-4fa1-85be-2c456569a100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:19.756088 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1729c3-d118-4fa1-85be-2c456569a100 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:19.756571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1729c3-d118-4fa1-85be-2c456569a100 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:19.757044 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1729c3-d118-4fa1-85be-2c456569a100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:19.768298 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1729c3-d118-4fa1-85be-2c456569a100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:19.770171 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1729c3-d118-4fa1-85be-2c456569a100 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:19.789114 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1139/2259] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:49:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:49:19.972968 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149e6bc-11e8-4c86-bddf-446ca8b2e2dc None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:19.975007 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f149e6bc-11e8-4c86-bddf-446ca8b2e2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:19.995508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149e6bc-11e8-4c86-bddf-446ca8b2e2dc None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:20.001335 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484587cc-f1b7-4b22-952b-6496e5923677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:20.002308 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484587cc-f1b7-4b22-952b-6496e5923677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:20.002478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484587cc-f1b7-4b22-952b-6496e5923677 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:20.003065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484587cc-f1b7-4b22-952b-6496e5923677 admin admin] PATH_INFO: `/v3/projects/c0022ceeb35049c586796931a90af7b4` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:20.004237 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484587cc-f1b7-4b22-952b-6496e5923677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0022ceeb35049c586796931a90af7b4)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:20.006157 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484587cc-f1b7-4b22-952b-6496e5923677 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:20.063801 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-484587cc-f1b7-4b22-952b-6496e5923677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0022ceeb35049c586796931a90af7b4', 'request_id': 'req-484587cc-f1b7-4b22-952b-6496e5923677'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:20.070045 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-484587cc-f1b7-4b22-952b-6496e5923677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0022ceeb35049c586796931a90af7b4', 'request_id': 'req-484587cc-f1b7-4b22-952b-6496e5923677'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:20.077890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-484587cc-f1b7-4b22-952b-6496e5923677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0022ceeb35049c586796931a90af7b4', 'request_id': 'req-484587cc-f1b7-4b22-952b-6496e5923677'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:20.092505 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-484587cc-f1b7-4b22-952b-6496e5923677 admin admin] The token cache is being invalidate because project c0022ceeb35049c586796931a90af7b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:49:20.092804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-484587cc-f1b7-4b22-952b-6496e5923677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:20.093545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-484587cc-f1b7-4b22-952b-6496e5923677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:20.095293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1121/2260] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:49:19 2022] DELETE /identity/v3/projects/c0022ceeb35049c586796931a90af7b4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:49:20.100223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf92e1-a734-493d-8494-9faf7f351f56 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:20.100725 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf92e1-a734-493d-8494-9faf7f351f56 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:20.100918 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf92e1-a734-493d-8494-9faf7f351f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:20.158579 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-5ebf92e1-a734-493d-8494-9faf7f351f56 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:20.159866 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5ebf92e1-a734-493d-8494-9faf7f351f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:20.222929 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1140/2261] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:49:20.231194 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd2f64-b8e6-4b58-953e-c138ff45d085 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:20.231469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd2f64-b8e6-4b58-953e-c138ff45d085 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:20.231749 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd2f64-b8e6-4b58-953e-c138ff45d085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:20.250923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-7edd2f64-b8e6-4b58-953e-c138ff45d085 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:20.252257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-7edd2f64-b8e6-4b58-953e-c138ff45d085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:20.260596 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1122/2262] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:49:20.264926 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf92e1-a734-493d-8494-9faf7f351f56 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:20.275188 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf92e1-a734-493d-8494-9faf7f351f56 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:20.280154 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1c194-daf4-43fe-8b2f-20a9cf40b595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:20.280829 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1c194-daf4-43fe-8b2f-20a9cf40b595 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:20.281114 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1c194-daf4-43fe-8b2f-20a9cf40b595 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:20.281394 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1c194-daf4-43fe-8b2f-20a9cf40b595 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:20.282127 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1c194-daf4-43fe-8b2f-20a9cf40b595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:49:20.282439 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1c194-daf4-43fe-8b2f-20a9cf40b595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:20.284228 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1c194-daf4-43fe-8b2f-20a9cf40b595 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:20.296331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1141/2263] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 21:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:49:20.300847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd2f64-b8e6-4b58-953e-c138ff45d085 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:20.310287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd2f64-b8e6-4b58-953e-c138ff45d085 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:20.315073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c3422-1df7-4b1f-93d9-e3bf35798e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:20.315727 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c3422-1df7-4b1f-93d9-e3bf35798e2c admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:20.316007 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c3422-1df7-4b1f-93d9-e3bf35798e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:20.316282 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c3422-1df7-4b1f-93d9-e3bf35798e2c admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:20.316967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c3422-1df7-4b1f-93d9-e3bf35798e2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:20.318854 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c3422-1df7-4b1f-93d9-e3bf35798e2c admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:20.349773 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1123/2264] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 21:49:20 2022] POST /identity/v3/projects => generated 397 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:49:20.351172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1c194-daf4-43fe-8b2f-20a9cf40b595 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:20.361706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1c194-daf4-43fe-8b2f-20a9cf40b595 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:20.462837 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34512eb-ac49-49b4-be9f-445a4c028afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:20.464015 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34512eb-ac49-49b4-be9f-445a4c028afa admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:20.464457 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34512eb-ac49-49b4-be9f-445a4c028afa admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:20.464935 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34512eb-ac49-49b4-be9f-445a4c028afa admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:20.465792 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34512eb-ac49-49b4-be9f-445a4c028afa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:20.468249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34512eb-ac49-49b4-be9f-445a4c028afa admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:20.495960 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1142/2265] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 21:49:20 2022] POST /identity/v3/users => generated 299 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:49:20.497664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c3422-1df7-4b1f-93d9-e3bf35798e2c admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:20.509263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c3422-1df7-4b1f-93d9-e3bf35798e2c admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:20.514460 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd50a9e-2acd-4385-813c-5a236bdb381f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:20.515473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd50a9e-2acd-4385-813c-5a236bdb381f admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:20.515990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd50a9e-2acd-4385-813c-5a236bdb381f admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:20.516360 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd50a9e-2acd-4385-813c-5a236bdb381f admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:20.517288 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd50a9e-2acd-4385-813c-5a236bdb381f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:20.518991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd50a9e-2acd-4385-813c-5a236bdb381f admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:20.530802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1124/2266] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:49:20.534792 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34512eb-ac49-49b4-be9f-445a4c028afa admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:20.545011 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34512eb-ac49-49b4-be9f-445a4c028afa admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:20.555601 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14aade-5fcd-47bc-8f40-667d1e0114b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:20.556420 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14aade-5fcd-47bc-8f40-667d1e0114b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:20.556780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14aade-5fcd-47bc-8f40-667d1e0114b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:20.557058 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14aade-5fcd-47bc-8f40-667d1e0114b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:20.558243 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14aade-5fcd-47bc-8f40-667d1e0114b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:20.559470 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14aade-5fcd-47bc-8f40-667d1e0114b9 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:20.576119 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1143/2267] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 21:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:49:20.580237 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd50a9e-2acd-4385-813c-5a236bdb381f admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:20.594270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd50a9e-2acd-4385-813c-5a236bdb381f admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:20.599001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefe2ba-d7b9-46a3-9318-bc680a831b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:20.600022 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefe2ba-d7b9-46a3-9318-bc680a831b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:20.600302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefe2ba-d7b9-46a3-9318-bc680a831b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:20.600572 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefe2ba-d7b9-46a3-9318-bc680a831b88 admin admin] PATH_INFO: `/v3/projects/bad9909ab03c40248c6eaab49544b7d8/users/03a125b1ed57446895a8dd8f5cfbab0e/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:20.617096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefe2ba-d7b9-46a3-9318-bc680a831b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bad9909ab03c40248c6eaab49544b7d8, user_id=03a125b1ed57446895a8dd8f5cfbab0e, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:20.620319 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefe2ba-d7b9-46a3-9318-bc680a831b88 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:20.643305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1125/2268] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 21:49:20 2022] PUT /identity/v3/projects/bad9909ab03c40248c6eaab49544b7d8/users/03a125b1ed57446895a8dd8f5cfbab0e/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:49:20.654451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35a13e-5fb1-4e5a-a472-4f6b76a335fa None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:20.654741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35a13e-5fb1-4e5a-a472-4f6b76a335fa None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:20.655025 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35a13e-5fb1-4e5a-a472-4f6b76a335fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:20.685908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-2a35a13e-5fb1-4e5a-a472-4f6b76a335fa None None] MFA Rules not processed for user `03a125b1ed57446895a8dd8f5cfbab0e`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:20.687340 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-2a35a13e-5fb1-4e5a-a472-4f6b76a335fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:20.797019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1144/2269] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:49:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:49:20.804049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefe2ba-d7b9-46a3-9318-bc680a831b88 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:20.807157 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-7aefe2ba-d7b9-46a3-9318-bc680a831b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:20.896276 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefe2ba-d7b9-46a3-9318-bc680a831b88 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:20.900262 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004179e6-67f4-47c6-8601-483f49d990d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:20.901007 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004179e6-67f4-47c6-8601-483f49d990d3 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:20.901352 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004179e6-67f4-47c6-8601-483f49d990d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:20.901690 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004179e6-67f4-47c6-8601-483f49d990d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:20.911467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004179e6-67f4-47c6-8601-483f49d990d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:20.913073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004179e6-67f4-47c6-8601-483f49d990d3 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:20.925692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1126/2270] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:49:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:49:22.465350 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9046447-7a4b-48a1-9ce4-21e7d3ec03c0 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:22.465919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9046447-7a4b-48a1-9ce4-21e7d3ec03c0 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:22.466197 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9046447-7a4b-48a1-9ce4-21e7d3ec03c0 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:22.468409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1145/2271] 10.222.0.11 () {54 vars in 921 bytes} [Wed May 4 21:49:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:49:22.474796 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf379a-15b2-448a-8e19-ddccb9c389c7 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:22.475354 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf379a-15b2-448a-8e19-ddccb9c389c7 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:22.476352 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf379a-15b2-448a-8e19-ddccb9c389c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:22.539418 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-9caf379a-15b2-448a-8e19-ddccb9c389c7 None None] MFA Rules not processed for user `f4f207481ccb4cfcbbcffd9df73d2985`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:22.541157 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-9caf379a-15b2-448a-8e19-ddccb9c389c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:22.682865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1127/2272] 10.222.0.11 () {58 vars in 1018 bytes} [Wed May 4 21:49:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:49:22.702752 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9046447-7a4b-48a1-9ce4-21e7d3ec03c0 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:22.705233 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-d9046447-7a4b-48a1-9ce4-21e7d3ec03c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:22.789707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9046447-7a4b-48a1-9ce4-21e7d3ec03c0 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:22.793341 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee6188-4e09-41ed-a47a-57930297a0c4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c61205d7e96f496ab9f8ca84ab9408b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:22.793981 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee6188-4e09-41ed-a47a-57930297a0c4 service glance] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:22.794268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee6188-4e09-41ed-a47a-57930297a0c4 service glance] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:22.794545 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee6188-4e09-41ed-a47a-57930297a0c4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:22.804965 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee6188-4e09-41ed-a47a-57930297a0c4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:22.806478 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee6188-4e09-41ed-a47a-57930297a0c4 service glance] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:22.817968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1146/2273] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:49:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:49:22.885258 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4afcd0-946e-446b-8ec8-ea27b4c82b86 None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:22.885600 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4afcd0-946e-446b-8ec8-ea27b4c82b86 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:22.885819 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4afcd0-946e-446b-8ec8-ea27b4c82b86 None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:22.887440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1128/2274] 10.222.0.11 () {54 vars in 921 bytes} [Wed May 4 21:49:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:49:22.892877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc30230-e37b-4004-9036-7509254316cf None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:22.893257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc30230-e37b-4004-9036-7509254316cf None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:22.893610 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc30230-e37b-4004-9036-7509254316cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:22.912912 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-6dc30230-e37b-4004-9036-7509254316cf None None] MFA Rules not processed for user `e4e5d4fe283447c59672398a26dea225`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:22.914138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-6dc30230-e37b-4004-9036-7509254316cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:22.968784 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1147/2275] 10.222.0.11 () {58 vars in 1018 bytes} [Wed May 4 21:49:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:49:22.981060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4afcd0-946e-446b-8ec8-ea27b4c82b86 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:22.982806 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-bb4afcd0-946e-446b-8ec8-ea27b4c82b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:22.996753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4afcd0-946e-446b-8ec8-ea27b4c82b86 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:23.001267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f681f72-c2ea-4797-aab7-5419c4e5872f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:23.001918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f681f72-c2ea-4797-aab7-5419c4e5872f service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:23.002196 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f681f72-c2ea-4797-aab7-5419c4e5872f service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:23.002469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f681f72-c2ea-4797-aab7-5419c4e5872f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:23.010298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f681f72-c2ea-4797-aab7-5419c4e5872f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:23.011775 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f681f72-c2ea-4797-aab7-5419c4e5872f service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:23.019900 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1129/2276] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:49:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:49:23.139324 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf53e0-b76b-4016-ba79-7eee5df86de2 None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:23.139722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf53e0-b76b-4016-ba79-7eee5df86de2 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:23.140070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf53e0-b76b-4016-ba79-7eee5df86de2 None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:23.141660 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1148/2277] 10.222.0.11 () {54 vars in 921 bytes} [Wed May 4 21:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:49:23.148872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919e293-a3e6-4b04-bbaa-622d9973db54 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:23.149364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919e293-a3e6-4b04-bbaa-622d9973db54 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:23.150016 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919e293-a3e6-4b04-bbaa-622d9973db54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:23.169064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-c919e293-a3e6-4b04-bbaa-622d9973db54 None None] MFA Rules not processed for user `f4f207481ccb4cfcbbcffd9df73d2985`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:23.170549 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c919e293-a3e6-4b04-bbaa-622d9973db54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:23.181982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1130/2278] 10.222.0.11 () {58 vars in 1018 bytes} [Wed May 4 21:49:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:49:23.194133 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf53e0-b76b-4016-ba79-7eee5df86de2 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:23.205142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf53e0-b76b-4016-ba79-7eee5df86de2 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:23.212847 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c798b0-22b0-43e9-beec-212a5d0bf11c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:23.213533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c798b0-22b0-43e9-beec-212a5d0bf11c service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:23.214321 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c798b0-22b0-43e9-beec-212a5d0bf11c service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:23.214321 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c798b0-22b0-43e9-beec-212a5d0bf11c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:23.225657 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c798b0-22b0-43e9-beec-212a5d0bf11c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:23.227325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c798b0-22b0-43e9-beec-212a5d0bf11c service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:23.240135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1149/2279] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:49:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:49:29.278610 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919e293-a3e6-4b04-bbaa-622d9973db54 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:29.377628 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919e293-a3e6-4b04-bbaa-622d9973db54 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:29.383958 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c1e04-515e-413c-89d7-a279a0baef60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:29.385107 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c1e04-515e-413c-89d7-a279a0baef60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:29.385457 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c1e04-515e-413c-89d7-a279a0baef60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:29.385815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c1e04-515e-413c-89d7-a279a0baef60 admin admin] PATH_INFO: `/v3/users/03a125b1ed57446895a8dd8f5cfbab0e` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:29.388028 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c1e04-515e-413c-89d7-a279a0baef60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03a125b1ed57446895a8dd8f5cfbab0e)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:29.390679 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c1e04-515e-413c-89d7-a279a0baef60 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:29.446963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8e5c1e04-515e-413c-89d7-a279a0baef60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03a125b1ed57446895a8dd8f5cfbab0e'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:29.455789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8e5c1e04-515e-413c-89d7-a279a0baef60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03a125b1ed57446895a8dd8f5cfbab0e'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:29.463670 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8e5c1e04-515e-413c-89d7-a279a0baef60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03a125b1ed57446895a8dd8f5cfbab0e'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:29.464485 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8e5c1e04-515e-413c-89d7-a279a0baef60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03a125b1ed57446895a8dd8f5cfbab0e'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:29.465079 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8e5c1e04-515e-413c-89d7-a279a0baef60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03a125b1ed57446895a8dd8f5cfbab0e'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:29.495798 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1131/2280] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 21:49:29 2022] DELETE /identity/v3/users/03a125b1ed57446895a8dd8f5cfbab0e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:49:29.500235 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75eed5-63ed-4647-8931-a92039911b13 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:29.500722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75eed5-63ed-4647-8931-a92039911b13 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:29.500827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75eed5-63ed-4647-8931-a92039911b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:29.520772 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-5e75eed5-63ed-4647-8931-a92039911b13 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:29.521964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5e75eed5-63ed-4647-8931-a92039911b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:29.582344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1150/2281] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:49:29.593063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c1e04-515e-413c-89d7-a279a0baef60 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:29.594583 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-8e5c1e04-515e-413c-89d7-a279a0baef60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:29.652599 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c1e04-515e-413c-89d7-a279a0baef60 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:29.656331 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65c3a5-5376-405f-9aac-bf689540b2dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:29.656982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65c3a5-5376-405f-9aac-bf689540b2dd service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:29.657263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65c3a5-5376-405f-9aac-bf689540b2dd service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:29.657537 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65c3a5-5376-405f-9aac-bf689540b2dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:29.667212 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65c3a5-5376-405f-9aac-bf689540b2dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:29.668670 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65c3a5-5376-405f-9aac-bf689540b2dd service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:29.678373 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1132/2282] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:49:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:49:29.972995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75eed5-63ed-4647-8931-a92039911b13 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:29.974706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5e75eed5-63ed-4647-8931-a92039911b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:29.998929 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75eed5-63ed-4647-8931-a92039911b13 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:30.005363 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e80213-0e82-469a-82cb-11d7321dfcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:30.006129 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e80213-0e82-469a-82cb-11d7321dfcd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:30.006713 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e80213-0e82-469a-82cb-11d7321dfcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:30.006879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e80213-0e82-469a-82cb-11d7321dfcd1 admin admin] PATH_INFO: `/v3/projects/bad9909ab03c40248c6eaab49544b7d8` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:30.008152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e80213-0e82-469a-82cb-11d7321dfcd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bad9909ab03c40248c6eaab49544b7d8)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:30.010214 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e80213-0e82-469a-82cb-11d7321dfcd1 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:30.057702 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-36e80213-0e82-469a-82cb-11d7321dfcd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bad9909ab03c40248c6eaab49544b7d8', 'request_id': 'req-36e80213-0e82-469a-82cb-11d7321dfcd1'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:30.069097 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-36e80213-0e82-469a-82cb-11d7321dfcd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bad9909ab03c40248c6eaab49544b7d8', 'request_id': 'req-36e80213-0e82-469a-82cb-11d7321dfcd1'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:30.076935 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-36e80213-0e82-469a-82cb-11d7321dfcd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bad9909ab03c40248c6eaab49544b7d8', 'request_id': 'req-36e80213-0e82-469a-82cb-11d7321dfcd1'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:30.088328 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-36e80213-0e82-469a-82cb-11d7321dfcd1 admin admin] The token cache is being invalidate because project bad9909ab03c40248c6eaab49544b7d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:49:30.088618 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-36e80213-0e82-469a-82cb-11d7321dfcd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:30.089304 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-36e80213-0e82-469a-82cb-11d7321dfcd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:30.090885 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1151/2283] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 21:49:29 2022] DELETE /identity/v3/projects/bad9909ab03c40248c6eaab49544b7d8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:49:30.742684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95645933-00db-413d-a354-9c3b0caf6ff9 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:30.743252 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95645933-00db-413d-a354-9c3b0caf6ff9 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:30.743338 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95645933-00db-413d-a354-9c3b0caf6ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:30.794221 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-95645933-00db-413d-a354-9c3b0caf6ff9 None None] MFA Rules not processed for user `82b2e79995f94ab880f5d798ddd649b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:30.795464 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-95645933-00db-413d-a354-9c3b0caf6ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:30.869484 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1133/2284] 10.222.0.11 () {58 vars in 1009 bytes} [Wed May 4 21:49:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:49:30.882207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e80213-0e82-469a-82cb-11d7321dfcd1 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:30.883828 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-36e80213-0e82-469a-82cb-11d7321dfcd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:30.977691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e80213-0e82-469a-82cb-11d7321dfcd1 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:30.983382 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14970e-f41e-4b4c-88d5-506770aa117e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8358da535a104873ad9f5676989a9e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:30.984041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14970e-f41e-4b4c-88d5-506770aa117e service swift] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:30.984325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14970e-f41e-4b4c-88d5-506770aa117e service swift] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:30.984603 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14970e-f41e-4b4c-88d5-506770aa117e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:30.994788 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14970e-f41e-4b4c-88d5-506770aa117e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:30.996889 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14970e-f41e-4b4c-88d5-506770aa117e service swift] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:31.005438 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1152/2285] 10.222.0.11 () {60 vars in 1384 bytes} [Wed May 4 21:49:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:49:45.841251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95645933-00db-413d-a354-9c3b0caf6ff9 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:45.843300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-95645933-00db-413d-a354-9c3b0caf6ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:45.936601 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95645933-00db-413d-a354-9c3b0caf6ff9 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:45.942044 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005dc89-1475-4234-98ad-b453d82ad096 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e203d7077af54930a640b2334a1d8fa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:45.942734 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005dc89-1475-4234-98ad-b453d82ad096 service placement] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:45.943071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005dc89-1475-4234-98ad-b453d82ad096 service placement] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:45.943369 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005dc89-1475-4234-98ad-b453d82ad096 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:45.945193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a005dc89-1475-4234-98ad-b453d82ad096 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:45.957511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005dc89-1475-4234-98ad-b453d82ad096 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:45.959167 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005dc89-1475-4234-98ad-b453d82ad096 service placement] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:45.969763 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1134/2286] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:49:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:50:00.761938 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14970e-f41e-4b4c-88d5-506770aa117e service swift] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:50:00.763697 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-4a14970e-f41e-4b4c-88d5-506770aa117e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:00.827780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14970e-f41e-4b4c-88d5-506770aa117e service swift] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:50:00.831783 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a158d2-2e78-4443-be1d-6465b1f9f2a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:50:00.832520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a158d2-2e78-4443-be1d-6465b1f9f2a4 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:00.832804 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a158d2-2e78-4443-be1d-6465b1f9f2a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:00.833082 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a158d2-2e78-4443-be1d-6465b1f9f2a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:00.835178 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-76a158d2-2e78-4443-be1d-6465b1f9f2a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:00.906507 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a158d2-2e78-4443-be1d-6465b1f9f2a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:50:00.907993 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a158d2-2e78-4443-be1d-6465b1f9f2a4 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:50:00.917324 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1153/2287] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:50:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:50:09.318307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b9637-8252-4460-a737-b4146a6b7741 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:09.318808 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b9637-8252-4460-a737-b4146a6b7741 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:09.319456 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b9637-8252-4460-a737-b4146a6b7741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:09.345540 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-0b4b9637-8252-4460-a737-b4146a6b7741 None None] MFA Rules not processed for user `82b2e79995f94ab880f5d798ddd649b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:50:09.346874 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-0b4b9637-8252-4460-a737-b4146a6b7741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:09.363187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1135/2288] 10.222.0.11 () {58 vars in 967 bytes} [Wed May 4 21:50:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:50:09.384528 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a158d2-2e78-4443-be1d-6465b1f9f2a4 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:50:09.397305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a158d2-2e78-4443-be1d-6465b1f9f2a4 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:50:09.402751 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb098b0b-f188-4b56-b64b-c4df32976584 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8358da535a104873ad9f5676989a9e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:50:09.403489 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb098b0b-f188-4b56-b64b-c4df32976584 service swift] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:09.403829 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb098b0b-f188-4b56-b64b-c4df32976584 service swift] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:09.404212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb098b0b-f188-4b56-b64b-c4df32976584 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:09.414768 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb098b0b-f188-4b56-b64b-c4df32976584 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:50:09.416647 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb098b0b-f188-4b56-b64b-c4df32976584 service swift] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:50:09.428236 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1154/2289] 10.222.0.11 () {60 vars in 1384 bytes} [Wed May 4 21:50:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:50:20.171689 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa989061-1ce0-4de2-806b-bb5edd5cb85c None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:20.172251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa989061-1ce0-4de2-806b-bb5edd5cb85c None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:20.172251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa989061-1ce0-4de2-806b-bb5edd5cb85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:20.192357 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-aa989061-1ce0-4de2-806b-bb5edd5cb85c None None] MFA Rules not processed for user `ff11e001afbb49e7af8d95f52db2882b`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:50:20.193882 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-aa989061-1ce0-4de2-806b-bb5edd5cb85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:20.255222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1136/2290] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:50:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:51:28.788029 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb098b0b-f188-4b56-b64b-c4df32976584 service swift] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:28.789441 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-eb098b0b-f188-4b56-b64b-c4df32976584 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:28.801856 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb098b0b-f188-4b56-b64b-c4df32976584 service swift] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:28.805833 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da0b85-bbd5-4d60-965f-1d31115ed8a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:28.806634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da0b85-bbd5-4d60-965f-1d31115ed8a0 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:28.806979 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da0b85-bbd5-4d60-965f-1d31115ed8a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:28.807326 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da0b85-bbd5-4d60-965f-1d31115ed8a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:28.809377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-55da0b85-bbd5-4d60-965f-1d31115ed8a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:28.894546 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da0b85-bbd5-4d60-965f-1d31115ed8a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:28.895935 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da0b85-bbd5-4d60-965f-1d31115ed8a0 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:28.906962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1155/2291] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:51:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:51:29.305073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa989061-1ce0-4de2-806b-bb5edd5cb85c None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:29.316096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa989061-1ce0-4de2-806b-bb5edd5cb85c None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:29.320599 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de718d-05e7-4fca-93f0-46d987a6726c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:29.321240 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de718d-05e7-4fca-93f0-46d987a6726c service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:29.321560 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de718d-05e7-4fca-93f0-46d987a6726c service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:29.321862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de718d-05e7-4fca-93f0-46d987a6726c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:29.324076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-54de718d-05e7-4fca-93f0-46d987a6726c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:29.338070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de718d-05e7-4fca-93f0-46d987a6726c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:29.339534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de718d-05e7-4fca-93f0-46d987a6726c service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:29.350528 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1137/2292] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:51:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:51:38.659099 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da0b85-bbd5-4d60-965f-1d31115ed8a0 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:38.667738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da0b85-bbd5-4d60-965f-1d31115ed8a0 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:38.671698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc26dd-2f69-4151-8a93-789a601341a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:38.672345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc26dd-2f69-4151-8a93-789a601341a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:38.672651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc26dd-2f69-4151-8a93-789a601341a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:38.672924 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc26dd-2f69-4151-8a93-789a601341a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:38.674840 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-b6cc26dd-2f69-4151-8a93-789a601341a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:38.702710 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de718d-05e7-4fca-93f0-46d987a6726c service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:38.704254 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-54de718d-05e7-4fca-93f0-46d987a6726c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:38.718447 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de718d-05e7-4fca-93f0-46d987a6726c service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:38.725165 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814a351-0830-499c-8b9e-bff948373c2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:38.725827 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814a351-0830-499c-8b9e-bff948373c2a service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:38.726061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814a351-0830-499c-8b9e-bff948373c2a service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:38.726364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814a351-0830-499c-8b9e-bff948373c2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:38.729781 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-9814a351-0830-499c-8b9e-bff948373c2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:38.737972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc26dd-2f69-4151-8a93-789a601341a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:38.739590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc26dd-2f69-4151-8a93-789a601341a6 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:38.740702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814a351-0830-499c-8b9e-bff948373c2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:38.742448 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814a351-0830-499c-8b9e-bff948373c2a service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:38.749562 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1156/2293] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:51:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:51:38.753237 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1138/2294] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:51:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:51:39.294618 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc26dd-2f69-4151-8a93-789a601341a6 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:39.296183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-b6cc26dd-2f69-4151-8a93-789a601341a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:39.312262 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc26dd-2f69-4151-8a93-789a601341a6 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:39.319303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f4e50-da68-4dd8-b378-2e8489b6054e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:39.319981 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f4e50-da68-4dd8-b378-2e8489b6054e service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:39.320260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f4e50-da68-4dd8-b378-2e8489b6054e service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:39.320531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f4e50-da68-4dd8-b378-2e8489b6054e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:39.322521 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-490f4e50-da68-4dd8-b378-2e8489b6054e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:39.381885 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f4e50-da68-4dd8-b378-2e8489b6054e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:39.383606 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f4e50-da68-4dd8-b378-2e8489b6054e service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:39.393222 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1157/2295] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:51:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:51:45.252161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7067ef6-7793-4393-a5cf-6e9c8b9cf1c6 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:45.252685 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7067ef6-7793-4393-a5cf-6e9c8b9cf1c6 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:45.252793 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7067ef6-7793-4393-a5cf-6e9c8b9cf1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:45.270862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-e7067ef6-7793-4393-a5cf-6e9c8b9cf1c6 None None] MFA Rules not processed for user `49618ca42d8d43a4ac419c352f7d0042`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:51:45.272098 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e7067ef6-7793-4393-a5cf-6e9c8b9cf1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:45.279736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1139/2296] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:51:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:51:46.147592 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f4e50-da68-4dd8-b378-2e8489b6054e service nova] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:46.159350 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f4e50-da68-4dd8-b378-2e8489b6054e service nova] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:46.166412 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cc012-c453-4695-bbbc-6192c1fe848d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e203d7077af54930a640b2334a1d8fa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:46.166729 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cc012-c453-4695-bbbc-6192c1fe848d service placement] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:46.166914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cc012-c453-4695-bbbc-6192c1fe848d service placement] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:46.167209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cc012-c453-4695-bbbc-6192c1fe848d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:46.169068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-586cc012-c453-4695-bbbc-6192c1fe848d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:46.181512 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cc012-c453-4695-bbbc-6192c1fe848d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:46.183354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cc012-c453-4695-bbbc-6192c1fe848d service placement] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:46.193885 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1158/2297] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:51:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:51:47.979685 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7067ef6-7793-4393-a5cf-6e9c8b9cf1c6 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:47.990318 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7067ef6-7793-4393-a5cf-6e9c8b9cf1c6 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:47.994434 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88e113-abf7-42c8-b8a8-a62b4f9ee591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:47.995135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88e113-abf7-42c8-b8a8-a62b4f9ee591 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:47.995412 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88e113-abf7-42c8-b8a8-a62b4f9ee591 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:47.995689 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88e113-abf7-42c8-b8a8-a62b4f9ee591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:47.997569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-bc88e113-abf7-42c8-b8a8-a62b4f9ee591 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:48.007971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88e113-abf7-42c8-b8a8-a62b4f9ee591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:48.009500 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88e113-abf7-42c8-b8a8-a62b4f9ee591 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:48.018159 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1140/2298] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:51:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:51:54.783407 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cc012-c453-4695-bbbc-6192c1fe848d service placement] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:54.799034 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cc012-c453-4695-bbbc-6192c1fe848d service placement] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:54.806260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58ce9d-0bcf-400f-86b8-9c79a359ced4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:54.806947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58ce9d-0bcf-400f-86b8-9c79a359ced4 service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:54.807272 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58ce9d-0bcf-400f-86b8-9c79a359ced4 service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:54.807545 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58ce9d-0bcf-400f-86b8-9c79a359ced4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:54.809581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-dd58ce9d-0bcf-400f-86b8-9c79a359ced4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:54.872950 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58ce9d-0bcf-400f-86b8-9c79a359ced4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:54.874575 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58ce9d-0bcf-400f-86b8-9c79a359ced4 service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:54.883942 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1159/2299] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:51:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:51:56.260016 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488471f-1646-43ff-abc0-fafbd3c492fd None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:56.260589 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488471f-1646-43ff-abc0-fafbd3c492fd None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:56.260589 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488471f-1646-43ff-abc0-fafbd3c492fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:56.280588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-c488471f-1646-43ff-abc0-fafbd3c492fd None None] MFA Rules not processed for user `440a9798bf914da4af0398483e23e33c`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:51:56.282017 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c488471f-1646-43ff-abc0-fafbd3c492fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:56.291477 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1141/2300] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 21:51:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:01.703685 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58ce9d-0bcf-400f-86b8-9c79a359ced4 service nova] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:01.715806 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58ce9d-0bcf-400f-86b8-9c79a359ced4 service nova] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:01.722690 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd266ed-2138-4a11-9957-0bb745fbcb3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:01.723459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd266ed-2138-4a11-9957-0bb745fbcb3b service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:01.723744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd266ed-2138-4a11-9957-0bb745fbcb3b service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:01.724023 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd266ed-2138-4a11-9957-0bb745fbcb3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:01.725829 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ecd266ed-2138-4a11-9957-0bb745fbcb3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:01.738114 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd266ed-2138-4a11-9957-0bb745fbcb3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:01.739736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd266ed-2138-4a11-9957-0bb745fbcb3b service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:01.750177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1160/2301] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:52:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:52:36.521612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488471f-1646-43ff-abc0-fafbd3c492fd None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:36.544364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488471f-1646-43ff-abc0-fafbd3c492fd None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:36.551619 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0ffc2-52cc-4e81-bf4e-e2c8e5836cac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:36.552269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0ffc2-52cc-4e81-bf4e-e2c8e5836cac service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:36.552553 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0ffc2-52cc-4e81-bf4e-e2c8e5836cac service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:36.552827 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0ffc2-52cc-4e81-bf4e-e2c8e5836cac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:36.555062 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-4cb0ffc2-52cc-4e81-bf4e-e2c8e5836cac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:36.617252 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0ffc2-52cc-4e81-bf4e-e2c8e5836cac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:36.618859 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0ffc2-52cc-4e81-bf4e-e2c8e5836cac service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:36.627953 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1142/2302] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:52:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:53:08.633183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd266ed-2138-4a11-9957-0bb745fbcb3b service nova] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:53:08.649223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd266ed-2138-4a11-9957-0bb745fbcb3b service nova] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:53:08.656423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a7bb9-54b6-436e-b137-46b9d1cd2493 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:53:08.657114 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a7bb9-54b6-436e-b137-46b9d1cd2493 service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:53:08.657475 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a7bb9-54b6-436e-b137-46b9d1cd2493 service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:53:08.657756 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a7bb9-54b6-436e-b137-46b9d1cd2493 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:53:08.659981 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-f37a7bb9-54b6-436e-b137-46b9d1cd2493 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:53:08.728433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a7bb9-54b6-436e-b137-46b9d1cd2493 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:53:08.730617 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a7bb9-54b6-436e-b137-46b9d1cd2493 service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:53:08.743271 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1161/2303] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:53:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:53:39.966808 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0ffc2-52cc-4e81-bf4e-e2c8e5836cac service nova] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:53:39.969047 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-4cb0ffc2-52cc-4e81-bf4e-e2c8e5836cac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:53:40.044525 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0ffc2-52cc-4e81-bf4e-e2c8e5836cac service nova] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:53:40.049289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa28ad-56b7-4580-b009-320911663da4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:53:40.049973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa28ad-56b7-4580-b009-320911663da4 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:53:40.050254 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa28ad-56b7-4580-b009-320911663da4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:53:40.050541 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa28ad-56b7-4580-b009-320911663da4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:53:40.052760 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-aeaa28ad-56b7-4580-b009-320911663da4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:53:40.064964 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa28ad-56b7-4580-b009-320911663da4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:53:40.066396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa28ad-56b7-4580-b009-320911663da4 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:53:40.076311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1143/2304] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:53:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:53:49.801696 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a7bb9-54b6-436e-b137-46b9d1cd2493 service nova] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:53:49.820451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a7bb9-54b6-436e-b137-46b9d1cd2493 service nova] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:53:49.828820 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe255c-fd4e-4c3e-824c-f9444463005b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:53:49.829480 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe255c-fd4e-4c3e-824c-f9444463005b service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:53:49.829769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe255c-fd4e-4c3e-824c-f9444463005b service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:53:49.830040 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe255c-fd4e-4c3e-824c-f9444463005b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:53:49.832105 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-d0fe255c-fd4e-4c3e-824c-f9444463005b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:53:49.895371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe255c-fd4e-4c3e-824c-f9444463005b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:53:49.896868 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe255c-fd4e-4c3e-824c-f9444463005b service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:53:49.906228 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1162/2305] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:53:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:55:37.253849 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa28ad-56b7-4580-b009-320911663da4 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:55:37.266387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa28ad-56b7-4580-b009-320911663da4 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:55:37.272430 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de451b9-fec2-490e-96d3-615e0bb145a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e203d7077af54930a640b2334a1d8fa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:55:37.273079 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de451b9-fec2-490e-96d3-615e0bb145a5 service placement] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:55:37.273367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de451b9-fec2-490e-96d3-615e0bb145a5 service placement] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:55:37.273641 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de451b9-fec2-490e-96d3-615e0bb145a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:55:37.282320 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de451b9-fec2-490e-96d3-615e0bb145a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:55:37.284100 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de451b9-fec2-490e-96d3-615e0bb145a5 service placement] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:55:37.293849 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1144/2306] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:55:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:56:28.653057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe255c-fd4e-4c3e-824c-f9444463005b service nova] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:56:28.667967 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe255c-fd4e-4c3e-824c-f9444463005b service nova] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:56:28.674619 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e6c95-c363-4048-a339-9f11fcda12af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:56:28.675310 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e6c95-c363-4048-a339-9f11fcda12af service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:56:28.675667 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e6c95-c363-4048-a339-9f11fcda12af service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:56:28.676041 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e6c95-c363-4048-a339-9f11fcda12af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:56:28.688652 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e6c95-c363-4048-a339-9f11fcda12af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:56:28.690580 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e6c95-c363-4048-a339-9f11fcda12af service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:56:28.701893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1163/2307] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:56:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:56:38.759431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de451b9-fec2-490e-96d3-615e0bb145a5 service placement] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:56:38.772570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de451b9-fec2-490e-96d3-615e0bb145a5 service placement] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:56:38.779550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655b968-c75d-4513-b7c7-b7a5bb5fe6a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:56:38.780188 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655b968-c75d-4513-b7c7-b7a5bb5fe6a0 service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:56:38.780469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655b968-c75d-4513-b7c7-b7a5bb5fe6a0 service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:56:38.780739 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655b968-c75d-4513-b7c7-b7a5bb5fe6a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:56:38.789563 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655b968-c75d-4513-b7c7-b7a5bb5fe6a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:56:38.791193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655b968-c75d-4513-b7c7-b7a5bb5fe6a0 service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:56:38.800558 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1145/2308] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:56:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:57:37.988597 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e6c95-c363-4048-a339-9f11fcda12af service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:57:37.999454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e6c95-c363-4048-a339-9f11fcda12af service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:57:38.004101 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf88e74-1b16-453a-9255-5fb275890089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:57:38.004739 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf88e74-1b16-453a-9255-5fb275890089 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:57:38.005047 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf88e74-1b16-453a-9255-5fb275890089 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:57:38.005318 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf88e74-1b16-453a-9255-5fb275890089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:57:38.013606 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf88e74-1b16-453a-9255-5fb275890089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:57:38.015071 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf88e74-1b16-453a-9255-5fb275890089 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:57:38.024405 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1164/2309] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:57:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:57:40.708198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655b968-c75d-4513-b7c7-b7a5bb5fe6a0 service nova] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:57:40.720156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655b968-c75d-4513-b7c7-b7a5bb5fe6a0 service nova] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:57:40.724772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def6508-f6ec-4e85-8dd3-4069ad67d5c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:57:40.725508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def6508-f6ec-4e85-8dd3-4069ad67d5c7 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:57:40.725844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def6508-f6ec-4e85-8dd3-4069ad67d5c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:57:40.726172 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def6508-f6ec-4e85-8dd3-4069ad67d5c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:57:40.735556 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def6508-f6ec-4e85-8dd3-4069ad67d5c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:57:40.736984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def6508-f6ec-4e85-8dd3-4069ad67d5c7 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:57:40.765565 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1146/2310] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:57:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:57:40.814960 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf88e74-1b16-453a-9255-5fb275890089 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:57:40.824451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf88e74-1b16-453a-9255-5fb275890089 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:57:40.828291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6fb31-7ed5-4fb3-a2f5-f282277a27cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:57:40.828934 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6fb31-7ed5-4fb3-a2f5-f282277a27cf service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:57:40.829221 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6fb31-7ed5-4fb3-a2f5-f282277a27cf service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:57:40.829499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6fb31-7ed5-4fb3-a2f5-f282277a27cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:57:40.840378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6fb31-7ed5-4fb3-a2f5-f282277a27cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:57:40.841804 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6fb31-7ed5-4fb3-a2f5-f282277a27cf service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:57:40.852746 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1165/2311] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:57:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:57:40.894348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def6508-f6ec-4e85-8dd3-4069ad67d5c7 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:57:40.903468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def6508-f6ec-4e85-8dd3-4069ad67d5c7 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:57:40.907277 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b736129-fa22-4a54-b107-8fb1a5a17138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:57:40.907956 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b736129-fa22-4a54-b107-8fb1a5a17138 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:57:40.908241 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b736129-fa22-4a54-b107-8fb1a5a17138 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:57:40.908515 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b736129-fa22-4a54-b107-8fb1a5a17138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:57:40.917234 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b736129-fa22-4a54-b107-8fb1a5a17138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:57:40.918823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b736129-fa22-4a54-b107-8fb1a5a17138 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:57:40.947902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1147/2312] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:57:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:57:40.985280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6fb31-7ed5-4fb3-a2f5-f282277a27cf service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:57:40.997139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6fb31-7ed5-4fb3-a2f5-f282277a27cf service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:57:41.003394 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619356b1-8ad5-4d8c-9f81-6a6379da00cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:57:41.004244 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619356b1-8ad5-4d8c-9f81-6a6379da00cb service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:57:41.004609 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619356b1-8ad5-4d8c-9f81-6a6379da00cb service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:57:41.004988 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619356b1-8ad5-4d8c-9f81-6a6379da00cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:57:41.016113 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619356b1-8ad5-4d8c-9f81-6a6379da00cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:57:41.017792 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619356b1-8ad5-4d8c-9f81-6a6379da00cb service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:57:41.046409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1166/2313] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:57:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:58:24.532094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b736129-fa22-4a54-b107-8fb1a5a17138 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:24.544700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b736129-fa22-4a54-b107-8fb1a5a17138 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:24.550622 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084ea5f-2918-423e-b779-a5863d3c7bd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:24.551340 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084ea5f-2918-423e-b779-a5863d3c7bd1 service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:24.551624 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084ea5f-2918-423e-b779-a5863d3c7bd1 service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:24.551964 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084ea5f-2918-423e-b779-a5863d3c7bd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:24.560582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084ea5f-2918-423e-b779-a5863d3c7bd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:24.562302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084ea5f-2918-423e-b779-a5863d3c7bd1 service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:24.595712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1148/2314] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:58:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:59:41.176594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619356b1-8ad5-4d8c-9f81-6a6379da00cb service nova] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:41.182733 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084ea5f-2918-423e-b779-a5863d3c7bd1 service nova] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:41.216018 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619356b1-8ad5-4d8c-9f81-6a6379da00cb service nova] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:41.219836 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96002e99-12da-4020-9f02-0771dec66235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:41.220493 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96002e99-12da-4020-9f02-0771dec66235 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:41.220779 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96002e99-12da-4020-9f02-0771dec66235 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:41.221061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96002e99-12da-4020-9f02-0771dec66235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:41.238423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96002e99-12da-4020-9f02-0771dec66235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:41.240081 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96002e99-12da-4020-9f02-0771dec66235 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:41.249466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084ea5f-2918-423e-b779-a5863d3c7bd1 service nova] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:41.255550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad699ef1-7cce-42cb-9bc1-27f23a7dd3b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:41.256314 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad699ef1-7cce-42cb-9bc1-27f23a7dd3b5 service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:41.256598 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad699ef1-7cce-42cb-9bc1-27f23a7dd3b5 service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:41.256872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad699ef1-7cce-42cb-9bc1-27f23a7dd3b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:41.267563 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad699ef1-7cce-42cb-9bc1-27f23a7dd3b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:41.269378 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad699ef1-7cce-42cb-9bc1-27f23a7dd3b5 service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:41.270234 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1167/2315] 10.222.0.11 () {60 vars in 1396 bytes} [Wed May 4 21:59:41 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:59:41.299081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1149/2316] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 21:59:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:00:42.259811 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96002e99-12da-4020-9f02-0771dec66235 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:00:42.261979 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-96002e99-12da-4020-9f02-0771dec66235 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:00:42.367374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96002e99-12da-4020-9f02-0771dec66235 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:00:42.375120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be4290-f0ea-484f-ab8f-039f622c677b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e203d7077af54930a640b2334a1d8fa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:00:42.376148 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be4290-f0ea-484f-ab8f-039f622c677b service placement] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:00:42.376626 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be4290-f0ea-484f-ab8f-039f622c677b service placement] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:00:42.377063 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be4290-f0ea-484f-ab8f-039f622c677b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:00:42.380738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-e2be4290-f0ea-484f-ab8f-039f622c677b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:00:42.395648 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be4290-f0ea-484f-ab8f-039f622c677b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:00:42.397239 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be4290-f0ea-484f-ab8f-039f622c677b service placement] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:00:42.407714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1168/2317] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:00:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:01:41.509611 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad699ef1-7cce-42cb-9bc1-27f23a7dd3b5 service nova] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:01:41.520139 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad699ef1-7cce-42cb-9bc1-27f23a7dd3b5 service nova] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:01:41.524797 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979fcd9-6250-452b-8ee4-5921fb6d0395 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:01:41.525594 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979fcd9-6250-452b-8ee4-5921fb6d0395 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:01:41.525884 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979fcd9-6250-452b-8ee4-5921fb6d0395 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:01:41.526158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979fcd9-6250-452b-8ee4-5921fb6d0395 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:01:41.528640 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-4979fcd9-6250-452b-8ee4-5921fb6d0395 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:01:41.615782 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979fcd9-6250-452b-8ee4-5921fb6d0395 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:01:41.617297 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979fcd9-6250-452b-8ee4-5921fb6d0395 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:01:41.628397 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1150/2318] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:01:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:01:41.752653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be4290-f0ea-484f-ab8f-039f622c677b service placement] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:01:41.762460 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be4290-f0ea-484f-ab8f-039f622c677b service placement] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:01:41.766291 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedf2d0-7ca6-4a47-8d31-0dbe2816b6e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:01:41.766937 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedf2d0-7ca6-4a47-8d31-0dbe2816b6e4 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:01:41.767255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedf2d0-7ca6-4a47-8d31-0dbe2816b6e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:01:41.767534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedf2d0-7ca6-4a47-8d31-0dbe2816b6e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:01:41.769468 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-1fedf2d0-7ca6-4a47-8d31-0dbe2816b6e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:01:41.850953 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fedf2d0-7ca6-4a47-8d31-0dbe2816b6e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:01:41.852522 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fedf2d0-7ca6-4a47-8d31-0dbe2816b6e4 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:01:41.870823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1169/2319] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:01:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:02:25.611302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979fcd9-6250-452b-8ee4-5921fb6d0395 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:02:25.612878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-4979fcd9-6250-452b-8ee4-5921fb6d0395 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:02:25.694025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979fcd9-6250-452b-8ee4-5921fb6d0395 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:02:25.698899 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a46e1-27aa-4349-b118-51ae8413003c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:02:25.699712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a46e1-27aa-4349-b118-51ae8413003c service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:02:25.700170 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a46e1-27aa-4349-b118-51ae8413003c service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:02:25.700536 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a46e1-27aa-4349-b118-51ae8413003c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:02:25.704043 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ab2a46e1-27aa-4349-b118-51ae8413003c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:02:25.792130 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a46e1-27aa-4349-b118-51ae8413003c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:02:25.793572 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a46e1-27aa-4349-b118-51ae8413003c service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:02:25.812556 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1151/2320] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:02:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:02:29.284386 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedf2d0-7ca6-4a47-8d31-0dbe2816b6e4 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:02:29.285913 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-1fedf2d0-7ca6-4a47-8d31-0dbe2816b6e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:02:29.301453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedf2d0-7ca6-4a47-8d31-0dbe2816b6e4 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:02:29.306303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9920fa-67c1-4240-ac03-5fa7302bf972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:02:29.308463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9920fa-67c1-4240-ac03-5fa7302bf972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:02:29.308755 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9920fa-67c1-4240-ac03-5fa7302bf972 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:02:29.309034 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9920fa-67c1-4240-ac03-5fa7302bf972 admin admin] PATH_INFO: `/v3/users/49618ca42d8d43a4ac419c352f7d0042` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:02:29.325486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9920fa-67c1-4240-ac03-5fa7302bf972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49618ca42d8d43a4ac419c352f7d0042)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:02:29.327519 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9920fa-67c1-4240-ac03-5fa7302bf972 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:02:29.377148 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4d9920fa-67c1-4240-ac03-5fa7302bf972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49618ca42d8d43a4ac419c352f7d0042'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:02:29.384812 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4d9920fa-67c1-4240-ac03-5fa7302bf972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49618ca42d8d43a4ac419c352f7d0042'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:02:29.385487 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4d9920fa-67c1-4240-ac03-5fa7302bf972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49618ca42d8d43a4ac419c352f7d0042'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:02:29.396724 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4d9920fa-67c1-4240-ac03-5fa7302bf972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49618ca42d8d43a4ac419c352f7d0042'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:02:29.405934 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4d9920fa-67c1-4240-ac03-5fa7302bf972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49618ca42d8d43a4ac419c352f7d0042'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:02:29.412526 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1170/2321] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:02:29 2022] DELETE /identity/v3/users/49618ca42d8d43a4ac419c352f7d0042 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:02:29.592074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a46e1-27aa-4349-b118-51ae8413003c service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:02:29.601805 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a46e1-27aa-4349-b118-51ae8413003c service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:02:29.660260 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d4f6b-98fb-4e63-b2c8-88fe7da5d453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:02:29.661186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d4f6b-98fb-4e63-b2c8-88fe7da5d453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:02:29.661475 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d4f6b-98fb-4e63-b2c8-88fe7da5d453 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:02:29.661753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d4f6b-98fb-4e63-b2c8-88fe7da5d453 admin admin] PATH_INFO: `/v3/projects/1f6fb9972fe0474ca47445634bcf06e0` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:02:29.662977 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d4f6b-98fb-4e63-b2c8-88fe7da5d453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f6fb9972fe0474ca47445634bcf06e0)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:02:29.664984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d4f6b-98fb-4e63-b2c8-88fe7da5d453 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:02:29.713008 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-994d4f6b-98fb-4e63-b2c8-88fe7da5d453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f6fb9972fe0474ca47445634bcf06e0', 'request_id': 'req-994d4f6b-98fb-4e63-b2c8-88fe7da5d453'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:02:29.720217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-994d4f6b-98fb-4e63-b2c8-88fe7da5d453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f6fb9972fe0474ca47445634bcf06e0', 'request_id': 'req-994d4f6b-98fb-4e63-b2c8-88fe7da5d453'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:02:29.732648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-994d4f6b-98fb-4e63-b2c8-88fe7da5d453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f6fb9972fe0474ca47445634bcf06e0', 'request_id': 'req-994d4f6b-98fb-4e63-b2c8-88fe7da5d453'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:02:29.742792 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-994d4f6b-98fb-4e63-b2c8-88fe7da5d453 admin admin] The token cache is being invalidate because project 1f6fb9972fe0474ca47445634bcf06e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:02:29.743109 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-994d4f6b-98fb-4e63-b2c8-88fe7da5d453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:02:29.743839 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-994d4f6b-98fb-4e63-b2c8-88fe7da5d453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:02:29.745291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1152/2322] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:02:29 2022] DELETE /identity/v3/projects/1f6fb9972fe0474ca47445634bcf06e0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:02:29.751486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b3290-4b88-4d5d-8493-e39097fbffec None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:02:29.751781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b3290-4b88-4d5d-8493-e39097fbffec None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:02:29.752068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b3290-4b88-4d5d-8493-e39097fbffec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:02:29.808314 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-062b3290-4b88-4d5d-8493-e39097fbffec None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:02:29.809536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-062b3290-4b88-4d5d-8493-e39097fbffec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:02:29.876896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1171/2323] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 22:02:29.888207 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b458d-2cd6-4c40-a561-26bf781b847e None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:02:29.888529 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b458d-2cd6-4c40-a561-26bf781b847e None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:02:29.888808 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b458d-2cd6-4c40-a561-26bf781b847e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:02:29.908374 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-db5b458d-2cd6-4c40-a561-26bf781b847e None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:02:29.909566 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-db5b458d-2cd6-4c40-a561-26bf781b847e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:02:29.919296 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1153/2324] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:02:29.925305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b3290-4b88-4d5d-8493-e39097fbffec None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:02:29.941181 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b3290-4b88-4d5d-8493-e39097fbffec None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:02:29.950229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a1810-2f9f-4f6f-aaec-832ec3ad026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:02:29.950983 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a1810-2f9f-4f6f-aaec-832ec3ad026a admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:02:29.951311 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a1810-2f9f-4f6f-aaec-832ec3ad026a admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:02:29.951594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a1810-2f9f-4f6f-aaec-832ec3ad026a admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:02:29.952335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a1810-2f9f-4f6f-aaec-832ec3ad026a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:02:29.952652 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a1810-2f9f-4f6f-aaec-832ec3ad026a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:02:29.954303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a1810-2f9f-4f6f-aaec-832ec3ad026a admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:02:29.967240 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1172/2325] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:02:29.971726 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b458d-2cd6-4c40-a561-26bf781b847e None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:02:29.981475 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b458d-2cd6-4c40-a561-26bf781b847e None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:02:29.987341 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0c7fe-03c2-41e1-9b6c-08d710cd5c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:02:29.987986 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0c7fe-03c2-41e1-9b6c-08d710cd5c87 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:02:29.988266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0c7fe-03c2-41e1-9b6c-08d710cd5c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:02:29.988536 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0c7fe-03c2-41e1-9b6c-08d710cd5c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:02:29.989222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0c7fe-03c2-41e1-9b6c-08d710cd5c87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:02:29.991136 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0c7fe-03c2-41e1-9b6c-08d710cd5c87 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:02:30.035869 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1154/2326] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:02:29 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:02:30.042523 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a1810-2f9f-4f6f-aaec-832ec3ad026a admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:02:30.053809 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a1810-2f9f-4f6f-aaec-832ec3ad026a admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:02:30.112758 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc3905-4c68-47eb-919a-1d0e783722ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:02:30.113458 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc3905-4c68-47eb-919a-1d0e783722ee admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:02:30.113746 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc3905-4c68-47eb-919a-1d0e783722ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:02:30.114025 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc3905-4c68-47eb-919a-1d0e783722ee admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:02:30.114716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc3905-4c68-47eb-919a-1d0e783722ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:02:30.116690 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc3905-4c68-47eb-919a-1d0e783722ee admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:02:30.139469 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1173/2327] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:02:30 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:02:30.143643 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0c7fe-03c2-41e1-9b6c-08d710cd5c87 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:02:30.154275 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0c7fe-03c2-41e1-9b6c-08d710cd5c87 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:02:30.159513 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf644a-eb6c-499e-ae6d-e6306d53ef17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:02:30.160188 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf644a-eb6c-499e-ae6d-e6306d53ef17 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:02:30.160467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf644a-eb6c-499e-ae6d-e6306d53ef17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:02:30.160741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf644a-eb6c-499e-ae6d-e6306d53ef17 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:02:30.161473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf644a-eb6c-499e-ae6d-e6306d53ef17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:02:30.163116 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf644a-eb6c-499e-ae6d-e6306d53ef17 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:02:30.173620 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1155/2328] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:02:30.177908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc3905-4c68-47eb-919a-1d0e783722ee admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:02:30.188650 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc3905-4c68-47eb-919a-1d0e783722ee admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:02:30.193541 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50b7eb-0761-4c71-a3eb-3b5b3b4e221a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:02:30.194208 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50b7eb-0761-4c71-a3eb-3b5b3b4e221a admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:02:30.194499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50b7eb-0761-4c71-a3eb-3b5b3b4e221a admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:02:30.194779 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50b7eb-0761-4c71-a3eb-3b5b3b4e221a admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:02:30.195549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50b7eb-0761-4c71-a3eb-3b5b3b4e221a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:02:30.197162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50b7eb-0761-4c71-a3eb-3b5b3b4e221a admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:02:30.207808 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1174/2329] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:02:30.212168 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf644a-eb6c-499e-ae6d-e6306d53ef17 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:02:30.223460 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf644a-eb6c-499e-ae6d-e6306d53ef17 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:02:30.229225 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42501103-a7f4-4250-9a0f-fbcb2d121f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:02:30.230120 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42501103-a7f4-4250-9a0f-fbcb2d121f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:02:30.230433 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42501103-a7f4-4250-9a0f-fbcb2d121f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:02:30.230668 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42501103-a7f4-4250-9a0f-fbcb2d121f74 admin admin] PATH_INFO: `/v3/projects/e2d719ae8d574bdcafec8ea909e0dbd7/users/3f84e46d71af430f835f12744b89b667/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:02:30.249342 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42501103-a7f4-4250-9a0f-fbcb2d121f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d719ae8d574bdcafec8ea909e0dbd7, user_id=3f84e46d71af430f835f12744b89b667, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:02:30.252069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42501103-a7f4-4250-9a0f-fbcb2d121f74 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:02:30.269328 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1156/2330] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:02:30 2022] PUT /identity/v3/projects/e2d719ae8d574bdcafec8ea909e0dbd7/users/3f84e46d71af430f835f12744b89b667/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:02:30.283408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc17ca0-7c3a-4134-a917-4cc2e1dbf2da None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:02:30.283851 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc17ca0-7c3a-4134-a917-4cc2e1dbf2da None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:02:30.284134 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc17ca0-7c3a-4134-a917-4cc2e1dbf2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:02:30.312411 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-ecc17ca0-7c3a-4134-a917-4cc2e1dbf2da None None] MFA Rules not processed for user `3f84e46d71af430f835f12744b89b667`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:02:30.313622 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ecc17ca0-7c3a-4134-a917-4cc2e1dbf2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:02:30.378340 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1175/2331] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:02:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:02:40.952528 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42501103-a7f4-4250-9a0f-fbcb2d121f74 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:02:40.954531 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-42501103-a7f4-4250-9a0f-fbcb2d121f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:02:41.019621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42501103-a7f4-4250-9a0f-fbcb2d121f74 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:02:41.024469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c90c78-4b72-4b19-8e28-efe83f4a2f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:02:41.025130 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c90c78-4b72-4b19-8e28-efe83f4a2f14 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:02:41.025418 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c90c78-4b72-4b19-8e28-efe83f4a2f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:02:41.025693 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c90c78-4b72-4b19-8e28-efe83f4a2f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:02:41.027904 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-54c90c78-4b72-4b19-8e28-efe83f4a2f14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:02:41.038302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c90c78-4b72-4b19-8e28-efe83f4a2f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:02:41.039775 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c90c78-4b72-4b19-8e28-efe83f4a2f14 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:02:41.048043 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1157/2332] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:02:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:02:41.380672 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc17ca0-7c3a-4134-a917-4cc2e1dbf2da None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:02:41.382416 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ecc17ca0-7c3a-4134-a917-4cc2e1dbf2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:02:41.457192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc17ca0-7c3a-4134-a917-4cc2e1dbf2da None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:02:41.462744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab0bc7-f61e-4d3b-adef-5c28f6df3676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:02:41.463437 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab0bc7-f61e-4d3b-adef-5c28f6df3676 service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:02:41.463724 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab0bc7-f61e-4d3b-adef-5c28f6df3676 service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:02:41.464004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab0bc7-f61e-4d3b-adef-5c28f6df3676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:02:41.466404 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-28ab0bc7-f61e-4d3b-adef-5c28f6df3676 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:02:41.534810 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab0bc7-f61e-4d3b-adef-5c28f6df3676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:02:41.536449 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab0bc7-f61e-4d3b-adef-5c28f6df3676 service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:02:41.545664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1176/2333] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:02:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:03:30.444005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c90c78-4b72-4b19-8e28-efe83f4a2f14 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:30.521770 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c90c78-4b72-4b19-8e28-efe83f4a2f14 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:30.526777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c98a00-7e23-4ed2-8215-c8f92d4b0b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:30.527677 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c98a00-7e23-4ed2-8215-c8f92d4b0b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:30.527971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c98a00-7e23-4ed2-8215-c8f92d4b0b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:30.528263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c98a00-7e23-4ed2-8215-c8f92d4b0b84 admin admin] PATH_INFO: `/v3/users/3f84e46d71af430f835f12744b89b667` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:30.529614 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c98a00-7e23-4ed2-8215-c8f92d4b0b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f84e46d71af430f835f12744b89b667)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:30.531577 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c98a00-7e23-4ed2-8215-c8f92d4b0b84 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:30.583850 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e8c98a00-7e23-4ed2-8215-c8f92d4b0b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f84e46d71af430f835f12744b89b667'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:30.593547 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e8c98a00-7e23-4ed2-8215-c8f92d4b0b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f84e46d71af430f835f12744b89b667'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:30.600779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e8c98a00-7e23-4ed2-8215-c8f92d4b0b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f84e46d71af430f835f12744b89b667'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:30.601414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e8c98a00-7e23-4ed2-8215-c8f92d4b0b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f84e46d71af430f835f12744b89b667'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:30.602030 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e8c98a00-7e23-4ed2-8215-c8f92d4b0b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f84e46d71af430f835f12744b89b667'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:30.620153 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1158/2334] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:03:30 2022] DELETE /identity/v3/users/3f84e46d71af430f835f12744b89b667 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:03:30.624917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ca29c-107c-400f-a44c-96426e3ddf78 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:30.625441 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ca29c-107c-400f-a44c-96426e3ddf78 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:30.625441 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ca29c-107c-400f-a44c-96426e3ddf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:30.642535 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-4a7ca29c-107c-400f-a44c-96426e3ddf78 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:03:30.643810 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-4a7ca29c-107c-400f-a44c-96426e3ddf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:30.702502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1177/2335] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:03:30.716263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c98a00-7e23-4ed2-8215-c8f92d4b0b84 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:30.718744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e8c98a00-7e23-4ed2-8215-c8f92d4b0b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:30.787249 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c98a00-7e23-4ed2-8215-c8f92d4b0b84 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:30.791492 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9185b-928e-4535-9888-2185b711c0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:30.792151 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9185b-928e-4535-9888-2185b711c0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:30.792409 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9185b-928e-4535-9888-2185b711c0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:30.792715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9185b-928e-4535-9888-2185b711c0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:30.803465 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9185b-928e-4535-9888-2185b711c0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:30.804928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9185b-928e-4535-9888-2185b711c0e2 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:30.815806 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1159/2336] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:03:31.099574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ca29c-107c-400f-a44c-96426e3ddf78 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:31.101581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-4a7ca29c-107c-400f-a44c-96426e3ddf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:31.113746 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ca29c-107c-400f-a44c-96426e3ddf78 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:31.122693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d4f5a-386d-411c-9e91-9603f3310d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:31.122693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d4f5a-386d-411c-9e91-9603f3310d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:31.122693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d4f5a-386d-411c-9e91-9603f3310d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:31.122693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d4f5a-386d-411c-9e91-9603f3310d7b admin admin] PATH_INFO: `/v3/projects/e2d719ae8d574bdcafec8ea909e0dbd7` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:31.123528 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d4f5a-386d-411c-9e91-9603f3310d7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d719ae8d574bdcafec8ea909e0dbd7)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:31.125083 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d4f5a-386d-411c-9e91-9603f3310d7b admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:31.181111 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ae1d4f5a-386d-411c-9e91-9603f3310d7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d719ae8d574bdcafec8ea909e0dbd7', 'request_id': 'req-ae1d4f5a-386d-411c-9e91-9603f3310d7b'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:31.189867 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ae1d4f5a-386d-411c-9e91-9603f3310d7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d719ae8d574bdcafec8ea909e0dbd7', 'request_id': 'req-ae1d4f5a-386d-411c-9e91-9603f3310d7b'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:31.196431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ae1d4f5a-386d-411c-9e91-9603f3310d7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d719ae8d574bdcafec8ea909e0dbd7', 'request_id': 'req-ae1d4f5a-386d-411c-9e91-9603f3310d7b'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:31.207563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ae1d4f5a-386d-411c-9e91-9603f3310d7b admin admin] The token cache is being invalidate because project e2d719ae8d574bdcafec8ea909e0dbd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:03:31.207847 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ae1d4f5a-386d-411c-9e91-9603f3310d7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:31.208559 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ae1d4f5a-386d-411c-9e91-9603f3310d7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:31.210213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1178/2337] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:03:31 2022] DELETE /identity/v3/projects/e2d719ae8d574bdcafec8ea909e0dbd7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:03:31.228481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bb438-6380-4201-8e5d-32e7938ee257 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:31.228768 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bb438-6380-4201-8e5d-32e7938ee257 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:31.229048 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bb438-6380-4201-8e5d-32e7938ee257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:31.247609 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-6c6bb438-6380-4201-8e5d-32e7938ee257 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:03:31.248796 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-6c6bb438-6380-4201-8e5d-32e7938ee257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:31.307998 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1160/2338] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:03:31.318197 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a5ebe-d5a8-4662-b089-353ff517b832 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:31.318533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a5ebe-d5a8-4662-b089-353ff517b832 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:31.318810 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a5ebe-d5a8-4662-b089-353ff517b832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:31.339486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-b55a5ebe-d5a8-4662-b089-353ff517b832 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:03:31.340688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-b55a5ebe-d5a8-4662-b089-353ff517b832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:31.349241 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1179/2339] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:03:31.353758 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bb438-6380-4201-8e5d-32e7938ee257 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:31.364009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bb438-6380-4201-8e5d-32e7938ee257 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:31.369015 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bad788-6b1c-4868-a560-62985417392b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:31.369709 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bad788-6b1c-4868-a560-62985417392b admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:31.369997 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bad788-6b1c-4868-a560-62985417392b admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:31.370258 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bad788-6b1c-4868-a560-62985417392b admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:31.370987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bad788-6b1c-4868-a560-62985417392b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:03:31.371330 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bad788-6b1c-4868-a560-62985417392b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:31.373043 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bad788-6b1c-4868-a560-62985417392b admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:31.384439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1161/2340] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:03:31.388930 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a5ebe-d5a8-4662-b089-353ff517b832 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:31.398134 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a5ebe-d5a8-4662-b089-353ff517b832 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:31.403081 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb856f-a49f-4111-ba23-ef462f680aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:31.403733 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb856f-a49f-4111-ba23-ef462f680aeb admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:31.404013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb856f-a49f-4111-ba23-ef462f680aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:31.404283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb856f-a49f-4111-ba23-ef462f680aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:31.404968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb856f-a49f-4111-ba23-ef462f680aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:31.406865 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb856f-a49f-4111-ba23-ef462f680aeb admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:31.433655 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1180/2341] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:03:31 2022] POST /identity/v3/projects => generated 403 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:03:31.438423 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bad788-6b1c-4868-a560-62985417392b admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:31.452862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bad788-6b1c-4868-a560-62985417392b admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:31.522589 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3ca22-b5af-47e8-beb3-5dec1093d875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:31.523321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3ca22-b5af-47e8-beb3-5dec1093d875 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:31.523613 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3ca22-b5af-47e8-beb3-5dec1093d875 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:31.523868 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3ca22-b5af-47e8-beb3-5dec1093d875 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:31.524586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3ca22-b5af-47e8-beb3-5dec1093d875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:31.526573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3ca22-b5af-47e8-beb3-5dec1093d875 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:31.548620 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1162/2342] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:03:31 2022] POST /identity/v3/users => generated 302 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:03:31.554274 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb856f-a49f-4111-ba23-ef462f680aeb admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:31.565410 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb856f-a49f-4111-ba23-ef462f680aeb admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:31.571159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbd1a6-f8d1-4f8e-89b9-bd619174da98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:31.571858 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbd1a6-f8d1-4f8e-89b9-bd619174da98 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:31.572139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbd1a6-f8d1-4f8e-89b9-bd619174da98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:31.572413 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbd1a6-f8d1-4f8e-89b9-bd619174da98 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:31.573138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbd1a6-f8d1-4f8e-89b9-bd619174da98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:31.574754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbd1a6-f8d1-4f8e-89b9-bd619174da98 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:31.585515 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1181/2343] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:03:31.589983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3ca22-b5af-47e8-beb3-5dec1093d875 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:31.600481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3ca22-b5af-47e8-beb3-5dec1093d875 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:31.606182 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b109a4-47f5-496d-92db-821b2bd2a0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:31.606970 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b109a4-47f5-496d-92db-821b2bd2a0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:31.607292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b109a4-47f5-496d-92db-821b2bd2a0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:31.607562 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b109a4-47f5-496d-92db-821b2bd2a0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:31.608292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b109a4-47f5-496d-92db-821b2bd2a0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:31.609893 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b109a4-47f5-496d-92db-821b2bd2a0e1 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:31.619960 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1163/2344] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:03:31.624979 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbd1a6-f8d1-4f8e-89b9-bd619174da98 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:31.634969 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbd1a6-f8d1-4f8e-89b9-bd619174da98 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:31.640665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30e98b-8a44-4d22-b739-f78ba47c9760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:31.641562 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30e98b-8a44-4d22-b739-f78ba47c9760 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:31.641831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30e98b-8a44-4d22-b739-f78ba47c9760 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:31.642123 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30e98b-8a44-4d22-b739-f78ba47c9760 admin admin] PATH_INFO: `/v3/projects/b8893f052f5042689391dc3e012fd350/users/2547a09c133a4c6981cdd98ab4b815d0/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:31.657465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30e98b-8a44-4d22-b739-f78ba47c9760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8893f052f5042689391dc3e012fd350, user_id=2547a09c133a4c6981cdd98ab4b815d0, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:31.660201 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30e98b-8a44-4d22-b739-f78ba47c9760 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:31.676024 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1182/2345] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:03:31 2022] PUT /identity/v3/projects/b8893f052f5042689391dc3e012fd350/users/2547a09c133a4c6981cdd98ab4b815d0/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:03:31.681258 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a51b4a-eab4-4d80-ae4d-2ffff1b94500 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:31.681549 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a51b4a-eab4-4d80-ae4d-2ffff1b94500 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:31.681826 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a51b4a-eab4-4d80-ae4d-2ffff1b94500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:31.700534 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-55a51b4a-eab4-4d80-ae4d-2ffff1b94500 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:03:31.701721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-55a51b4a-eab4-4d80-ae4d-2ffff1b94500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:31.766566 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1164/2346] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 22:03:31.778644 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30e98b-8a44-4d22-b739-f78ba47c9760 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:31.780669 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-8c30e98b-8a44-4d22-b739-f78ba47c9760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:31.845829 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30e98b-8a44-4d22-b739-f78ba47c9760 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:31.850576 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e114f16-eac6-497a-8d94-7ca5baa88dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:31.851196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114f16-eac6-497a-8d94-7ca5baa88dbd service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:31.851475 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114f16-eac6-497a-8d94-7ca5baa88dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:31.851747 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114f16-eac6-497a-8d94-7ca5baa88dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:31.862014 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e114f16-eac6-497a-8d94-7ca5baa88dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:31.863497 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e114f16-eac6-497a-8d94-7ca5baa88dbd service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:31.873108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1183/2347] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:03:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:03:32.479678 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ff073-f7d2-47db-abb0-1c3702cf718a None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:32.480194 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ff073-f7d2-47db-abb0-1c3702cf718a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:32.480311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ff073-f7d2-47db-abb0-1c3702cf718a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:32.510050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-908ff073-f7d2-47db-abb0-1c3702cf718a None None] MFA Rules not processed for user `2547a09c133a4c6981cdd98ab4b815d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:03:32.511405 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-908ff073-f7d2-47db-abb0-1c3702cf718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:32.576241 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1165/2348] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:03:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:03:32.580592 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e114f16-eac6-497a-8d94-7ca5baa88dbd service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:32.591700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e114f16-eac6-497a-8d94-7ca5baa88dbd service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:32.596895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae32c8a-8f00-44a4-81f4-9b0996eb0215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:32.597560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae32c8a-8f00-44a4-81f4-9b0996eb0215 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:32.597841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae32c8a-8f00-44a4-81f4-9b0996eb0215 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:32.598113 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae32c8a-8f00-44a4-81f4-9b0996eb0215 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:32.598926 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae32c8a-8f00-44a4-81f4-9b0996eb0215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:32.600910 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae32c8a-8f00-44a4-81f4-9b0996eb0215 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:32.631303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1184/2349] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:03:32 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:03:32.632648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ff073-f7d2-47db-abb0-1c3702cf718a None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:32.643469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ff073-f7d2-47db-abb0-1c3702cf718a None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:32.698569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea9449-bb20-4130-bed8-14ada132812c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:32.699292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea9449-bb20-4130-bed8-14ada132812c admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:32.699577 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea9449-bb20-4130-bed8-14ada132812c admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:32.699854 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea9449-bb20-4130-bed8-14ada132812c admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:32.700661 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea9449-bb20-4130-bed8-14ada132812c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:32.702610 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea9449-bb20-4130-bed8-14ada132812c admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:32.725649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1166/2350] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:03:32 2022] POST /identity/v3/users => generated 309 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:03:32.729664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae32c8a-8f00-44a4-81f4-9b0996eb0215 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:32.740171 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae32c8a-8f00-44a4-81f4-9b0996eb0215 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:32.745625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4e3f1-e94d-414e-b320-1b606d3aeca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:32.746288 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4e3f1-e94d-414e-b320-1b606d3aeca3 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:32.746598 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4e3f1-e94d-414e-b320-1b606d3aeca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:32.746895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4e3f1-e94d-414e-b320-1b606d3aeca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:32.747654 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4e3f1-e94d-414e-b320-1b606d3aeca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:32.749260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4e3f1-e94d-414e-b320-1b606d3aeca3 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:32.759893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1185/2351] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:03:32.764525 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea9449-bb20-4130-bed8-14ada132812c admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:32.774700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea9449-bb20-4130-bed8-14ada132812c admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:32.780146 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb298e4e-b11e-45ec-a263-d09fd32f59dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:32.781066 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb298e4e-b11e-45ec-a263-d09fd32f59dc admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:32.781348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb298e4e-b11e-45ec-a263-d09fd32f59dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:32.781621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb298e4e-b11e-45ec-a263-d09fd32f59dc admin admin] PATH_INFO: `/v3/projects/4cd90a51dff44724bc38e3253edb2b9e/users/53975241deda43bcb863609598ea6efd/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:32.797508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb298e4e-b11e-45ec-a263-d09fd32f59dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd90a51dff44724bc38e3253edb2b9e, user_id=53975241deda43bcb863609598ea6efd, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:32.800342 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb298e4e-b11e-45ec-a263-d09fd32f59dc admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:32.817995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1167/2352] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:03:32 2022] PUT /identity/v3/projects/4cd90a51dff44724bc38e3253edb2b9e/users/53975241deda43bcb863609598ea6efd/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:03:32.822178 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4e3f1-e94d-414e-b320-1b606d3aeca3 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:32.833091 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4e3f1-e94d-414e-b320-1b606d3aeca3 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:32.894686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09f72c-0d9c-4489-8293-534aca89fef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:32.895406 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09f72c-0d9c-4489-8293-534aca89fef7 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:32.895693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09f72c-0d9c-4489-8293-534aca89fef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:32.895974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09f72c-0d9c-4489-8293-534aca89fef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:32.896738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09f72c-0d9c-4489-8293-534aca89fef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:32.898399 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09f72c-0d9c-4489-8293-534aca89fef7 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:32.908333 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1186/2353] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:03:32.912848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb298e4e-b11e-45ec-a263-d09fd32f59dc admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:32.923788 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb298e4e-b11e-45ec-a263-d09fd32f59dc admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:32.929243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b40db-50bc-4a2b-aa82-434866444db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:32.930134 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b40db-50bc-4a2b-aa82-434866444db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:32.930411 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b40db-50bc-4a2b-aa82-434866444db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:32.930681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b40db-50bc-4a2b-aa82-434866444db8 admin admin] PATH_INFO: `/v3/projects/4cd90a51dff44724bc38e3253edb2b9e/users/53975241deda43bcb863609598ea6efd/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:32.932776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b40db-50bc-4a2b-aa82-434866444db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd90a51dff44724bc38e3253edb2b9e, user_id=53975241deda43bcb863609598ea6efd, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:32.935564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b40db-50bc-4a2b-aa82-434866444db8 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:32.946376 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1168/2354] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:03:32 2022] PUT /identity/v3/projects/4cd90a51dff44724bc38e3253edb2b9e/users/53975241deda43bcb863609598ea6efd/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:03:33.560946 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc71e96-f2cc-4622-92aa-2e7129fbeb99 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:33.561266 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc71e96-f2cc-4622-92aa-2e7129fbeb99 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:33.561576 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc71e96-f2cc-4622-92aa-2e7129fbeb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:33.588173 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-5dc71e96-f2cc-4622-92aa-2e7129fbeb99 None None] MFA Rules not processed for user `53975241deda43bcb863609598ea6efd`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:03:33.589726 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5dc71e96-f2cc-4622-92aa-2e7129fbeb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:33.659255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1187/2355] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:03:33 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:03:35.011426 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b40db-50bc-4a2b-aa82-434866444db8 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:35.082133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b40db-50bc-4a2b-aa82-434866444db8 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:35.088191 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa757ed5-8c58-4ad9-8795-634ebbdb6370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:35.089394 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa757ed5-8c58-4ad9-8795-634ebbdb6370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:35.089709 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa757ed5-8c58-4ad9-8795-634ebbdb6370 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:35.089992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa757ed5-8c58-4ad9-8795-634ebbdb6370 admin admin] PATH_INFO: `/v3/users/2547a09c133a4c6981cdd98ab4b815d0` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:35.091383 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa757ed5-8c58-4ad9-8795-634ebbdb6370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2547a09c133a4c6981cdd98ab4b815d0)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:35.093356 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa757ed5-8c58-4ad9-8795-634ebbdb6370 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:35.143691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-aa757ed5-8c58-4ad9-8795-634ebbdb6370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2547a09c133a4c6981cdd98ab4b815d0'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:35.153010 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-aa757ed5-8c58-4ad9-8795-634ebbdb6370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2547a09c133a4c6981cdd98ab4b815d0'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:35.161167 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-aa757ed5-8c58-4ad9-8795-634ebbdb6370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2547a09c133a4c6981cdd98ab4b815d0'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:35.161909 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-aa757ed5-8c58-4ad9-8795-634ebbdb6370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2547a09c133a4c6981cdd98ab4b815d0'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:35.162580 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-aa757ed5-8c58-4ad9-8795-634ebbdb6370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2547a09c133a4c6981cdd98ab4b815d0'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:35.181545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1169/2356] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:03:35 2022] DELETE /identity/v3/users/2547a09c133a4c6981cdd98ab4b815d0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:03:35.376366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc71e96-f2cc-4622-92aa-2e7129fbeb99 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:35.387621 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc71e96-f2cc-4622-92aa-2e7129fbeb99 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:35.444339 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7a6b7-fbbe-4f7a-a5e1-7802f94f75fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:35.445208 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7a6b7-fbbe-4f7a-a5e1-7802f94f75fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:35.445490 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7a6b7-fbbe-4f7a-a5e1-7802f94f75fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:35.445763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7a6b7-fbbe-4f7a-a5e1-7802f94f75fa admin admin] PATH_INFO: `/v3/projects/b8893f052f5042689391dc3e012fd350` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:35.447000 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7a6b7-fbbe-4f7a-a5e1-7802f94f75fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8893f052f5042689391dc3e012fd350)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:35.448991 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7a6b7-fbbe-4f7a-a5e1-7802f94f75fa admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:35.495860 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a9a7a6b7-fbbe-4f7a-a5e1-7802f94f75fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8893f052f5042689391dc3e012fd350', 'request_id': 'req-a9a7a6b7-fbbe-4f7a-a5e1-7802f94f75fa'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:35.505832 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a9a7a6b7-fbbe-4f7a-a5e1-7802f94f75fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8893f052f5042689391dc3e012fd350', 'request_id': 'req-a9a7a6b7-fbbe-4f7a-a5e1-7802f94f75fa'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:35.512224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a9a7a6b7-fbbe-4f7a-a5e1-7802f94f75fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8893f052f5042689391dc3e012fd350', 'request_id': 'req-a9a7a6b7-fbbe-4f7a-a5e1-7802f94f75fa'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:35.522658 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a9a7a6b7-fbbe-4f7a-a5e1-7802f94f75fa admin admin] The token cache is being invalidate because project b8893f052f5042689391dc3e012fd350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:03:35.522942 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a9a7a6b7-fbbe-4f7a-a5e1-7802f94f75fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:35.523636 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a9a7a6b7-fbbe-4f7a-a5e1-7802f94f75fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:35.525327 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1188/2357] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:03:35 2022] DELETE /identity/v3/projects/b8893f052f5042689391dc3e012fd350 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:03:35.530685 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa757ed5-8c58-4ad9-8795-634ebbdb6370 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:35.532162 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-aa757ed5-8c58-4ad9-8795-634ebbdb6370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:35.546016 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa757ed5-8c58-4ad9-8795-634ebbdb6370 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:35.603837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737173d-6065-4ae7-8bd8-55ec38733b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:35.604713 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737173d-6065-4ae7-8bd8-55ec38733b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:35.604994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737173d-6065-4ae7-8bd8-55ec38733b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:35.605267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737173d-6065-4ae7-8bd8-55ec38733b6a admin admin] PATH_INFO: `/v3/users/53975241deda43bcb863609598ea6efd` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:35.606457 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737173d-6065-4ae7-8bd8-55ec38733b6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=53975241deda43bcb863609598ea6efd)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:35.608424 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737173d-6065-4ae7-8bd8-55ec38733b6a admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:35.655725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-a737173d-6065-4ae7-8bd8-55ec38733b6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53975241deda43bcb863609598ea6efd'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:35.665227 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-a737173d-6065-4ae7-8bd8-55ec38733b6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53975241deda43bcb863609598ea6efd'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:35.672785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-a737173d-6065-4ae7-8bd8-55ec38733b6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53975241deda43bcb863609598ea6efd'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:35.673441 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-a737173d-6065-4ae7-8bd8-55ec38733b6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53975241deda43bcb863609598ea6efd'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:35.674334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-a737173d-6065-4ae7-8bd8-55ec38733b6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53975241deda43bcb863609598ea6efd'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:35.701379 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1170/2358] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:03:35 2022] DELETE /identity/v3/users/53975241deda43bcb863609598ea6efd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:03:35.879914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7a6b7-fbbe-4f7a-a5e1-7802f94f75fa admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:35.881380 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a9a7a6b7-fbbe-4f7a-a5e1-7802f94f75fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:35.896163 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7a6b7-fbbe-4f7a-a5e1-7802f94f75fa admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:35.952552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409df86-5220-4320-9ca2-c222e09dadeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:35.953718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409df86-5220-4320-9ca2-c222e09dadeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:35.954008 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409df86-5220-4320-9ca2-c222e09dadeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:35.954289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409df86-5220-4320-9ca2-c222e09dadeb admin admin] PATH_INFO: `/v3/projects/4cd90a51dff44724bc38e3253edb2b9e` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:35.955531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409df86-5220-4320-9ca2-c222e09dadeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cd90a51dff44724bc38e3253edb2b9e)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:35.957467 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409df86-5220-4320-9ca2-c222e09dadeb admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:36.006892 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-9409df86-5220-4320-9ca2-c222e09dadeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cd90a51dff44724bc38e3253edb2b9e', 'request_id': 'req-9409df86-5220-4320-9ca2-c222e09dadeb'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:36.016829 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-9409df86-5220-4320-9ca2-c222e09dadeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cd90a51dff44724bc38e3253edb2b9e', 'request_id': 'req-9409df86-5220-4320-9ca2-c222e09dadeb'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:36.023441 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-9409df86-5220-4320-9ca2-c222e09dadeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cd90a51dff44724bc38e3253edb2b9e', 'request_id': 'req-9409df86-5220-4320-9ca2-c222e09dadeb'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:36.033872 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-9409df86-5220-4320-9ca2-c222e09dadeb admin admin] The token cache is being invalidate because project 4cd90a51dff44724bc38e3253edb2b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:03:36.034160 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-9409df86-5220-4320-9ca2-c222e09dadeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:36.034865 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-9409df86-5220-4320-9ca2-c222e09dadeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:03:36.036454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1189/2359] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:03:35 2022] DELETE /identity/v3/projects/4cd90a51dff44724bc38e3253edb2b9e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:03:36.041699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246c4bd-59c2-4ec5-8ca9-5648f16985bd None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:36.042213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246c4bd-59c2-4ec5-8ca9-5648f16985bd None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:36.042213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246c4bd-59c2-4ec5-8ca9-5648f16985bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:36.061280 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-2246c4bd-59c2-4ec5-8ca9-5648f16985bd None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:03:36.062523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-2246c4bd-59c2-4ec5-8ca9-5648f16985bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:36.122717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1171/2360] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:03:36.130965 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fea950-502f-444a-bb48-374d772a77d7 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:36.131306 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fea950-502f-444a-bb48-374d772a77d7 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:36.131625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fea950-502f-444a-bb48-374d772a77d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:36.152926 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-09fea950-502f-444a-bb48-374d772a77d7 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:03:36.154130 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-09fea950-502f-444a-bb48-374d772a77d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:36.163435 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1190/2361] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:03:36.167970 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246c4bd-59c2-4ec5-8ca9-5648f16985bd None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:36.177641 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246c4bd-59c2-4ec5-8ca9-5648f16985bd None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:36.182566 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194f29e-693a-44bd-8aad-d4ee5c3f1e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:36.183573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194f29e-693a-44bd-8aad-d4ee5c3f1e25 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:36.183851 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194f29e-693a-44bd-8aad-d4ee5c3f1e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:36.184119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194f29e-693a-44bd-8aad-d4ee5c3f1e25 admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:36.184840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194f29e-693a-44bd-8aad-d4ee5c3f1e25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:03:36.185141 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194f29e-693a-44bd-8aad-d4ee5c3f1e25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:36.186735 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194f29e-693a-44bd-8aad-d4ee5c3f1e25 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:36.199225 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1172/2362] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:03:36.204055 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fea950-502f-444a-bb48-374d772a77d7 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:36.213993 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fea950-502f-444a-bb48-374d772a77d7 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:36.219954 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdc9a9-97c8-4dba-b941-47eb33d38dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:36.220608 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdc9a9-97c8-4dba-b941-47eb33d38dda admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:36.220891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdc9a9-97c8-4dba-b941-47eb33d38dda admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:36.221247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdc9a9-97c8-4dba-b941-47eb33d38dda admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:36.221962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdc9a9-97c8-4dba-b941-47eb33d38dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:36.223912 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdc9a9-97c8-4dba-b941-47eb33d38dda admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:36.253587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1191/2363] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:03:36 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:03:36.258252 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194f29e-693a-44bd-8aad-d4ee5c3f1e25 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:36.267902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194f29e-693a-44bd-8aad-d4ee5c3f1e25 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:36.335387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7e1f7-0b55-48a7-9807-70df48b3c67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:36.336088 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7e1f7-0b55-48a7-9807-70df48b3c67e admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:36.336367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7e1f7-0b55-48a7-9807-70df48b3c67e admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:36.336638 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7e1f7-0b55-48a7-9807-70df48b3c67e admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:36.337360 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7e1f7-0b55-48a7-9807-70df48b3c67e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:36.339737 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7e1f7-0b55-48a7-9807-70df48b3c67e admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:36.360234 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1173/2364] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:03:36 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:03:36.364778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdc9a9-97c8-4dba-b941-47eb33d38dda admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:36.375083 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdc9a9-97c8-4dba-b941-47eb33d38dda admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:36.380836 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde33192-eaab-4e96-b7a4-61b8a82639f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:36.381487 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde33192-eaab-4e96-b7a4-61b8a82639f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:36.381790 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde33192-eaab-4e96-b7a4-61b8a82639f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:36.382061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde33192-eaab-4e96-b7a4-61b8a82639f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:36.382798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde33192-eaab-4e96-b7a4-61b8a82639f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:36.384498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde33192-eaab-4e96-b7a4-61b8a82639f1 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:36.394896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1192/2365] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:03:36.399091 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7e1f7-0b55-48a7-9807-70df48b3c67e admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:36.410132 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7e1f7-0b55-48a7-9807-70df48b3c67e admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:36.415726 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08dc4b7-9171-4745-8d19-671235383ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:36.416423 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dc4b7-9171-4745-8d19-671235383ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:36.416708 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dc4b7-9171-4745-8d19-671235383ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:36.416987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dc4b7-9171-4745-8d19-671235383ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:36.417720 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08dc4b7-9171-4745-8d19-671235383ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:36.419387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08dc4b7-9171-4745-8d19-671235383ca3 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:36.429469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1174/2366] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:03:36.434019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde33192-eaab-4e96-b7a4-61b8a82639f1 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:36.444869 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde33192-eaab-4e96-b7a4-61b8a82639f1 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:36.450493 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba29f95-151c-4c6e-b326-a523e5cd014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:36.451457 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba29f95-151c-4c6e-b326-a523e5cd014b admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:36.451742 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba29f95-151c-4c6e-b326-a523e5cd014b admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:36.452013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba29f95-151c-4c6e-b326-a523e5cd014b admin admin] PATH_INFO: `/v3/projects/9af135205a22414eb4ea9cfccc14051d/users/a196786e6b384408a46819eff3818af4/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:36.467994 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba29f95-151c-4c6e-b326-a523e5cd014b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af135205a22414eb4ea9cfccc14051d, user_id=a196786e6b384408a46819eff3818af4, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:36.470715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba29f95-151c-4c6e-b326-a523e5cd014b admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:36.486421 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1193/2367] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:03:36 2022] PUT /identity/v3/projects/9af135205a22414eb4ea9cfccc14051d/users/a196786e6b384408a46819eff3818af4/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:03:36.496963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addda9dc-9e54-4a6a-b6d6-e05bbef0a634 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:36.497258 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addda9dc-9e54-4a6a-b6d6-e05bbef0a634 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:36.497543 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addda9dc-9e54-4a6a-b6d6-e05bbef0a634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:36.525002 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-addda9dc-9e54-4a6a-b6d6-e05bbef0a634 None None] MFA Rules not processed for user `a196786e6b384408a46819eff3818af4`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:03:36.525881 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-addda9dc-9e54-4a6a-b6d6-e05bbef0a634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:36.591871 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1175/2368] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:03:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:03:36.596672 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba29f95-151c-4c6e-b326-a523e5cd014b admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:36.657555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba29f95-151c-4c6e-b326-a523e5cd014b admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:36.662549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1008113-ff22-4aa7-9eb9-92b919b68269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:36.663245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1008113-ff22-4aa7-9eb9-92b919b68269 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:36.663530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1008113-ff22-4aa7-9eb9-92b919b68269 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:36.663812 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1008113-ff22-4aa7-9eb9-92b919b68269 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:36.664517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1008113-ff22-4aa7-9eb9-92b919b68269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:36.666439 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1008113-ff22-4aa7-9eb9-92b919b68269 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:36.695668 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1194/2369] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:03:36 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:03:36.701325 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addda9dc-9e54-4a6a-b6d6-e05bbef0a634 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:36.712432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addda9dc-9e54-4a6a-b6d6-e05bbef0a634 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:36.771975 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fd07b-8553-444f-b936-79fd00b5f1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:36.772638 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fd07b-8553-444f-b936-79fd00b5f1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:36.772936 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fd07b-8553-444f-b936-79fd00b5f1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:36.773201 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fd07b-8553-444f-b936-79fd00b5f1e6 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:36.773890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fd07b-8553-444f-b936-79fd00b5f1e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:36.775916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fd07b-8553-444f-b936-79fd00b5f1e6 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:36.796433 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1176/2370] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:03:36 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:03:36.800957 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1008113-ff22-4aa7-9eb9-92b919b68269 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:36.811595 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1008113-ff22-4aa7-9eb9-92b919b68269 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:36.817768 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2f4a5-73b4-49bd-a7df-0ffc1a9e2fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:36.818454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2f4a5-73b4-49bd-a7df-0ffc1a9e2fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:36.818741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2f4a5-73b4-49bd-a7df-0ffc1a9e2fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:36.819027 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2f4a5-73b4-49bd-a7df-0ffc1a9e2fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:36.819797 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2f4a5-73b4-49bd-a7df-0ffc1a9e2fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:36.821473 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2f4a5-73b4-49bd-a7df-0ffc1a9e2fa8 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:36.833423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1195/2371] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:03:36.837798 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fd07b-8553-444f-b936-79fd00b5f1e6 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:36.848867 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fd07b-8553-444f-b936-79fd00b5f1e6 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:36.853914 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3550d-f9b0-4d75-b78b-e60ca8078bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:36.854832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3550d-f9b0-4d75-b78b-e60ca8078bca admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:36.855150 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3550d-f9b0-4d75-b78b-e60ca8078bca admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:36.855424 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3550d-f9b0-4d75-b78b-e60ca8078bca admin admin] PATH_INFO: `/v3/projects/5cdbe28e53e74c1b8bd7b7a403db1326/users/c293c48ab8e447c294e0399dcb462158/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:36.872460 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3550d-f9b0-4d75-b78b-e60ca8078bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cdbe28e53e74c1b8bd7b7a403db1326, user_id=c293c48ab8e447c294e0399dcb462158, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:36.875264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3550d-f9b0-4d75-b78b-e60ca8078bca admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:36.893205 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1177/2372] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:03:36 2022] PUT /identity/v3/projects/5cdbe28e53e74c1b8bd7b7a403db1326/users/c293c48ab8e447c294e0399dcb462158/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:03:36.897557 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2f4a5-73b4-49bd-a7df-0ffc1a9e2fa8 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:36.908102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2f4a5-73b4-49bd-a7df-0ffc1a9e2fa8 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:36.965573 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448201a9-e70b-4d85-b086-03dba6a091e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:36.966257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448201a9-e70b-4d85-b086-03dba6a091e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:36.966533 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448201a9-e70b-4d85-b086-03dba6a091e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:36.966803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448201a9-e70b-4d85-b086-03dba6a091e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:36.967578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448201a9-e70b-4d85-b086-03dba6a091e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:36.969378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448201a9-e70b-4d85-b086-03dba6a091e0 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:36.979526 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1196/2373] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:03:36.983811 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3550d-f9b0-4d75-b78b-e60ca8078bca admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:36.994569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3550d-f9b0-4d75-b78b-e60ca8078bca admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:37.000332 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868753e-5afc-4e2b-97f2-2a4ddaef60c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:37.001478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868753e-5afc-4e2b-97f2-2a4ddaef60c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:37.001754 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868753e-5afc-4e2b-97f2-2a4ddaef60c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:37.002046 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868753e-5afc-4e2b-97f2-2a4ddaef60c6 admin admin] PATH_INFO: `/v3/projects/5cdbe28e53e74c1b8bd7b7a403db1326/users/c293c48ab8e447c294e0399dcb462158/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:37.004193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868753e-5afc-4e2b-97f2-2a4ddaef60c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cdbe28e53e74c1b8bd7b7a403db1326, user_id=c293c48ab8e447c294e0399dcb462158, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:37.006845 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868753e-5afc-4e2b-97f2-2a4ddaef60c6 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:37.017405 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1178/2374] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:03:36 2022] PUT /identity/v3/projects/5cdbe28e53e74c1b8bd7b7a403db1326/users/c293c48ab8e447c294e0399dcb462158/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:03:37.028636 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fe792-920f-4743-811f-0d3a51a86f63 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:37.028849 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fe792-920f-4743-811f-0d3a51a86f63 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:37.029131 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fe792-920f-4743-811f-0d3a51a86f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:37.057836 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-445fe792-920f-4743-811f-0d3a51a86f63 None None] MFA Rules not processed for user `c293c48ab8e447c294e0399dcb462158`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:03:37.059766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-445fe792-920f-4743-811f-0d3a51a86f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:37.131745 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1197/2375] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:03:37 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:03:42.196163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868753e-5afc-4e2b-97f2-2a4ddaef60c6 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:42.198047 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c868753e-5afc-4e2b-97f2-2a4ddaef60c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:42.270472 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868753e-5afc-4e2b-97f2-2a4ddaef60c6 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:42.274800 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d9da3-9182-46ab-abae-a75af516e3b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:42.275481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d9da3-9182-46ab-abae-a75af516e3b5 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:42.275760 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d9da3-9182-46ab-abae-a75af516e3b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:42.276029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d9da3-9182-46ab-abae-a75af516e3b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:42.278045 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-539d9da3-9182-46ab-abae-a75af516e3b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:42.350175 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d9da3-9182-46ab-abae-a75af516e3b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:42.351659 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d9da3-9182-46ab-abae-a75af516e3b5 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:42.360750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1179/2376] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:03:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:03:42.449100 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fe792-920f-4743-811f-0d3a51a86f63 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:42.459467 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fe792-920f-4743-811f-0d3a51a86f63 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:42.463800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f02ad4-3f13-4dc5-993c-916a43de7d75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:42.464786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f02ad4-3f13-4dc5-993c-916a43de7d75 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:42.465066 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f02ad4-3f13-4dc5-993c-916a43de7d75 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:42.465343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f02ad4-3f13-4dc5-993c-916a43de7d75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:42.467361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-f5f02ad4-3f13-4dc5-993c-916a43de7d75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:42.542540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f02ad4-3f13-4dc5-993c-916a43de7d75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:42.544060 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f02ad4-3f13-4dc5-993c-916a43de7d75 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:42.553323 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1198/2377] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:03:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:03:42.684407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d9da3-9182-46ab-abae-a75af516e3b5 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:42.697106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d9da3-9182-46ab-abae-a75af516e3b5 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:42.701951 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfaf1bb-c1e5-45bc-9d80-b32e699462db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:42.702618 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaf1bb-c1e5-45bc-9d80-b32e699462db service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:42.702893 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaf1bb-c1e5-45bc-9d80-b32e699462db service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:42.703203 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaf1bb-c1e5-45bc-9d80-b32e699462db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:42.705263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-5cfaf1bb-c1e5-45bc-9d80-b32e699462db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:42.738833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-5cfaf1bb-c1e5-45bc-9d80-b32e699462db service cinder] Could not find project: e2d719ae8d574bdcafec8ea909e0dbd7.: keystone.exception.ProjectNotFound: Could not find project: e2d719ae8d574bdcafec8ea909e0dbd7. May 04 22:03:42.738833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 22:03:42.738833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 22:03:42.738833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 22:03:42.738833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 22:03:42.738833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 22:03:42.738833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 22:03:42.738833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 22:03:42.738833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 22:03:42.738833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 22:03:42.738833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 22:03:42.738833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 22:03:42.738833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get May 04 22:03:42.738833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') May 04 22:03:42.738833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 04 22:03:42.740104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 04 22:03:42.740104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 04 22:03:42.740104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 04 22:03:42.740104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 22:03:42.740104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 22:03:42.740104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token May 04 22:03:42.740104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application token = self._validate_token(token_id) May 04 22:03:42.740104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 22:03:42.740104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 22:03:42.740104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 22:03:42.740104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 22:03:42.740104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 22:03:42.740104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 22:03:42.740104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 22:03:42.740104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 22:03:42.740104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 22:03:42.740104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 22:03:42.741333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 22:03:42.741333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 22:03:42.741333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 22:03:42.741333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 22:03:42.741333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token May 04 22:03:42.741333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) May 04 22:03:42.741333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint May 04 22:03:42.741333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._validate_token_resources() May 04 22:03:42.741333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources May 04 22:03:42.741333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): May 04 22:03:42.741333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project May 04 22:03:42.741333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( May 04 22:03:42.741333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 22:03:42.741333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 22:03:42.741333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 22:03:42.741333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 22:03:42.741333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 22:03:42.742384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 22:03:42.742384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 22:03:42.742384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 22:03:42.742384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 22:03:42.742384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 22:03:42.742384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 22:03:42.742384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 22:03:42.742384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 22:03:42.742384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 22:03:42.742384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 22:03:42.742384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 22:03:42.742384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 22:03:42.742384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 22:03:42.742384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 22:03:42.742384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 22:03:42.742384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 22:03:42.742384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 22:03:42.743403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e2d719ae8d574bdcafec8ea909e0dbd7. May 04 22:03:42.743403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 22:03:42.743403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1180/2378] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:03:42 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 04 22:03:42.989225 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f02ad4-3f13-4dc5-993c-916a43de7d75 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:42.998152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f02ad4-3f13-4dc5-993c-916a43de7d75 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:43.002718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80ec35-592c-48a4-941e-8f7e6552ff73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:43.003404 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80ec35-592c-48a4-941e-8f7e6552ff73 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:43.003738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80ec35-592c-48a4-941e-8f7e6552ff73 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:43.004611 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80ec35-592c-48a4-941e-8f7e6552ff73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:43.014984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80ec35-592c-48a4-941e-8f7e6552ff73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:43.017182 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80ec35-592c-48a4-941e-8f7e6552ff73 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:43.027727 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1199/2379] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:03:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:05:43.097449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfaf1bb-c1e5-45bc-9d80-b32e699462db service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:05:43.107182 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfaf1bb-c1e5-45bc-9d80-b32e699462db service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:05:43.112179 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a380ef-d338-49c9-81df-2797e3dfd186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:05:43.112820 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a380ef-d338-49c9-81df-2797e3dfd186 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:05:43.113124 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a380ef-d338-49c9-81df-2797e3dfd186 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:05:43.113373 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a380ef-d338-49c9-81df-2797e3dfd186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:05:43.173724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a380ef-d338-49c9-81df-2797e3dfd186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:05:43.175202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a380ef-d338-49c9-81df-2797e3dfd186 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:05:43.184376 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1181/2380] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:05:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:05:43.414664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80ec35-592c-48a4-941e-8f7e6552ff73 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:05:43.423549 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80ec35-592c-48a4-941e-8f7e6552ff73 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:05:43.428040 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d08760-7f4d-4a93-a22e-1171df8191aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:05:43.428604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d08760-7f4d-4a93-a22e-1171df8191aa service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:05:43.428890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d08760-7f4d-4a93-a22e-1171df8191aa service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:05:43.429712 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d08760-7f4d-4a93-a22e-1171df8191aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:05:43.431070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-b2d08760-7f4d-4a93-a22e-1171df8191aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:05:43.503975 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d08760-7f4d-4a93-a22e-1171df8191aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:05:43.505457 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d08760-7f4d-4a93-a22e-1171df8191aa service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:05:43.514476 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1200/2381] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:05:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:05:43.562269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a380ef-d338-49c9-81df-2797e3dfd186 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:05:43.571071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a380ef-d338-49c9-81df-2797e3dfd186 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:05:43.574843 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b9210-9922-4245-a63f-a5735c58af35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:05:43.575529 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b9210-9922-4245-a63f-a5735c58af35 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:05:43.575949 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b9210-9922-4245-a63f-a5735c58af35 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:05:43.576639 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b9210-9922-4245-a63f-a5735c58af35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:05:43.578598 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-030b9210-9922-4245-a63f-a5735c58af35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:05:43.652301 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b9210-9922-4245-a63f-a5735c58af35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:05:43.653917 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b9210-9922-4245-a63f-a5735c58af35 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:05:43.663599 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1182/2382] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:05:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:05:44.059765 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d08760-7f4d-4a93-a22e-1171df8191aa service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:05:44.061558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-b2d08760-7f4d-4a93-a22e-1171df8191aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:05:44.118318 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d08760-7f4d-4a93-a22e-1171df8191aa service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:05:44.122873 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ccbcb-5d20-4f85-910f-04c71aac0a3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:05:44.123559 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ccbcb-5d20-4f85-910f-04c71aac0a3b service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:05:44.123845 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ccbcb-5d20-4f85-910f-04c71aac0a3b service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:05:44.124116 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ccbcb-5d20-4f85-910f-04c71aac0a3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:05:44.126000 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-280ccbcb-5d20-4f85-910f-04c71aac0a3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:05:44.207137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ccbcb-5d20-4f85-910f-04c71aac0a3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:05:44.208542 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ccbcb-5d20-4f85-910f-04c71aac0a3b service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:05:44.220410 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1201/2383] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:05:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:05:46.223330 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b9210-9922-4245-a63f-a5735c58af35 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:05:46.224856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-030b9210-9922-4245-a63f-a5735c58af35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:05:46.298976 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b9210-9922-4245-a63f-a5735c58af35 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:05:46.304714 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e42a1c-f1a6-490c-b68f-00c812f052cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e203d7077af54930a640b2334a1d8fa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:05:46.305385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e42a1c-f1a6-490c-b68f-00c812f052cd service placement] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:05:46.305681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e42a1c-f1a6-490c-b68f-00c812f052cd service placement] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:05:46.305964 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e42a1c-f1a6-490c-b68f-00c812f052cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:05:46.307813 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-29e42a1c-f1a6-490c-b68f-00c812f052cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:05:46.319452 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e42a1c-f1a6-490c-b68f-00c812f052cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:05:46.321100 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e42a1c-f1a6-490c-b68f-00c812f052cd service placement] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:05:46.331113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1183/2384] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:05:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:06:40.874465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ccbcb-5d20-4f85-910f-04c71aac0a3b service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:06:40.875910 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-280ccbcb-5d20-4f85-910f-04c71aac0a3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:06:40.886358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ccbcb-5d20-4f85-910f-04c71aac0a3b service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:06:40.889933 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89348cb1-e491-4a41-9f59-249f692f56de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:06:40.890584 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89348cb1-e491-4a41-9f59-249f692f56de service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:06:40.890865 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89348cb1-e491-4a41-9f59-249f692f56de service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:06:40.891172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89348cb1-e491-4a41-9f59-249f692f56de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:06:40.892909 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-89348cb1-e491-4a41-9f59-249f692f56de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:06:40.906002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89348cb1-e491-4a41-9f59-249f692f56de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:06:40.907460 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89348cb1-e491-4a41-9f59-249f692f56de service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:06:40.918130 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1202/2385] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:06:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:06:42.033556 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e42a1c-f1a6-490c-b68f-00c812f052cd service placement] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:06:42.035376 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-29e42a1c-f1a6-490c-b68f-00c812f052cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:06:42.051645 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e42a1c-f1a6-490c-b68f-00c812f052cd service placement] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:06:42.058728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a1b60-7325-487a-8978-14adc5609461 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:06:42.059400 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a1b60-7325-487a-8978-14adc5609461 service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:06:42.059953 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a1b60-7325-487a-8978-14adc5609461 service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:06:42.060233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a1b60-7325-487a-8978-14adc5609461 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:06:42.062168 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-0f6a1b60-7325-487a-8978-14adc5609461 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:06:42.120998 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a1b60-7325-487a-8978-14adc5609461 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:06:42.122595 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a1b60-7325-487a-8978-14adc5609461 service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:06:42.131427 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1184/2386] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:06:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:07:41.217059 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89348cb1-e491-4a41-9f59-249f692f56de service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:07:41.228027 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89348cb1-e491-4a41-9f59-249f692f56de service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:07:41.233481 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb685a-4de3-474e-aa87-fbfb717ad576 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:07:41.234160 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb685a-4de3-474e-aa87-fbfb717ad576 service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:07:41.234448 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb685a-4de3-474e-aa87-fbfb717ad576 service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:07:41.234730 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb685a-4de3-474e-aa87-fbfb717ad576 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:07:41.236687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-02fb685a-4de3-474e-aa87-fbfb717ad576 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:07:41.306492 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb685a-4de3-474e-aa87-fbfb717ad576 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:07:41.308035 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb685a-4de3-474e-aa87-fbfb717ad576 service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:07:41.326286 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1203/2387] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:07:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:07:46.970143 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a1b60-7325-487a-8978-14adc5609461 service nova] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:07:46.980532 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a1b60-7325-487a-8978-14adc5609461 service nova] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:07:46.984663 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b948e5-37da-4152-8f6d-08edd4145ac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:07:46.985394 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b948e5-37da-4152-8f6d-08edd4145ac5 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:07:46.985747 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b948e5-37da-4152-8f6d-08edd4145ac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:07:46.986093 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b948e5-37da-4152-8f6d-08edd4145ac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:07:46.990692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c8b948e5-37da-4152-8f6d-08edd4145ac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:07:46.998872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b948e5-37da-4152-8f6d-08edd4145ac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:07:47.000597 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b948e5-37da-4152-8f6d-08edd4145ac5 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:07:47.009771 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1185/2388] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:07:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:08:27.220137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb685a-4de3-474e-aa87-fbfb717ad576 service nova] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:08:27.229599 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb685a-4de3-474e-aa87-fbfb717ad576 service nova] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:08:27.234192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b1710-5ec0-409c-8758-4aff69e3156a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:08:27.234862 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b1710-5ec0-409c-8758-4aff69e3156a service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:08:27.235173 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b1710-5ec0-409c-8758-4aff69e3156a service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:08:27.235452 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b1710-5ec0-409c-8758-4aff69e3156a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:08:27.237640 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-811b1710-5ec0-409c-8758-4aff69e3156a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:08:27.305130 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b1710-5ec0-409c-8758-4aff69e3156a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:08:27.306591 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b1710-5ec0-409c-8758-4aff69e3156a service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:08:27.316776 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1204/2389] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:08:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:08:28.623302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b948e5-37da-4152-8f6d-08edd4145ac5 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:08:28.626566 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c8b948e5-37da-4152-8f6d-08edd4145ac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:08:28.646927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b948e5-37da-4152-8f6d-08edd4145ac5 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:08:28.653693 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702fc48-50bb-44e9-9b7b-5b8493033463 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:08:28.654658 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702fc48-50bb-44e9-9b7b-5b8493033463 service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:08:28.655029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702fc48-50bb-44e9-9b7b-5b8493033463 service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:08:28.655413 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702fc48-50bb-44e9-9b7b-5b8493033463 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:08:28.657401 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-8702fc48-50bb-44e9-9b7b-5b8493033463 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:08:28.673403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702fc48-50bb-44e9-9b7b-5b8493033463 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:08:28.675086 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702fc48-50bb-44e9-9b7b-5b8493033463 service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:08:28.691367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1186/2390] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:08:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:08:35.070667 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b1710-5ec0-409c-8758-4aff69e3156a service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:08:35.072156 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-811b1710-5ec0-409c-8758-4aff69e3156a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:08:35.086434 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b1710-5ec0-409c-8758-4aff69e3156a service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:08:35.092480 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062de731-ad4b-4702-8211-ab22a753d6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:08:35.093438 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062de731-ad4b-4702-8211-ab22a753d6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:08:35.093784 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062de731-ad4b-4702-8211-ab22a753d6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:08:35.094183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062de731-ad4b-4702-8211-ab22a753d6bf admin admin] PATH_INFO: `/v3/users/5bd12d925fbc44d69886993e247f7464` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:08:35.095478 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062de731-ad4b-4702-8211-ab22a753d6bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bd12d925fbc44d69886993e247f7464)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:08:35.097827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062de731-ad4b-4702-8211-ab22a753d6bf admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:08:35.147233 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-062de731-ad4b-4702-8211-ab22a753d6bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd12d925fbc44d69886993e247f7464'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:08:35.154025 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-062de731-ad4b-4702-8211-ab22a753d6bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd12d925fbc44d69886993e247f7464'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:08:35.154763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-062de731-ad4b-4702-8211-ab22a753d6bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd12d925fbc44d69886993e247f7464'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:08:35.166439 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-062de731-ad4b-4702-8211-ab22a753d6bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd12d925fbc44d69886993e247f7464'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:08:35.174186 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-062de731-ad4b-4702-8211-ab22a753d6bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd12d925fbc44d69886993e247f7464'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:08:35.181006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1205/2391] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:08:35 2022] DELETE /identity/v3/users/5bd12d925fbc44d69886993e247f7464 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:08:35.454320 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702fc48-50bb-44e9-9b7b-5b8493033463 service nova] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:08:35.465880 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702fc48-50bb-44e9-9b7b-5b8493033463 service nova] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:08:35.525908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711cd85-0c37-494d-bd58-e280ebcf0a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:08:35.526770 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711cd85-0c37-494d-bd58-e280ebcf0a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:08:35.527071 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711cd85-0c37-494d-bd58-e280ebcf0a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:08:35.527363 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711cd85-0c37-494d-bd58-e280ebcf0a4f admin admin] PATH_INFO: `/v3/projects/2385454f60464c12a03d1184053a2e98` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:08:35.528626 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711cd85-0c37-494d-bd58-e280ebcf0a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2385454f60464c12a03d1184053a2e98)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:08:35.530525 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711cd85-0c37-494d-bd58-e280ebcf0a4f admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:08:35.577082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8711cd85-0c37-494d-bd58-e280ebcf0a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2385454f60464c12a03d1184053a2e98', 'request_id': 'req-8711cd85-0c37-494d-bd58-e280ebcf0a4f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:08:35.583251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8711cd85-0c37-494d-bd58-e280ebcf0a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2385454f60464c12a03d1184053a2e98', 'request_id': 'req-8711cd85-0c37-494d-bd58-e280ebcf0a4f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:08:35.592764 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8711cd85-0c37-494d-bd58-e280ebcf0a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2385454f60464c12a03d1184053a2e98', 'request_id': 'req-8711cd85-0c37-494d-bd58-e280ebcf0a4f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:08:35.603359 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8711cd85-0c37-494d-bd58-e280ebcf0a4f admin admin] The token cache is being invalidate because project 2385454f60464c12a03d1184053a2e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:08:35.603644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8711cd85-0c37-494d-bd58-e280ebcf0a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:08:35.604265 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8711cd85-0c37-494d-bd58-e280ebcf0a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:08:35.605855 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1187/2392] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:08:35 2022] DELETE /identity/v3/projects/2385454f60464c12a03d1184053a2e98 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:08:35.610437 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062de731-ad4b-4702-8211-ab22a753d6bf admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:08:35.611977 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-062de731-ad4b-4702-8211-ab22a753d6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:08:35.625515 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062de731-ad4b-4702-8211-ab22a753d6bf admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:08:35.680765 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac6059-e1e6-4f96-aa74-423f1b83d5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:08:35.681645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac6059-e1e6-4f96-aa74-423f1b83d5eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:08:35.681921 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac6059-e1e6-4f96-aa74-423f1b83d5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:08:35.682191 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac6059-e1e6-4f96-aa74-423f1b83d5eb admin admin] PATH_INFO: `/v3/users/45ab396e3b7840e6a90b1241fbd95010` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:08:35.695431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac6059-e1e6-4f96-aa74-423f1b83d5eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ab396e3b7840e6a90b1241fbd95010)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:08:35.697368 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac6059-e1e6-4f96-aa74-423f1b83d5eb admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:08:35.753076 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e5ac6059-e1e6-4f96-aa74-423f1b83d5eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ab396e3b7840e6a90b1241fbd95010'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:08:35.760271 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e5ac6059-e1e6-4f96-aa74-423f1b83d5eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ab396e3b7840e6a90b1241fbd95010'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:08:35.761161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e5ac6059-e1e6-4f96-aa74-423f1b83d5eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ab396e3b7840e6a90b1241fbd95010'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:08:35.773505 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e5ac6059-e1e6-4f96-aa74-423f1b83d5eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ab396e3b7840e6a90b1241fbd95010'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:08:35.784416 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e5ac6059-e1e6-4f96-aa74-423f1b83d5eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ab396e3b7840e6a90b1241fbd95010'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:08:35.790249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1206/2393] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:08:35 2022] DELETE /identity/v3/users/45ab396e3b7840e6a90b1241fbd95010 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:08:35.998218 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711cd85-0c37-494d-bd58-e280ebcf0a4f admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:08:35.999950 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-8711cd85-0c37-494d-bd58-e280ebcf0a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:08:36.013107 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711cd85-0c37-494d-bd58-e280ebcf0a4f admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:08:36.079735 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77928b70-941e-4ac6-a31d-324973f0827f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:08:36.080649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77928b70-941e-4ac6-a31d-324973f0827f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:08:36.080936 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77928b70-941e-4ac6-a31d-324973f0827f admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:08:36.081211 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77928b70-941e-4ac6-a31d-324973f0827f admin admin] PATH_INFO: `/v3/projects/f78a1a4dccc8477e817be932abab2b16` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:08:36.092837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77928b70-941e-4ac6-a31d-324973f0827f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f78a1a4dccc8477e817be932abab2b16)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:08:36.094793 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77928b70-941e-4ac6-a31d-324973f0827f admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:08:36.140551 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-77928b70-941e-4ac6-a31d-324973f0827f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f78a1a4dccc8477e817be932abab2b16', 'request_id': 'req-77928b70-941e-4ac6-a31d-324973f0827f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:08:36.147602 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-77928b70-941e-4ac6-a31d-324973f0827f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f78a1a4dccc8477e817be932abab2b16', 'request_id': 'req-77928b70-941e-4ac6-a31d-324973f0827f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:08:36.158170 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-77928b70-941e-4ac6-a31d-324973f0827f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f78a1a4dccc8477e817be932abab2b16', 'request_id': 'req-77928b70-941e-4ac6-a31d-324973f0827f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:08:36.171908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-77928b70-941e-4ac6-a31d-324973f0827f admin admin] The token cache is being invalidate because project f78a1a4dccc8477e817be932abab2b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:08:36.172197 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-77928b70-941e-4ac6-a31d-324973f0827f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:08:36.172899 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-77928b70-941e-4ac6-a31d-324973f0827f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:08:36.174540 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1188/2394] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:08:35 2022] DELETE /identity/v3/projects/f78a1a4dccc8477e817be932abab2b16 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:08:41.343095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac6059-e1e6-4f96-aa74-423f1b83d5eb admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:08:41.345069 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-e5ac6059-e1e6-4f96-aa74-423f1b83d5eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:08:41.423353 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac6059-e1e6-4f96-aa74-423f1b83d5eb admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:08:41.497202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53d0de-ad51-465d-b6d0-d5a9f100c169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:08:41.497859 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53d0de-ad51-465d-b6d0-d5a9f100c169 service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:08:41.498148 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53d0de-ad51-465d-b6d0-d5a9f100c169 service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:08:41.498428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53d0de-ad51-465d-b6d0-d5a9f100c169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:08:41.500882 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-fd53d0de-ad51-465d-b6d0-d5a9f100c169 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:08:41.576716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53d0de-ad51-465d-b6d0-d5a9f100c169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:08:41.579361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53d0de-ad51-465d-b6d0-d5a9f100c169 service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:08:41.602313 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1207/2395] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:08:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:08:42.295499 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77928b70-941e-4ac6-a31d-324973f0827f admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:08:42.297146 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-77928b70-941e-4ac6-a31d-324973f0827f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:08:42.314552 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77928b70-941e-4ac6-a31d-324973f0827f admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:08:42.321408 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694ba58-287e-43c2-ab79-7d1a58cdaca3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:08:42.322058 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694ba58-287e-43c2-ab79-7d1a58cdaca3 service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:08:42.322320 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694ba58-287e-43c2-ab79-7d1a58cdaca3 service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:08:42.322616 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694ba58-287e-43c2-ab79-7d1a58cdaca3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:08:42.324518 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c694ba58-287e-43c2-ab79-7d1a58cdaca3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:08:42.391626 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694ba58-287e-43c2-ab79-7d1a58cdaca3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:08:42.393538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694ba58-287e-43c2-ab79-7d1a58cdaca3 service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:08:42.411029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1189/2396] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:08:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:10:26.440402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53d0de-ad51-465d-b6d0-d5a9f100c169 service nova] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:10:26.440402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-fd53d0de-ad51-465d-b6d0-d5a9f100c169 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:10:26.528694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53d0de-ad51-465d-b6d0-d5a9f100c169 service nova] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:10:26.533503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f85f65-19f1-43dd-ae66-fa57d734334a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:10:26.534168 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f85f65-19f1-43dd-ae66-fa57d734334a service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:10:26.534457 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f85f65-19f1-43dd-ae66-fa57d734334a service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:10:26.534738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f85f65-19f1-43dd-ae66-fa57d734334a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:10:26.536756 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-20f85f65-19f1-43dd-ae66-fa57d734334a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:10:26.623814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f85f65-19f1-43dd-ae66-fa57d734334a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:10:26.625288 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f85f65-19f1-43dd-ae66-fa57d734334a service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:10:26.635369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1208/2397] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:10:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:10:43.736863 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694ba58-287e-43c2-ab79-7d1a58cdaca3 service nova] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:10:43.804001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694ba58-287e-43c2-ab79-7d1a58cdaca3 service nova] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:10:43.810601 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ba025-dffc-4b2f-af15-4c874edc9c0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:10:43.811639 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ba025-dffc-4b2f-af15-4c874edc9c0c service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:10:43.811975 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ba025-dffc-4b2f-af15-4c874edc9c0c service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:10:43.812283 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ba025-dffc-4b2f-af15-4c874edc9c0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:10:43.814473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-134ba025-dffc-4b2f-af15-4c874edc9c0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:10:43.843205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f85f65-19f1-43dd-ae66-fa57d734334a service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:10:43.844555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-20f85f65-19f1-43dd-ae66-fa57d734334a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:10:43.892235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ba025-dffc-4b2f-af15-4c874edc9c0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:10:43.893818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ba025-dffc-4b2f-af15-4c874edc9c0c service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:10:43.911459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f85f65-19f1-43dd-ae66-fa57d734334a service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:10:43.914103 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1190/2398] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:10:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:10:43.916363 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e4bd2-e538-454b-b71b-ce910b646b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:10:43.917072 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e4bd2-e538-454b-b71b-ce910b646b98 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:10:43.917344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e4bd2-e538-454b-b71b-ce910b646b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:10:43.917611 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e4bd2-e538-454b-b71b-ce910b646b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:10:43.919511 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-992e4bd2-e538-454b-b71b-ce910b646b98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:10:43.933406 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e4bd2-e538-454b-b71b-ce910b646b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:10:43.934891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e4bd2-e538-454b-b71b-ce910b646b98 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:10:43.946159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1209/2399] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:10:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:10:50.267380 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ba025-dffc-4b2f-af15-4c874edc9c0c service nova] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:10:50.269721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-134ba025-dffc-4b2f-af15-4c874edc9c0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:10:50.362042 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ba025-dffc-4b2f-af15-4c874edc9c0c service nova] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:10:50.369997 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625dc91-f20c-4302-bdda-cd8eedb09214 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e203d7077af54930a640b2334a1d8fa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:10:50.370942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625dc91-f20c-4302-bdda-cd8eedb09214 service placement] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:10:50.371355 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625dc91-f20c-4302-bdda-cd8eedb09214 service placement] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:10:50.371612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625dc91-f20c-4302-bdda-cd8eedb09214 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:10:50.374937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e625dc91-f20c-4302-bdda-cd8eedb09214 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:10:50.393784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625dc91-f20c-4302-bdda-cd8eedb09214 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:10:50.395456 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625dc91-f20c-4302-bdda-cd8eedb09214 service placement] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:10:50.405297 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1191/2400] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:10:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:11:41.537371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e4bd2-e538-454b-b71b-ce910b646b98 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:11:41.538999 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-992e4bd2-e538-454b-b71b-ce910b646b98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:11:41.554203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e4bd2-e538-454b-b71b-ce910b646b98 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:11:41.560026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d64c6d-e921-4c3b-b067-c3038442e6fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:11:41.560668 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d64c6d-e921-4c3b-b067-c3038442e6fa service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:11:41.562230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d64c6d-e921-4c3b-b067-c3038442e6fa service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:11:41.562526 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d64c6d-e921-4c3b-b067-c3038442e6fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:11:41.564667 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-53d64c6d-e921-4c3b-b067-c3038442e6fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:11:41.594395 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d64c6d-e921-4c3b-b067-c3038442e6fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:11:41.595880 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d64c6d-e921-4c3b-b067-c3038442e6fa service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:11:41.607059 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1210/2401] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:11:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:11:42.070671 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625dc91-f20c-4302-bdda-cd8eedb09214 service placement] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:11:42.079894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625dc91-f20c-4302-bdda-cd8eedb09214 service placement] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:11:42.083519 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893e0cc-fbbf-42b8-b1c0-f70ef56ea52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:11:42.084170 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893e0cc-fbbf-42b8-b1c0-f70ef56ea52e service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:11:42.084530 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893e0cc-fbbf-42b8-b1c0-f70ef56ea52e service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:11:42.084803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893e0cc-fbbf-42b8-b1c0-f70ef56ea52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:11:42.087129 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-7893e0cc-fbbf-42b8-b1c0-f70ef56ea52e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:11:42.166208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893e0cc-fbbf-42b8-b1c0-f70ef56ea52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:11:42.167759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893e0cc-fbbf-42b8-b1c0-f70ef56ea52e service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:11:42.186791 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1192/2402] 10.222.0.11 () {60 vars in 1396 bytes} [Wed May 4 22:11:42 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:11:44.562253 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d64c6d-e921-4c3b-b067-c3038442e6fa service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:11:44.563796 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-53d64c6d-e921-4c3b-b067-c3038442e6fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:11:44.584442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d64c6d-e921-4c3b-b067-c3038442e6fa service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:11:44.589546 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78709d63-27cc-4232-86f5-5f043d1bdf94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:11:44.590210 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78709d63-27cc-4232-86f5-5f043d1bdf94 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:11:44.590498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78709d63-27cc-4232-86f5-5f043d1bdf94 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:11:44.590775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78709d63-27cc-4232-86f5-5f043d1bdf94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:11:44.593405 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-78709d63-27cc-4232-86f5-5f043d1bdf94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:11:44.608532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application [None req-78709d63-27cc-4232-86f5-5f043d1bdf94 service cinder] Could not find project: 2385454f60464c12a03d1184053a2e98.: keystone.exception.ProjectNotFound: Could not find project: 2385454f60464c12a03d1184053a2e98. May 04 22:11:44.608532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 22:11:44.608532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 22:11:44.608532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 22:11:44.608532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 22:11:44.608532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 22:11:44.608532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 22:11:44.608532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 22:11:44.608532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 22:11:44.608532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 22:11:44.608532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 22:11:44.608532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 22:11:44.608532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get May 04 22:11:44.608532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') May 04 22:11:44.608532 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 04 22:11:44.609684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 04 22:11:44.609684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 04 22:11:44.609684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 04 22:11:44.609684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 22:11:44.609684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 22:11:44.609684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token May 04 22:11:44.609684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application token = self._validate_token(token_id) May 04 22:11:44.609684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 22:11:44.609684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 22:11:44.609684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 22:11:44.609684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 22:11:44.609684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 22:11:44.609684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 22:11:44.609684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 22:11:44.609684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 22:11:44.609684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 22:11:44.609684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 22:11:44.610786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 22:11:44.610786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 22:11:44.610786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 22:11:44.610786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 22:11:44.610786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token May 04 22:11:44.610786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) May 04 22:11:44.610786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint May 04 22:11:44.610786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self._validate_token_resources() May 04 22:11:44.610786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources May 04 22:11:44.610786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): May 04 22:11:44.610786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project May 04 22:11:44.610786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( May 04 22:11:44.610786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 22:11:44.610786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 22:11:44.610786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 22:11:44.610786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 22:11:44.610786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 22:11:44.612303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.get_or_create( May 04 22:11:44.612303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 22:11:44.612303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application with Lock( May 04 22:11:44.612303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 22:11:44.612303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._enter() May 04 22:11:44.612303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 22:11:44.612303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 22:11:44.612303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 22:11:44.612303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.creator() May 04 22:11:44.612303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 22:11:44.612303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application created_value = creator( May 04 22:11:44.612303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 22:11:44.612303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 22:11:44.612303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 22:11:44.612303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 22:11:44.612303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 22:11:44.612303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 22:11:44.613373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2385454f60464c12a03d1184053a2e98. May 04 22:11:44.613373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: ERROR keystone.server.flask.application May 04 22:11:44.613373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1211/2403] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:11:44 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 04 22:11:48.180878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354507d-1489-4f4b-870a-e2cefc041095 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:11:48.181424 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354507d-1489-4f4b-870a-e2cefc041095 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:11:48.181537 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354507d-1489-4f4b-870a-e2cefc041095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:11:48.213076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-b354507d-1489-4f4b-870a-e2cefc041095 None None] MFA Rules not processed for user `0196716439d4473498c7c4b15a1e1d24`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:11:48.214671 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b354507d-1489-4f4b-870a-e2cefc041095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:11:48.223027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1193/2404] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:11:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:11:48.677033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59a124-728f-49e1-8763-5506610ea4c0 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:11:48.677594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59a124-728f-49e1-8763-5506610ea4c0 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:11:48.677594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59a124-728f-49e1-8763-5506610ea4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:11:48.705025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354507d-1489-4f4b-870a-e2cefc041095 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:11:48.712338 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-db59a124-728f-49e1-8763-5506610ea4c0 None None] MFA Rules not processed for user `2bf26e013e10482fae90fd291b1b90b2`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:11:48.713648 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-db59a124-728f-49e1-8763-5506610ea4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:11:48.717369 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354507d-1489-4f4b-870a-e2cefc041095 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:11:48.721550 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1212/2405] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:11:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:11:48.721698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c9062-caf7-4faf-91fa-81b2ea2febda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:11:48.722213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c9062-caf7-4faf-91fa-81b2ea2febda service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:11:48.722492 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c9062-caf7-4faf-91fa-81b2ea2febda service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:11:48.722760 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c9062-caf7-4faf-91fa-81b2ea2febda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:11:48.724723 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-7f7c9062-caf7-4faf-91fa-81b2ea2febda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:11:48.735516 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c9062-caf7-4faf-91fa-81b2ea2febda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:11:48.736943 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c9062-caf7-4faf-91fa-81b2ea2febda service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:11:48.745381 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1194/2406] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:11:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:11:49.087709 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59a124-728f-49e1-8763-5506610ea4c0 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:11:49.090910 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-db59a124-728f-49e1-8763-5506610ea4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:11:49.093089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c9062-caf7-4faf-91fa-81b2ea2febda service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:11:49.102084 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c9062-caf7-4faf-91fa-81b2ea2febda service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:11:49.105856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebc12a-9662-43ab-b7b8-ad0f7e1755f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:11:49.106749 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebc12a-9662-43ab-b7b8-ad0f7e1755f5 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:11:49.107213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebc12a-9662-43ab-b7b8-ad0f7e1755f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:11:49.107634 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebc12a-9662-43ab-b7b8-ad0f7e1755f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:11:49.110408 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-81ebc12a-9662-43ab-b7b8-ad0f7e1755f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:11:49.114372 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59a124-728f-49e1-8763-5506610ea4c0 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:11:49.121665 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebc12a-9662-43ab-b7b8-ad0f7e1755f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:11:49.123292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca1274-b0ee-4e20-89e0-a0f7b042a2bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e203d7077af54930a640b2334a1d8fa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:11:49.123746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebc12a-9662-43ab-b7b8-ad0f7e1755f5 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:11:49.124482 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca1274-b0ee-4e20-89e0-a0f7b042a2bc service placement] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:11:49.125187 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca1274-b0ee-4e20-89e0-a0f7b042a2bc service placement] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:11:49.125630 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca1274-b0ee-4e20-89e0-a0f7b042a2bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:11:49.128073 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-07ca1274-b0ee-4e20-89e0-a0f7b042a2bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:11:49.136005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1195/2407] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:11:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:11:49.153799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca1274-b0ee-4e20-89e0-a0f7b042a2bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:11:49.156100 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca1274-b0ee-4e20-89e0-a0f7b042a2bc service placement] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:11:49.168445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1213/2408] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:11:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:11:52.689560 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebc12a-9662-43ab-b7b8-ad0f7e1755f5 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:11:52.691836 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-81ebc12a-9662-43ab-b7b8-ad0f7e1755f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:11:52.710319 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebc12a-9662-43ab-b7b8-ad0f7e1755f5 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:11:52.745012 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feece9c-97bf-4d49-aba7-63831ae0a249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:11:52.746292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feece9c-97bf-4d49-aba7-63831ae0a249 service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:11:52.747528 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feece9c-97bf-4d49-aba7-63831ae0a249 service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:11:52.748364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feece9c-97bf-4d49-aba7-63831ae0a249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:11:52.750665 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-3feece9c-97bf-4d49-aba7-63831ae0a249 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:11:52.770682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feece9c-97bf-4d49-aba7-63831ae0a249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:11:52.773061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feece9c-97bf-4d49-aba7-63831ae0a249 service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:11:52.787824 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1196/2409] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:11:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:11:57.739361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca1274-b0ee-4e20-89e0-a0f7b042a2bc service placement] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:11:57.752886 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca1274-b0ee-4e20-89e0-a0f7b042a2bc service placement] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:11:57.759165 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d3287-c83e-4d4f-af82-66b962169082 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:11:57.759884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d3287-c83e-4d4f-af82-66b962169082 service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:11:57.760198 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d3287-c83e-4d4f-af82-66b962169082 service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:11:57.760433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d3287-c83e-4d4f-af82-66b962169082 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:11:57.762368 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-497d3287-c83e-4d4f-af82-66b962169082 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:11:57.775077 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d3287-c83e-4d4f-af82-66b962169082 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:11:57.776709 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d3287-c83e-4d4f-af82-66b962169082 service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:11:57.787574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1214/2410] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:11:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:12:26.926892 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feece9c-97bf-4d49-aba7-63831ae0a249 service nova] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:12:26.929257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-3feece9c-97bf-4d49-aba7-63831ae0a249 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:12:27.027356 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feece9c-97bf-4d49-aba7-63831ae0a249 service nova] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:12:27.032130 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a711e-f2ca-41f1-b1e7-23a5b4fc4cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:12:27.033007 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a711e-f2ca-41f1-b1e7-23a5b4fc4cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:27.033285 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a711e-f2ca-41f1-b1e7-23a5b4fc4cee admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:27.033556 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a711e-f2ca-41f1-b1e7-23a5b4fc4cee admin admin] PATH_INFO: `/v3/users/a196786e6b384408a46819eff3818af4` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:27.034744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a711e-f2ca-41f1-b1e7-23a5b4fc4cee admin admin] RBAC: Authorizing `identity:delete_user(user_id=a196786e6b384408a46819eff3818af4)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:12:27.036699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a711e-f2ca-41f1-b1e7-23a5b4fc4cee admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:12:27.086962 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-598a711e-f2ca-41f1-b1e7-23a5b4fc4cee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a196786e6b384408a46819eff3818af4'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:12:27.094889 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-598a711e-f2ca-41f1-b1e7-23a5b4fc4cee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a196786e6b384408a46819eff3818af4'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:12:27.102046 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-598a711e-f2ca-41f1-b1e7-23a5b4fc4cee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a196786e6b384408a46819eff3818af4'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:12:27.102800 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-598a711e-f2ca-41f1-b1e7-23a5b4fc4cee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a196786e6b384408a46819eff3818af4'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:12:27.103535 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-598a711e-f2ca-41f1-b1e7-23a5b4fc4cee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a196786e6b384408a46819eff3818af4'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:12:27.121226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1197/2411] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:12:26 2022] DELETE /identity/v3/users/a196786e6b384408a46819eff3818af4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:12:27.126070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fdc48-a10d-45a9-90da-62219b5a3196 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:27.126569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fdc48-a10d-45a9-90da-62219b5a3196 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:27.126698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fdc48-a10d-45a9-90da-62219b5a3196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:27.144106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-b39fdc48-a10d-45a9-90da-62219b5a3196 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:12:27.145589 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-b39fdc48-a10d-45a9-90da-62219b5a3196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:12:27.208012 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1215/2412] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:12:27.218522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a711e-f2ca-41f1-b1e7-23a5b4fc4cee admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:12:27.220265 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-598a711e-f2ca-41f1-b1e7-23a5b4fc4cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:12:27.302833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a711e-f2ca-41f1-b1e7-23a5b4fc4cee admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:12:27.306949 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422c4bb-e395-48f0-bb48-0c8cb4076278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:12:27.307637 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422c4bb-e395-48f0-bb48-0c8cb4076278 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:27.307914 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422c4bb-e395-48f0-bb48-0c8cb4076278 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:27.308193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422c4bb-e395-48f0-bb48-0c8cb4076278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:27.317753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422c4bb-e395-48f0-bb48-0c8cb4076278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:12:27.319220 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422c4bb-e395-48f0-bb48-0c8cb4076278 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:12:27.329075 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1198/2413] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:12:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:12:27.604481 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fdc48-a10d-45a9-90da-62219b5a3196 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:12:27.606020 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-b39fdc48-a10d-45a9-90da-62219b5a3196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:12:27.618836 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fdc48-a10d-45a9-90da-62219b5a3196 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:12:27.624098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5cecc-af78-4b59-aed9-ab21acdaf20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:12:27.625106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5cecc-af78-4b59-aed9-ab21acdaf20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:27.625389 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5cecc-af78-4b59-aed9-ab21acdaf20f admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:27.626301 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5cecc-af78-4b59-aed9-ab21acdaf20f admin admin] PATH_INFO: `/v3/projects/9af135205a22414eb4ea9cfccc14051d` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:27.627847 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5cecc-af78-4b59-aed9-ab21acdaf20f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9af135205a22414eb4ea9cfccc14051d)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:12:27.629822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5cecc-af78-4b59-aed9-ab21acdaf20f admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:12:27.678518 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-5cd5cecc-af78-4b59-aed9-ab21acdaf20f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9af135205a22414eb4ea9cfccc14051d', 'request_id': 'req-5cd5cecc-af78-4b59-aed9-ab21acdaf20f'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:12:27.686769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-5cd5cecc-af78-4b59-aed9-ab21acdaf20f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9af135205a22414eb4ea9cfccc14051d', 'request_id': 'req-5cd5cecc-af78-4b59-aed9-ab21acdaf20f'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:12:27.693398 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-5cd5cecc-af78-4b59-aed9-ab21acdaf20f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9af135205a22414eb4ea9cfccc14051d', 'request_id': 'req-5cd5cecc-af78-4b59-aed9-ab21acdaf20f'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:12:27.703719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-5cd5cecc-af78-4b59-aed9-ab21acdaf20f admin admin] The token cache is being invalidate because project 9af135205a22414eb4ea9cfccc14051d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:12:27.704007 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-5cd5cecc-af78-4b59-aed9-ab21acdaf20f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:12:27.704664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-5cd5cecc-af78-4b59-aed9-ab21acdaf20f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:12:27.706206 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1216/2414] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:12:27 2022] DELETE /identity/v3/projects/9af135205a22414eb4ea9cfccc14051d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:12:27.710309 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422c4bb-e395-48f0-bb48-0c8cb4076278 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:12:27.720850 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422c4bb-e395-48f0-bb48-0c8cb4076278 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:12:27.776691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eaa813-012c-4171-9997-c675bf023319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:12:27.777563 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eaa813-012c-4171-9997-c675bf023319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:27.777839 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eaa813-012c-4171-9997-c675bf023319 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:27.778110 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eaa813-012c-4171-9997-c675bf023319 admin admin] PATH_INFO: `/v3/users/c293c48ab8e447c294e0399dcb462158` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:27.779336 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eaa813-012c-4171-9997-c675bf023319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c293c48ab8e447c294e0399dcb462158)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:12:27.781594 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eaa813-012c-4171-9997-c675bf023319 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:12:27.831380 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-54eaa813-012c-4171-9997-c675bf023319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c293c48ab8e447c294e0399dcb462158'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:12:27.839982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-54eaa813-012c-4171-9997-c675bf023319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c293c48ab8e447c294e0399dcb462158'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:12:27.847147 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-54eaa813-012c-4171-9997-c675bf023319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c293c48ab8e447c294e0399dcb462158'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:12:27.847790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-54eaa813-012c-4171-9997-c675bf023319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c293c48ab8e447c294e0399dcb462158'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:12:27.848427 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-54eaa813-012c-4171-9997-c675bf023319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c293c48ab8e447c294e0399dcb462158'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:12:27.868640 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1199/2415] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:12:27 2022] DELETE /identity/v3/users/c293c48ab8e447c294e0399dcb462158 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:12:28.317545 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5cecc-af78-4b59-aed9-ab21acdaf20f admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:12:28.319265 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5cd5cecc-af78-4b59-aed9-ab21acdaf20f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:12:28.339494 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5cecc-af78-4b59-aed9-ab21acdaf20f admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:12:28.414803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cc927-ce97-420a-a21f-683996a27f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:12:28.415724 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cc927-ce97-420a-a21f-683996a27f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:28.416011 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cc927-ce97-420a-a21f-683996a27f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:28.416287 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cc927-ce97-420a-a21f-683996a27f4e admin admin] PATH_INFO: `/v3/projects/5cdbe28e53e74c1b8bd7b7a403db1326` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:28.417693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cc927-ce97-420a-a21f-683996a27f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cdbe28e53e74c1b8bd7b7a403db1326)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:12:28.419713 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cc927-ce97-420a-a21f-683996a27f4e admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:12:28.470065 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-b34cc927-ce97-420a-a21f-683996a27f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cdbe28e53e74c1b8bd7b7a403db1326', 'request_id': 'req-b34cc927-ce97-420a-a21f-683996a27f4e'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:12:28.479031 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-b34cc927-ce97-420a-a21f-683996a27f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cdbe28e53e74c1b8bd7b7a403db1326', 'request_id': 'req-b34cc927-ce97-420a-a21f-683996a27f4e'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:12:28.485244 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-b34cc927-ce97-420a-a21f-683996a27f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cdbe28e53e74c1b8bd7b7a403db1326', 'request_id': 'req-b34cc927-ce97-420a-a21f-683996a27f4e'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:12:28.495370 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-b34cc927-ce97-420a-a21f-683996a27f4e admin admin] The token cache is being invalidate because project 5cdbe28e53e74c1b8bd7b7a403db1326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:12:28.495659 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-b34cc927-ce97-420a-a21f-683996a27f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:12:28.496364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-b34cc927-ce97-420a-a21f-683996a27f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:12:28.497943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1217/2416] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:12:28 2022] DELETE /identity/v3/projects/5cdbe28e53e74c1b8bd7b7a403db1326 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:12:28.503865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8b90e-faa9-48c9-8784-16ea6e11f8db None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:28.504396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8b90e-faa9-48c9-8784-16ea6e11f8db None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:28.504396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8b90e-faa9-48c9-8784-16ea6e11f8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:28.525295 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-3cc8b90e-faa9-48c9-8784-16ea6e11f8db None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:12:28.526494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-3cc8b90e-faa9-48c9-8784-16ea6e11f8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:12:28.598884 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1200/2417] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:12:28.607069 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6864ff4-ee6a-4def-a8d6-923eb73adec5 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:28.607484 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6864ff4-ee6a-4def-a8d6-923eb73adec5 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:28.607854 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6864ff4-ee6a-4def-a8d6-923eb73adec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:28.628010 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-d6864ff4-ee6a-4def-a8d6-923eb73adec5 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:12:28.629249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-d6864ff4-ee6a-4def-a8d6-923eb73adec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:12:28.638891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1218/2418] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:12:28.643442 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8b90e-faa9-48c9-8784-16ea6e11f8db None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:12:28.653789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8b90e-faa9-48c9-8784-16ea6e11f8db None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:12:28.658752 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ecb8a-56bb-4624-9ec5-3857c972a05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:12:28.659537 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ecb8a-56bb-4624-9ec5-3857c972a05e admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:28.659885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ecb8a-56bb-4624-9ec5-3857c972a05e admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:28.660224 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ecb8a-56bb-4624-9ec5-3857c972a05e admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:28.661030 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ecb8a-56bb-4624-9ec5-3857c972a05e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:12:28.661403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ecb8a-56bb-4624-9ec5-3857c972a05e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:12:28.663118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ecb8a-56bb-4624-9ec5-3857c972a05e admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:12:28.675700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1201/2419] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:12:28.680089 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6864ff4-ee6a-4def-a8d6-923eb73adec5 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:12:28.690135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6864ff4-ee6a-4def-a8d6-923eb73adec5 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:12:28.695296 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ed108-af86-4f2d-a32b-031ccfce8e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:12:28.695979 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ed108-af86-4f2d-a32b-031ccfce8e68 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:28.696264 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ed108-af86-4f2d-a32b-031ccfce8e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:28.696543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ed108-af86-4f2d-a32b-031ccfce8e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:28.697261 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ed108-af86-4f2d-a32b-031ccfce8e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:12:28.699293 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ed108-af86-4f2d-a32b-031ccfce8e68 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:12:28.728691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1219/2420] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:12:28 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:12:28.733009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ecb8a-56bb-4624-9ec5-3857c972a05e admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:12:28.743597 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ecb8a-56bb-4624-9ec5-3857c972a05e admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:12:28.796773 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d0181-4364-4569-9860-4faf192f88ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:12:28.797449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d0181-4364-4569-9860-4faf192f88ce admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:28.797729 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d0181-4364-4569-9860-4faf192f88ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:28.797998 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d0181-4364-4569-9860-4faf192f88ce admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:28.798695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d0181-4364-4569-9860-4faf192f88ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:12:28.800669 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d0181-4364-4569-9860-4faf192f88ce admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:12:28.823565 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1202/2421] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:12:28 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:12:28.828005 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ed108-af86-4f2d-a32b-031ccfce8e68 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:12:28.838465 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ed108-af86-4f2d-a32b-031ccfce8e68 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:12:28.843076 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c2216-4b33-4edd-abec-6e1913107fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:12:28.843878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c2216-4b33-4edd-abec-6e1913107fbd admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:28.844169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c2216-4b33-4edd-abec-6e1913107fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:28.844446 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c2216-4b33-4edd-abec-6e1913107fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:28.845176 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c2216-4b33-4edd-abec-6e1913107fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:12:28.846802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c2216-4b33-4edd-abec-6e1913107fbd admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:12:28.857200 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1220/2422] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:12:28.861492 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d0181-4364-4569-9860-4faf192f88ce admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:12:28.871993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d0181-4364-4569-9860-4faf192f88ce admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:12:28.877579 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52a7e5-c1b8-4964-a772-559203b2a6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:12:28.878358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52a7e5-c1b8-4964-a772-559203b2a6ac admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:28.878648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52a7e5-c1b8-4964-a772-559203b2a6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:28.878931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52a7e5-c1b8-4964-a772-559203b2a6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:28.879701 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52a7e5-c1b8-4964-a772-559203b2a6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:12:28.881401 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52a7e5-c1b8-4964-a772-559203b2a6ac admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:12:28.891754 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1203/2423] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:12:28.896065 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c2216-4b33-4edd-abec-6e1913107fbd admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:12:28.906914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c2216-4b33-4edd-abec-6e1913107fbd admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:12:28.911778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ba6d5-f730-45a1-9788-b29bbaa15bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:12:28.912670 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ba6d5-f730-45a1-9788-b29bbaa15bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:28.912955 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ba6d5-f730-45a1-9788-b29bbaa15bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:28.913232 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ba6d5-f730-45a1-9788-b29bbaa15bb9 admin admin] PATH_INFO: `/v3/projects/a6d9d653ad51401a977b0bcb1dec3896/users/69bb100e7cb048a5b815952dd5f1e7c7/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:28.929788 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ba6d5-f730-45a1-9788-b29bbaa15bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d9d653ad51401a977b0bcb1dec3896, user_id=69bb100e7cb048a5b815952dd5f1e7c7, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:12:28.932524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ba6d5-f730-45a1-9788-b29bbaa15bb9 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:12:28.949231 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1221/2424] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:12:28 2022] PUT /identity/v3/projects/a6d9d653ad51401a977b0bcb1dec3896/users/69bb100e7cb048a5b815952dd5f1e7c7/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:12:28.959823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfe241-c48d-48f4-b2b3-9ddfa8f95a16 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:28.960191 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfe241-c48d-48f4-b2b3-9ddfa8f95a16 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:28.960536 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfe241-c48d-48f4-b2b3-9ddfa8f95a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:28.988737 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-79dfe241-c48d-48f4-b2b3-9ddfa8f95a16 None None] MFA Rules not processed for user `69bb100e7cb048a5b815952dd5f1e7c7`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:12:28.990105 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-79dfe241-c48d-48f4-b2b3-9ddfa8f95a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:12:29.057396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1204/2425] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:12:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 22:12:29.062111 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ba6d5-f730-45a1-9788-b29bbaa15bb9 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:12:29.124254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ba6d5-f730-45a1-9788-b29bbaa15bb9 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:12:29.129667 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5c54c-e076-48d0-ab79-59289e27f978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:12:29.130325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c54c-e076-48d0-ab79-59289e27f978 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:29.130612 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c54c-e076-48d0-ab79-59289e27f978 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:29.130892 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c54c-e076-48d0-ab79-59289e27f978 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:29.131615 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5c54c-e076-48d0-ab79-59289e27f978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:12:29.133570 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5c54c-e076-48d0-ab79-59289e27f978 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:12:29.164054 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1222/2426] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:12:29 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:12:29.168341 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfe241-c48d-48f4-b2b3-9ddfa8f95a16 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:12:29.179616 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfe241-c48d-48f4-b2b3-9ddfa8f95a16 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:12:29.235278 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff391025-b339-4c9d-bcae-b2addcfd6ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:12:29.236018 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff391025-b339-4c9d-bcae-b2addcfd6ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:29.236292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff391025-b339-4c9d-bcae-b2addcfd6ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:29.236564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff391025-b339-4c9d-bcae-b2addcfd6ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:29.237249 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff391025-b339-4c9d-bcae-b2addcfd6ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:12:29.239220 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff391025-b339-4c9d-bcae-b2addcfd6ae2 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:12:29.261766 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1205/2427] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:12:29 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:12:29.265610 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5c54c-e076-48d0-ab79-59289e27f978 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:12:29.276790 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5c54c-e076-48d0-ab79-59289e27f978 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:12:29.282870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194535d-0de5-46e2-99b2-b3f7e6a0ecb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:12:29.283722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194535d-0de5-46e2-99b2-b3f7e6a0ecb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:29.283846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194535d-0de5-46e2-99b2-b3f7e6a0ecb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:29.284113 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194535d-0de5-46e2-99b2-b3f7e6a0ecb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:29.285099 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194535d-0de5-46e2-99b2-b3f7e6a0ecb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:12:29.286457 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194535d-0de5-46e2-99b2-b3f7e6a0ecb0 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:12:29.299074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1223/2428] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:12:29.304172 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff391025-b339-4c9d-bcae-b2addcfd6ae2 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:12:29.315635 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff391025-b339-4c9d-bcae-b2addcfd6ae2 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:12:29.320937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d6ea8-da96-4955-b3c7-8f4a5aeebbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:12:29.321838 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d6ea8-da96-4955-b3c7-8f4a5aeebbc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:29.322120 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d6ea8-da96-4955-b3c7-8f4a5aeebbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:29.322394 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d6ea8-da96-4955-b3c7-8f4a5aeebbc4 admin admin] PATH_INFO: `/v3/projects/8934614dd3a841839fea822edfe1b61e/users/f38ab1a5b85b427683a7ae664ff55a48/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:29.337615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d6ea8-da96-4955-b3c7-8f4a5aeebbc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8934614dd3a841839fea822edfe1b61e, user_id=f38ab1a5b85b427683a7ae664ff55a48, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:12:29.340324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d6ea8-da96-4955-b3c7-8f4a5aeebbc4 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:12:29.356702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1206/2429] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:12:29 2022] PUT /identity/v3/projects/8934614dd3a841839fea822edfe1b61e/users/f38ab1a5b85b427683a7ae664ff55a48/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:12:29.361074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194535d-0de5-46e2-99b2-b3f7e6a0ecb0 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:12:29.372862 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194535d-0de5-46e2-99b2-b3f7e6a0ecb0 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:12:29.433558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12390c65-561d-4262-977b-1246b50fd8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:12:29.434219 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12390c65-561d-4262-977b-1246b50fd8ca admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:29.434497 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12390c65-561d-4262-977b-1246b50fd8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:29.434770 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12390c65-561d-4262-977b-1246b50fd8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:29.435540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12390c65-561d-4262-977b-1246b50fd8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:12:29.437248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12390c65-561d-4262-977b-1246b50fd8ca admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:12:29.447101 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1224/2430] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:12:29.453111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d6ea8-da96-4955-b3c7-8f4a5aeebbc4 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:12:29.463623 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d6ea8-da96-4955-b3c7-8f4a5aeebbc4 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:12:29.468716 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad481b3-d935-4611-811b-47b760e88e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:12:29.469602 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad481b3-d935-4611-811b-47b760e88e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:29.469896 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad481b3-d935-4611-811b-47b760e88e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:29.470143 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad481b3-d935-4611-811b-47b760e88e05 admin admin] PATH_INFO: `/v3/projects/8934614dd3a841839fea822edfe1b61e/users/f38ab1a5b85b427683a7ae664ff55a48/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:29.472153 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad481b3-d935-4611-811b-47b760e88e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8934614dd3a841839fea822edfe1b61e, user_id=f38ab1a5b85b427683a7ae664ff55a48, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:12:29.474795 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad481b3-d935-4611-811b-47b760e88e05 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:12:29.489605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1207/2431] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:12:29 2022] PUT /identity/v3/projects/8934614dd3a841839fea822edfe1b61e/users/f38ab1a5b85b427683a7ae664ff55a48/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:12:29.501212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a0491-62af-4831-a427-9c75f58be5f5 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:29.501508 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a0491-62af-4831-a427-9c75f58be5f5 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:29.501789 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a0491-62af-4831-a427-9c75f58be5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:29.530016 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-385a0491-62af-4831-a427-9c75f58be5f5 None None] MFA Rules not processed for user `f38ab1a5b85b427683a7ae664ff55a48`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:12:29.531591 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-385a0491-62af-4831-a427-9c75f58be5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:12:29.605297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1225/2432] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:12:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:12:49.947960 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad481b3-d935-4611-811b-47b760e88e05 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:12:49.950123 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-cad481b3-d935-4611-811b-47b760e88e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:12:50.009155 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad481b3-d935-4611-811b-47b760e88e05 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:12:50.013326 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e125d-2ff7-4d76-820d-ea9a1b0f7ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:12:50.014164 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e125d-2ff7-4d76-820d-ea9a1b0f7ddd service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:12:50.014450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e125d-2ff7-4d76-820d-ea9a1b0f7ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:12:50.014739 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e125d-2ff7-4d76-820d-ea9a1b0f7ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:12:50.016906 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-451e125d-2ff7-4d76-820d-ea9a1b0f7ddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:12:50.026417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e125d-2ff7-4d76-820d-ea9a1b0f7ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:12:50.027867 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e125d-2ff7-4d76-820d-ea9a1b0f7ddd service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:12:50.035643 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1208/2433] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:12:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:13:29.674434 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a0491-62af-4831-a427-9c75f58be5f5 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:29.744788 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a0491-62af-4831-a427-9c75f58be5f5 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:29.750102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36df9e8-2464-4d70-87f1-63b3d4370914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:29.751073 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36df9e8-2464-4d70-87f1-63b3d4370914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:29.751393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36df9e8-2464-4d70-87f1-63b3d4370914 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:29.751671 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36df9e8-2464-4d70-87f1-63b3d4370914 admin admin] PATH_INFO: `/v3/users/69bb100e7cb048a5b815952dd5f1e7c7` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:29.752968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36df9e8-2464-4d70-87f1-63b3d4370914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69bb100e7cb048a5b815952dd5f1e7c7)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:29.754912 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36df9e8-2464-4d70-87f1-63b3d4370914 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:29.807522 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c36df9e8-2464-4d70-87f1-63b3d4370914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69bb100e7cb048a5b815952dd5f1e7c7'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:13:29.814288 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c36df9e8-2464-4d70-87f1-63b3d4370914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69bb100e7cb048a5b815952dd5f1e7c7'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:13:29.815013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c36df9e8-2464-4d70-87f1-63b3d4370914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69bb100e7cb048a5b815952dd5f1e7c7'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:13:29.827269 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c36df9e8-2464-4d70-87f1-63b3d4370914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69bb100e7cb048a5b815952dd5f1e7c7'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:13:29.836684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c36df9e8-2464-4d70-87f1-63b3d4370914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69bb100e7cb048a5b815952dd5f1e7c7'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:13:29.842892 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1226/2434] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:13:29 2022] DELETE /identity/v3/users/69bb100e7cb048a5b815952dd5f1e7c7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:13:29.847598 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a38ffa-e512-455d-82ae-73da02fc95e1 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:29.848089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a38ffa-e512-455d-82ae-73da02fc95e1 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:29.848194 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a38ffa-e512-455d-82ae-73da02fc95e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:29.877950 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-f3a38ffa-e512-455d-82ae-73da02fc95e1 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:13:29.879178 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f3a38ffa-e512-455d-82ae-73da02fc95e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:13:29.938725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1209/2435] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:13:29.949500 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36df9e8-2464-4d70-87f1-63b3d4370914 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:29.951945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c36df9e8-2464-4d70-87f1-63b3d4370914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:13:30.009651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36df9e8-2464-4d70-87f1-63b3d4370914 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:30.014069 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70362eb-6d76-47aa-9dc1-6095163279c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:30.015153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70362eb-6d76-47aa-9dc1-6095163279c0 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:30.015625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70362eb-6d76-47aa-9dc1-6095163279c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:30.016123 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70362eb-6d76-47aa-9dc1-6095163279c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:30.026796 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70362eb-6d76-47aa-9dc1-6095163279c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:30.028281 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70362eb-6d76-47aa-9dc1-6095163279c0 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:30.037921 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1227/2436] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:13:30.338280 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a38ffa-e512-455d-82ae-73da02fc95e1 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:30.339862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f3a38ffa-e512-455d-82ae-73da02fc95e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:13:30.353871 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a38ffa-e512-455d-82ae-73da02fc95e1 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:30.359692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95df0d5-ed49-40c8-9caa-1e77fb52c401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:30.360730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95df0d5-ed49-40c8-9caa-1e77fb52c401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:30.361026 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95df0d5-ed49-40c8-9caa-1e77fb52c401 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:30.361265 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95df0d5-ed49-40c8-9caa-1e77fb52c401 admin admin] PATH_INFO: `/v3/projects/a6d9d653ad51401a977b0bcb1dec3896` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:30.362861 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95df0d5-ed49-40c8-9caa-1e77fb52c401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6d9d653ad51401a977b0bcb1dec3896)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:30.365999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95df0d5-ed49-40c8-9caa-1e77fb52c401 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:30.416721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-d95df0d5-ed49-40c8-9caa-1e77fb52c401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6d9d653ad51401a977b0bcb1dec3896', 'request_id': 'req-d95df0d5-ed49-40c8-9caa-1e77fb52c401'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:13:30.423165 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-d95df0d5-ed49-40c8-9caa-1e77fb52c401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6d9d653ad51401a977b0bcb1dec3896', 'request_id': 'req-d95df0d5-ed49-40c8-9caa-1e77fb52c401'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:13:30.431781 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-d95df0d5-ed49-40c8-9caa-1e77fb52c401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6d9d653ad51401a977b0bcb1dec3896', 'request_id': 'req-d95df0d5-ed49-40c8-9caa-1e77fb52c401'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:13:30.442015 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-d95df0d5-ed49-40c8-9caa-1e77fb52c401 admin admin] The token cache is being invalidate because project a6d9d653ad51401a977b0bcb1dec3896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:13:30.442305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-d95df0d5-ed49-40c8-9caa-1e77fb52c401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:13:30.442908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-d95df0d5-ed49-40c8-9caa-1e77fb52c401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:13:30.444518 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1210/2437] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:13:30 2022] DELETE /identity/v3/projects/a6d9d653ad51401a977b0bcb1dec3896 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:13:30.448704 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70362eb-6d76-47aa-9dc1-6095163279c0 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:30.458883 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70362eb-6d76-47aa-9dc1-6095163279c0 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:30.533189 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd959e0-3f81-4ccc-94f8-b13f6bd2a224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:30.534079 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd959e0-3f81-4ccc-94f8-b13f6bd2a224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:30.534359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd959e0-3f81-4ccc-94f8-b13f6bd2a224 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:30.534629 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd959e0-3f81-4ccc-94f8-b13f6bd2a224 admin admin] PATH_INFO: `/v3/users/f38ab1a5b85b427683a7ae664ff55a48` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:30.535901 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd959e0-3f81-4ccc-94f8-b13f6bd2a224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38ab1a5b85b427683a7ae664ff55a48)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:30.537840 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd959e0-3f81-4ccc-94f8-b13f6bd2a224 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:30.590154 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-0cd959e0-3f81-4ccc-94f8-b13f6bd2a224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38ab1a5b85b427683a7ae664ff55a48'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:13:30.596990 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-0cd959e0-3f81-4ccc-94f8-b13f6bd2a224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38ab1a5b85b427683a7ae664ff55a48'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:13:30.597667 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-0cd959e0-3f81-4ccc-94f8-b13f6bd2a224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38ab1a5b85b427683a7ae664ff55a48'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:13:30.609021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-0cd959e0-3f81-4ccc-94f8-b13f6bd2a224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38ab1a5b85b427683a7ae664ff55a48'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:13:30.620081 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-0cd959e0-3f81-4ccc-94f8-b13f6bd2a224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38ab1a5b85b427683a7ae664ff55a48'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:13:30.626285 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1228/2438] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:13:30 2022] DELETE /identity/v3/users/f38ab1a5b85b427683a7ae664ff55a48 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:13:30.914704 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95df0d5-ed49-40c8-9caa-1e77fb52c401 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:30.916169 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-d95df0d5-ed49-40c8-9caa-1e77fb52c401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:13:30.931623 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95df0d5-ed49-40c8-9caa-1e77fb52c401 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:30.997427 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148df44-8357-4365-ac9c-0de79a159821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:30.998301 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148df44-8357-4365-ac9c-0de79a159821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:30.998583 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148df44-8357-4365-ac9c-0de79a159821 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:30.998856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148df44-8357-4365-ac9c-0de79a159821 admin admin] PATH_INFO: `/v3/projects/8934614dd3a841839fea822edfe1b61e` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:31.000195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148df44-8357-4365-ac9c-0de79a159821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8934614dd3a841839fea822edfe1b61e)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:31.002498 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148df44-8357-4365-ac9c-0de79a159821 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:31.053684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b148df44-8357-4365-ac9c-0de79a159821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8934614dd3a841839fea822edfe1b61e', 'request_id': 'req-b148df44-8357-4365-ac9c-0de79a159821'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:13:31.059862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b148df44-8357-4365-ac9c-0de79a159821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8934614dd3a841839fea822edfe1b61e', 'request_id': 'req-b148df44-8357-4365-ac9c-0de79a159821'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:13:31.069845 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b148df44-8357-4365-ac9c-0de79a159821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8934614dd3a841839fea822edfe1b61e', 'request_id': 'req-b148df44-8357-4365-ac9c-0de79a159821'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:13:31.080315 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b148df44-8357-4365-ac9c-0de79a159821 admin admin] The token cache is being invalidate because project 8934614dd3a841839fea822edfe1b61e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:13:31.080597 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b148df44-8357-4365-ac9c-0de79a159821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:13:31.081232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b148df44-8357-4365-ac9c-0de79a159821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:13:31.082785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1211/2439] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:13:30 2022] DELETE /identity/v3/projects/8934614dd3a841839fea822edfe1b61e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:13:31.095676 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef221a-7bb7-426f-bcd3-309728bddb26 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:31.096230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef221a-7bb7-426f-bcd3-309728bddb26 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:31.096329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef221a-7bb7-426f-bcd3-309728bddb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:31.145265 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-79ef221a-7bb7-426f-bcd3-309728bddb26 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:13:31.146478 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-79ef221a-7bb7-426f-bcd3-309728bddb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:13:31.207927 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1229/2440] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:13:31.216567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b411ee-7014-495b-8af0-c9e364b7d2fc None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:31.216855 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b411ee-7014-495b-8af0-c9e364b7d2fc None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:31.217129 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b411ee-7014-495b-8af0-c9e364b7d2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:31.237029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-41b411ee-7014-495b-8af0-c9e364b7d2fc None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:13:31.238240 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-41b411ee-7014-495b-8af0-c9e364b7d2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:13:31.247707 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1212/2441] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:13:31.252838 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef221a-7bb7-426f-bcd3-309728bddb26 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:31.268969 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef221a-7bb7-426f-bcd3-309728bddb26 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:31.275879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edb8fa-5482-4550-98cf-2535354fc85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:31.276529 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edb8fa-5482-4550-98cf-2535354fc85b admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:31.276812 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edb8fa-5482-4550-98cf-2535354fc85b admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:31.277082 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edb8fa-5482-4550-98cf-2535354fc85b admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:31.277806 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edb8fa-5482-4550-98cf-2535354fc85b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:13:31.278112 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edb8fa-5482-4550-98cf-2535354fc85b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:31.279806 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edb8fa-5482-4550-98cf-2535354fc85b admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:31.291959 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1230/2442] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:13:31.296490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b411ee-7014-495b-8af0-c9e364b7d2fc None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:31.305641 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b411ee-7014-495b-8af0-c9e364b7d2fc None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:31.310397 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7d3b1-33c2-477b-95a0-35807abc5db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:31.311102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7d3b1-33c2-477b-95a0-35807abc5db6 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:31.311387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7d3b1-33c2-477b-95a0-35807abc5db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:31.311656 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7d3b1-33c2-477b-95a0-35807abc5db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:31.312332 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7d3b1-33c2-477b-95a0-35807abc5db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:31.314289 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7d3b1-33c2-477b-95a0-35807abc5db6 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:31.353983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1213/2443] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:13:31 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:13:31.358261 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edb8fa-5482-4550-98cf-2535354fc85b admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:31.369128 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edb8fa-5482-4550-98cf-2535354fc85b admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:31.425210 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edc8d6-7cc3-4edd-b75f-9e9d0918bf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:31.425880 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edc8d6-7cc3-4edd-b75f-9e9d0918bf22 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:31.426169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edc8d6-7cc3-4edd-b75f-9e9d0918bf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:31.426442 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edc8d6-7cc3-4edd-b75f-9e9d0918bf22 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:31.427159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09edc8d6-7cc3-4edd-b75f-9e9d0918bf22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:31.429125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09edc8d6-7cc3-4edd-b75f-9e9d0918bf22 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:31.451721 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1231/2444] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:13:31 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:13:31.457072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7d3b1-33c2-477b-95a0-35807abc5db6 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:31.468468 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7d3b1-33c2-477b-95a0-35807abc5db6 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:31.473605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608a79f-9694-4034-a330-88be8ccac070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:31.474286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608a79f-9694-4034-a330-88be8ccac070 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:31.474571 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608a79f-9694-4034-a330-88be8ccac070 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:31.474871 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608a79f-9694-4034-a330-88be8ccac070 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:31.475668 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608a79f-9694-4034-a330-88be8ccac070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:31.477292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608a79f-9694-4034-a330-88be8ccac070 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:31.488462 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1214/2445] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 22:13:31.492459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edc8d6-7cc3-4edd-b75f-9e9d0918bf22 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:31.502593 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edc8d6-7cc3-4edd-b75f-9e9d0918bf22 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:31.507673 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ed0d2-dc8d-4703-8893-302106f30683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:31.508343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ed0d2-dc8d-4703-8893-302106f30683 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:31.508628 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ed0d2-dc8d-4703-8893-302106f30683 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:31.508908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ed0d2-dc8d-4703-8893-302106f30683 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:31.509637 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ed0d2-dc8d-4703-8893-302106f30683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:31.511284 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ed0d2-dc8d-4703-8893-302106f30683 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:31.521542 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1232/2446] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:13:31.525795 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608a79f-9694-4034-a330-88be8ccac070 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:31.535791 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608a79f-9694-4034-a330-88be8ccac070 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:31.540820 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8906f-e2bc-4b00-b1b0-cb41e3765169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:31.541704 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8906f-e2bc-4b00-b1b0-cb41e3765169 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:31.541989 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8906f-e2bc-4b00-b1b0-cb41e3765169 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:31.542280 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8906f-e2bc-4b00-b1b0-cb41e3765169 admin admin] PATH_INFO: `/v3/projects/8ecfd446c5794230b9c74c30098c36ba/users/51b3208b05844f4980a2ea03f035b6e2/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:31.559841 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8906f-e2bc-4b00-b1b0-cb41e3765169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ecfd446c5794230b9c74c30098c36ba, user_id=51b3208b05844f4980a2ea03f035b6e2, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:31.562606 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8906f-e2bc-4b00-b1b0-cb41e3765169 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:31.589367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1215/2447] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:13:31 2022] PUT /identity/v3/projects/8ecfd446c5794230b9c74c30098c36ba/users/51b3208b05844f4980a2ea03f035b6e2/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:13:31.591170 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6924e8-9cef-46dd-a982-51a448ccf2f0 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:31.591461 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6924e8-9cef-46dd-a982-51a448ccf2f0 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:31.591736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6924e8-9cef-46dd-a982-51a448ccf2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:31.618569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-5a6924e8-9cef-46dd-a982-51a448ccf2f0 None None] MFA Rules not processed for user `51b3208b05844f4980a2ea03f035b6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:13:31.619820 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5a6924e8-9cef-46dd-a982-51a448ccf2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:13:31.680967 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1233/2448] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:13:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:13:31.685586 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8906f-e2bc-4b00-b1b0-cb41e3765169 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:31.752738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8906f-e2bc-4b00-b1b0-cb41e3765169 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:31.758553 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08e668-8c79-4c72-9b7f-6e0e34813ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:31.759245 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08e668-8c79-4c72-9b7f-6e0e34813ceb admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:31.759522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08e668-8c79-4c72-9b7f-6e0e34813ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:31.759791 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08e668-8c79-4c72-9b7f-6e0e34813ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:31.760476 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08e668-8c79-4c72-9b7f-6e0e34813ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:31.762388 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08e668-8c79-4c72-9b7f-6e0e34813ceb admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:31.792924 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1216/2449] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:13:31 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:13:31.797353 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6924e8-9cef-46dd-a982-51a448ccf2f0 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:31.808455 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6924e8-9cef-46dd-a982-51a448ccf2f0 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:31.865531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5c7cb-00b6-4f45-a637-c16c5894f4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:31.866207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5c7cb-00b6-4f45-a637-c16c5894f4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:31.866492 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5c7cb-00b6-4f45-a637-c16c5894f4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:31.866769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5c7cb-00b6-4f45-a637-c16c5894f4e0 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:31.867504 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5c7cb-00b6-4f45-a637-c16c5894f4e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:31.869444 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5c7cb-00b6-4f45-a637-c16c5894f4e0 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:31.892566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1234/2450] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:13:31 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:13:31.897980 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08e668-8c79-4c72-9b7f-6e0e34813ceb admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:31.909219 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08e668-8c79-4c72-9b7f-6e0e34813ceb admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:31.914078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac08d18-3ffc-4c4d-9081-61c277ad89f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:31.914740 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac08d18-3ffc-4c4d-9081-61c277ad89f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:31.915407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac08d18-3ffc-4c4d-9081-61c277ad89f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:31.915407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac08d18-3ffc-4c4d-9081-61c277ad89f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:31.916027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac08d18-3ffc-4c4d-9081-61c277ad89f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:31.917644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac08d18-3ffc-4c4d-9081-61c277ad89f5 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:31.928344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1217/2451] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:13:31.932545 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5c7cb-00b6-4f45-a637-c16c5894f4e0 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:31.943329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5c7cb-00b6-4f45-a637-c16c5894f4e0 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:31.949096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305a9d4-2296-45a8-b762-7273ec52e621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:31.949992 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305a9d4-2296-45a8-b762-7273ec52e621 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:31.950280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305a9d4-2296-45a8-b762-7273ec52e621 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:31.950563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305a9d4-2296-45a8-b762-7273ec52e621 admin admin] PATH_INFO: `/v3/projects/73bfcc0c715946ac87628215b0f829e9/users/cbd2806e59d64a5e834c6dc0c0a425c5/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:31.965995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305a9d4-2296-45a8-b762-7273ec52e621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bfcc0c715946ac87628215b0f829e9, user_id=cbd2806e59d64a5e834c6dc0c0a425c5, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:31.968765 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305a9d4-2296-45a8-b762-7273ec52e621 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:31.984946 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1235/2452] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:13:31 2022] PUT /identity/v3/projects/73bfcc0c715946ac87628215b0f829e9/users/cbd2806e59d64a5e834c6dc0c0a425c5/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:13:31.989025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac08d18-3ffc-4c4d-9081-61c277ad89f5 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:31.998833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac08d18-3ffc-4c4d-9081-61c277ad89f5 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:32.059859 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21065ac5-103b-487b-a5b5-8081db7e9f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:32.060688 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21065ac5-103b-487b-a5b5-8081db7e9f1e admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:32.061014 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21065ac5-103b-487b-a5b5-8081db7e9f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:32.061302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21065ac5-103b-487b-a5b5-8081db7e9f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:32.062169 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21065ac5-103b-487b-a5b5-8081db7e9f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:32.065081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21065ac5-103b-487b-a5b5-8081db7e9f1e admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:32.076370 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1218/2453] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:13:32.082597 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305a9d4-2296-45a8-b762-7273ec52e621 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:32.093994 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305a9d4-2296-45a8-b762-7273ec52e621 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:32.100193 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602e002-61e4-44de-af0f-d45b41883722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:32.101096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602e002-61e4-44de-af0f-d45b41883722 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:32.101383 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602e002-61e4-44de-af0f-d45b41883722 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:32.101662 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602e002-61e4-44de-af0f-d45b41883722 admin admin] PATH_INFO: `/v3/projects/73bfcc0c715946ac87628215b0f829e9/users/cbd2806e59d64a5e834c6dc0c0a425c5/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:32.103971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602e002-61e4-44de-af0f-d45b41883722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bfcc0c715946ac87628215b0f829e9, user_id=cbd2806e59d64a5e834c6dc0c0a425c5, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:32.106703 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602e002-61e4-44de-af0f-d45b41883722 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:32.118127 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1236/2454] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:13:32 2022] PUT /identity/v3/projects/73bfcc0c715946ac87628215b0f829e9/users/cbd2806e59d64a5e834c6dc0c0a425c5/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:13:32.130338 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dc2c5-e76d-4deb-9018-b6e47f3683b7 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:32.130803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dc2c5-e76d-4deb-9018-b6e47f3683b7 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:32.131235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dc2c5-e76d-4deb-9018-b6e47f3683b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:32.161975 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-666dc2c5-e76d-4deb-9018-b6e47f3683b7 None None] MFA Rules not processed for user `cbd2806e59d64a5e834c6dc0c0a425c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:13:32.163221 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-666dc2c5-e76d-4deb-9018-b6e47f3683b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:13:32.238275 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1219/2455] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:13:32 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:13:41.423998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602e002-61e4-44de-af0f-d45b41883722 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:41.427356 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-2602e002-61e4-44de-af0f-d45b41883722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:13:41.558861 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602e002-61e4-44de-af0f-d45b41883722 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:41.575010 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4eff1-0c76-403f-9352-ada6183a214e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:41.575998 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4eff1-0c76-403f-9352-ada6183a214e service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:41.576347 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4eff1-0c76-403f-9352-ada6183a214e service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:41.576692 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4eff1-0c76-403f-9352-ada6183a214e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:41.579417 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-6fc4eff1-0c76-403f-9352-ada6183a214e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:13:41.602890 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4eff1-0c76-403f-9352-ada6183a214e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:41.604808 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4eff1-0c76-403f-9352-ada6183a214e service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:41.624155 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1237/2456] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:13:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:13:42.395693 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666dc2c5-e76d-4deb-9018-b6e47f3683b7 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:42.397217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-666dc2c5-e76d-4deb-9018-b6e47f3683b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:13:42.413466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666dc2c5-e76d-4deb-9018-b6e47f3683b7 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:42.422053 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f99a4-6036-42b6-a7cd-9aa4e2395efd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:42.422824 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f99a4-6036-42b6-a7cd-9aa4e2395efd service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:42.423222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f99a4-6036-42b6-a7cd-9aa4e2395efd service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:42.423568 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f99a4-6036-42b6-a7cd-9aa4e2395efd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:42.425889 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-733f99a4-6036-42b6-a7cd-9aa4e2395efd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:13:42.486317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f99a4-6036-42b6-a7cd-9aa4e2395efd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:42.488488 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f99a4-6036-42b6-a7cd-9aa4e2395efd service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:42.499293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1220/2457] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:13:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:13:42.530664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4eff1-0c76-403f-9352-ada6183a214e service nova] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:42.543373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4eff1-0c76-403f-9352-ada6183a214e service nova] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:42.549741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a8048-0629-4110-913f-65d669600dcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:42.550498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a8048-0629-4110-913f-65d669600dcb service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:42.550853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a8048-0629-4110-913f-65d669600dcb service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:42.551226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a8048-0629-4110-913f-65d669600dcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:42.553355 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-894a8048-0629-4110-913f-65d669600dcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:13:42.642285 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a8048-0629-4110-913f-65d669600dcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:42.644121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a8048-0629-4110-913f-65d669600dcb service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:42.653106 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1238/2458] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:13:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:13:44.780392 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f99a4-6036-42b6-a7cd-9aa4e2395efd service nova] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:13:44.782902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-733f99a4-6036-42b6-a7cd-9aa4e2395efd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:13:44.865520 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f99a4-6036-42b6-a7cd-9aa4e2395efd service nova] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:13:44.869370 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406176c-d2af-479d-ac0d-07fcf4fb3176 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:13:44.870049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406176c-d2af-479d-ac0d-07fcf4fb3176 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:44.870341 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406176c-d2af-479d-ac0d-07fcf4fb3176 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:44.870617 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406176c-d2af-479d-ac0d-07fcf4fb3176 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:44.872467 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-3406176c-d2af-479d-ac0d-07fcf4fb3176 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:13:44.951098 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406176c-d2af-479d-ac0d-07fcf4fb3176 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:13:44.952565 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406176c-d2af-479d-ac0d-07fcf4fb3176 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:13:44.962275 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1221/2459] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:13:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:13:45.240120 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0df71b-e38d-444e-8d89-e3c68ac16f85 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:13:45.240623 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0df71b-e38d-444e-8d89-e3c68ac16f85 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:13:45.240754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0df71b-e38d-444e-8d89-e3c68ac16f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:13:45.258529 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-cb0df71b-e38d-444e-8d89-e3c68ac16f85 None None] MFA Rules not processed for user `0196716439d4473498c7c4b15a1e1d24`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:13:45.259763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-cb0df71b-e38d-444e-8d89-e3c68ac16f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:13:45.267069 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1239/2460] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:13:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:14:27.564702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406176c-d2af-479d-ac0d-07fcf4fb3176 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:14:27.566402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-3406176c-d2af-479d-ac0d-07fcf4fb3176 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:14:27.578325 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406176c-d2af-479d-ac0d-07fcf4fb3176 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:14:27.582685 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e04fc-22b5-4e1b-a1b8-1c41f6664513 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:14:27.583386 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e04fc-22b5-4e1b-a1b8-1c41f6664513 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:14:27.583673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e04fc-22b5-4e1b-a1b8-1c41f6664513 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:14:27.583952 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e04fc-22b5-4e1b-a1b8-1c41f6664513 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:14:27.586886 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c98e04fc-22b5-4e1b-a1b8-1c41f6664513 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:14:27.600050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-c98e04fc-22b5-4e1b-a1b8-1c41f6664513 service cinder] Could not find project: a6d9d653ad51401a977b0bcb1dec3896.: keystone.exception.ProjectNotFound: Could not find project: a6d9d653ad51401a977b0bcb1dec3896. May 04 22:14:27.600050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 22:14:27.600050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 22:14:27.600050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 22:14:27.600050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 22:14:27.600050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 22:14:27.600050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 22:14:27.600050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 22:14:27.600050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 22:14:27.600050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 22:14:27.600050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 22:14:27.600050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 22:14:27.600050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get May 04 22:14:27.600050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') May 04 22:14:27.600050 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 04 22:14:27.601290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 04 22:14:27.601290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 04 22:14:27.601290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 04 22:14:27.601290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 22:14:27.601290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 22:14:27.601290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token May 04 22:14:27.601290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application token = self._validate_token(token_id) May 04 22:14:27.601290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 22:14:27.601290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 22:14:27.601290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 22:14:27.601290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 22:14:27.601290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 22:14:27.601290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 22:14:27.601290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 22:14:27.601290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 22:14:27.601290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 22:14:27.601290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 22:14:27.602581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 22:14:27.602581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 22:14:27.602581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 22:14:27.602581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 22:14:27.602581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token May 04 22:14:27.602581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) May 04 22:14:27.602581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint May 04 22:14:27.602581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._validate_token_resources() May 04 22:14:27.602581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources May 04 22:14:27.602581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): May 04 22:14:27.602581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project May 04 22:14:27.602581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( May 04 22:14:27.602581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 22:14:27.602581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 22:14:27.602581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 22:14:27.602581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 22:14:27.602581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 22:14:27.603870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 22:14:27.603870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 22:14:27.603870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 22:14:27.603870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 22:14:27.603870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 22:14:27.603870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 22:14:27.603870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 22:14:27.603870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 22:14:27.603870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 22:14:27.603870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 22:14:27.603870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 22:14:27.603870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 22:14:27.603870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 22:14:27.603870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 22:14:27.603870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 22:14:27.603870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 22:14:27.603870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 22:14:27.605128 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a6d9d653ad51401a977b0bcb1dec3896. May 04 22:14:27.605128 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 22:14:27.605128 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1222/2461] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:14:27 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 04 22:14:28.034390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0d897-0331-4f13-aff2-ce822919cb42 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:14:28.035401 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0d897-0331-4f13-aff2-ce822919cb42 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:14:28.035844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0d897-0331-4f13-aff2-ce822919cb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:14:28.088674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e04fc-22b5-4e1b-a1b8-1c41f6664513 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:14:28.097576 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e04fc-22b5-4e1b-a1b8-1c41f6664513 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:14:28.102104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99427d-9332-4973-a0a3-9d919c3cb185 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:14:28.102443 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-70e0d897-0331-4f13-aff2-ce822919cb42 None None] MFA Rules not processed for user `82b2e79995f94ab880f5d798ddd649b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:14:28.103264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99427d-9332-4973-a0a3-9d919c3cb185 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:14:28.103891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99427d-9332-4973-a0a3-9d919c3cb185 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:14:28.104017 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-70e0d897-0331-4f13-aff2-ce822919cb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:14:28.104372 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99427d-9332-4973-a0a3-9d919c3cb185 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:14:28.115074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99427d-9332-4973-a0a3-9d919c3cb185 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:14:28.116657 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99427d-9332-4973-a0a3-9d919c3cb185 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:14:28.129376 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1223/2462] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:14:28 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:14:28.175833 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1240/2463] 10.222.0.11 () {58 vars in 967 bytes} [Wed May 4 22:14:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:14:28.226222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99427d-9332-4973-a0a3-9d919c3cb185 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:14:28.227691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-fd99427d-9332-4973-a0a3-9d919c3cb185 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:14:28.330314 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99427d-9332-4973-a0a3-9d919c3cb185 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:14:28.336887 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af68c1-7cd1-4378-a6f0-7e607c4f95e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8358da535a104873ad9f5676989a9e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:14:28.337544 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af68c1-7cd1-4378-a6f0-7e607c4f95e8 service swift] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:14:28.337828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af68c1-7cd1-4378-a6f0-7e607c4f95e8 service swift] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:14:28.338101 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af68c1-7cd1-4378-a6f0-7e607c4f95e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:14:28.347206 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af68c1-7cd1-4378-a6f0-7e607c4f95e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:14:28.348815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af68c1-7cd1-4378-a6f0-7e607c4f95e8 service swift] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:14:28.357644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1224/2464] 10.222.0.11 () {60 vars in 1384 bytes} [Wed May 4 22:14:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 22:14:28.844695 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0d897-0331-4f13-aff2-ce822919cb42 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:14:28.846417 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-70e0d897-0331-4f13-aff2-ce822919cb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:14:28.903704 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0d897-0331-4f13-aff2-ce822919cb42 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:14:28.908769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92aab63-465e-4610-8a8a-5dc279958423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:14:28.909422 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92aab63-465e-4610-8a8a-5dc279958423 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:14:28.909706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92aab63-465e-4610-8a8a-5dc279958423 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:14:28.909977 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92aab63-465e-4610-8a8a-5dc279958423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:14:28.912030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c92aab63-465e-4610-8a8a-5dc279958423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:14:28.972619 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92aab63-465e-4610-8a8a-5dc279958423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:14:28.973978 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92aab63-465e-4610-8a8a-5dc279958423 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:14:28.983579 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1241/2465] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:14:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:14:35.718513 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af68c1-7cd1-4378-a6f0-7e607c4f95e8 service swift] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:14:35.720052 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-02af68c1-7cd1-4378-a6f0-7e607c4f95e8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:14:35.738802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af68c1-7cd1-4378-a6f0-7e607c4f95e8 service swift] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:14:35.743911 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b889390-1580-40c7-ad67-64fa39fdb1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:14:35.744796 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b889390-1580-40c7-ad67-64fa39fdb1d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:14:35.745109 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b889390-1580-40c7-ad67-64fa39fdb1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:14:35.745378 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b889390-1580-40c7-ad67-64fa39fdb1d5 admin admin] PATH_INFO: `/v3/users/620b3bc722474b14b933c6c8ce20dafe` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:14:35.760204 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b889390-1580-40c7-ad67-64fa39fdb1d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=620b3bc722474b14b933c6c8ce20dafe)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:14:35.762148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b889390-1580-40c7-ad67-64fa39fdb1d5 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:14:35.811140 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0b889390-1580-40c7-ad67-64fa39fdb1d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '620b3bc722474b14b933c6c8ce20dafe'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:14:35.819948 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0b889390-1580-40c7-ad67-64fa39fdb1d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '620b3bc722474b14b933c6c8ce20dafe'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:14:35.827250 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0b889390-1580-40c7-ad67-64fa39fdb1d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '620b3bc722474b14b933c6c8ce20dafe'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:14:35.828033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0b889390-1580-40c7-ad67-64fa39fdb1d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '620b3bc722474b14b933c6c8ce20dafe'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:14:35.828709 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0b889390-1580-40c7-ad67-64fa39fdb1d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '620b3bc722474b14b933c6c8ce20dafe'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:14:35.848593 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1225/2466] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:14:35 2022] DELETE /identity/v3/users/620b3bc722474b14b933c6c8ce20dafe => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:14:36.025574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92aab63-465e-4610-8a8a-5dc279958423 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:14:36.037184 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92aab63-465e-4610-8a8a-5dc279958423 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:14:36.094312 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13d763-6b2d-4962-95de-ca62725c8282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:14:36.095104 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13d763-6b2d-4962-95de-ca62725c8282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:14:36.095388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13d763-6b2d-4962-95de-ca62725c8282 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:14:36.095663 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13d763-6b2d-4962-95de-ca62725c8282 admin admin] PATH_INFO: `/v3/projects/df1112183d9b427aab35174082d08212` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:14:36.096830 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13d763-6b2d-4962-95de-ca62725c8282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df1112183d9b427aab35174082d08212)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:14:36.098831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13d763-6b2d-4962-95de-ca62725c8282 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:14:36.148878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-bd13d763-6b2d-4962-95de-ca62725c8282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df1112183d9b427aab35174082d08212', 'request_id': 'req-bd13d763-6b2d-4962-95de-ca62725c8282'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:14:36.158021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-bd13d763-6b2d-4962-95de-ca62725c8282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df1112183d9b427aab35174082d08212', 'request_id': 'req-bd13d763-6b2d-4962-95de-ca62725c8282'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:14:36.164290 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-bd13d763-6b2d-4962-95de-ca62725c8282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df1112183d9b427aab35174082d08212', 'request_id': 'req-bd13d763-6b2d-4962-95de-ca62725c8282'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:14:36.174501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-bd13d763-6b2d-4962-95de-ca62725c8282 admin admin] The token cache is being invalidate because project df1112183d9b427aab35174082d08212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:14:36.174787 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-bd13d763-6b2d-4962-95de-ca62725c8282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:14:36.175474 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-bd13d763-6b2d-4962-95de-ca62725c8282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:14:36.177086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1242/2467] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:14:36 2022] DELETE /identity/v3/projects/df1112183d9b427aab35174082d08212 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:14:36.181242 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b889390-1580-40c7-ad67-64fa39fdb1d5 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:14:36.182753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-0b889390-1580-40c7-ad67-64fa39fdb1d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:14:36.196163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b889390-1580-40c7-ad67-64fa39fdb1d5 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:14:36.262436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673deaeb-f6df-499f-ac8a-9024524fe8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:14:36.263393 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673deaeb-f6df-499f-ac8a-9024524fe8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:14:36.263673 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673deaeb-f6df-499f-ac8a-9024524fe8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:14:36.263940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673deaeb-f6df-499f-ac8a-9024524fe8c2 admin admin] PATH_INFO: `/v3/users/3552097ba0194960a6ab9a1a94736077` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:14:36.277454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673deaeb-f6df-499f-ac8a-9024524fe8c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3552097ba0194960a6ab9a1a94736077)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:14:36.279769 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673deaeb-f6df-499f-ac8a-9024524fe8c2 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:14:36.332299 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-673deaeb-f6df-499f-ac8a-9024524fe8c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3552097ba0194960a6ab9a1a94736077'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:14:36.340841 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-673deaeb-f6df-499f-ac8a-9024524fe8c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3552097ba0194960a6ab9a1a94736077'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:14:36.347936 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-673deaeb-f6df-499f-ac8a-9024524fe8c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3552097ba0194960a6ab9a1a94736077'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:14:36.348567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-673deaeb-f6df-499f-ac8a-9024524fe8c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3552097ba0194960a6ab9a1a94736077'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:14:36.349191 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-673deaeb-f6df-499f-ac8a-9024524fe8c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3552097ba0194960a6ab9a1a94736077'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:14:36.366266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1226/2468] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:14:36 2022] DELETE /identity/v3/users/3552097ba0194960a6ab9a1a94736077 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:14:36.550870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13d763-6b2d-4962-95de-ca62725c8282 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:14:36.552417 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-bd13d763-6b2d-4962-95de-ca62725c8282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:14:36.565126 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13d763-6b2d-4962-95de-ca62725c8282 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:14:36.624102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295cf81-a0fd-4d06-b137-30b84943e57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:14:36.625104 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295cf81-a0fd-4d06-b137-30b84943e57b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:14:36.625361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295cf81-a0fd-4d06-b137-30b84943e57b admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:14:36.625725 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295cf81-a0fd-4d06-b137-30b84943e57b admin admin] PATH_INFO: `/v3/projects/311eafe6fcb74845af20139a0cf26d2b` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:14:36.636618 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295cf81-a0fd-4d06-b137-30b84943e57b admin admin] RBAC: Authorizing `identity:delete_project(project_id=311eafe6fcb74845af20139a0cf26d2b)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:14:36.638561 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295cf81-a0fd-4d06-b137-30b84943e57b admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:14:36.687340 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-7295cf81-a0fd-4d06-b137-30b84943e57b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '311eafe6fcb74845af20139a0cf26d2b', 'request_id': 'req-7295cf81-a0fd-4d06-b137-30b84943e57b'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:14:36.696627 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-7295cf81-a0fd-4d06-b137-30b84943e57b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '311eafe6fcb74845af20139a0cf26d2b', 'request_id': 'req-7295cf81-a0fd-4d06-b137-30b84943e57b'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:14:36.703517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-7295cf81-a0fd-4d06-b137-30b84943e57b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '311eafe6fcb74845af20139a0cf26d2b', 'request_id': 'req-7295cf81-a0fd-4d06-b137-30b84943e57b'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:14:36.713580 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-7295cf81-a0fd-4d06-b137-30b84943e57b admin admin] The token cache is being invalidate because project 311eafe6fcb74845af20139a0cf26d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:14:36.713864 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-7295cf81-a0fd-4d06-b137-30b84943e57b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:14:36.714507 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-7295cf81-a0fd-4d06-b137-30b84943e57b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:14:36.716121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1243/2469] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:14:36 2022] DELETE /identity/v3/projects/311eafe6fcb74845af20139a0cf26d2b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:15:55.217757 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673deaeb-f6df-499f-ac8a-9024524fe8c2 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:15:55.219435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-673deaeb-f6df-499f-ac8a-9024524fe8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:15:55.293617 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673deaeb-f6df-499f-ac8a-9024524fe8c2 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:15:55.372560 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9330e3-5ca8-48ca-bc64-dc73f2f0498d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e203d7077af54930a640b2334a1d8fa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:15:55.373319 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9330e3-5ca8-48ca-bc64-dc73f2f0498d service placement] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:15:55.373604 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9330e3-5ca8-48ca-bc64-dc73f2f0498d service placement] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:15:55.373884 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9330e3-5ca8-48ca-bc64-dc73f2f0498d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:15:55.375767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-7d9330e3-5ca8-48ca-bc64-dc73f2f0498d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:15:55.387584 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9330e3-5ca8-48ca-bc64-dc73f2f0498d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:15:55.389414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9330e3-5ca8-48ca-bc64-dc73f2f0498d service placement] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:15:55.399258 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1227/2470] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:15:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:16:28.244237 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295cf81-a0fd-4d06-b137-30b84943e57b admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:16:28.246322 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-7295cf81-a0fd-4d06-b137-30b84943e57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:16:28.314995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295cf81-a0fd-4d06-b137-30b84943e57b admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:16:28.320023 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cd1f6-a35d-4ea2-a65f-5bf828d72fdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:16:28.320675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cd1f6-a35d-4ea2-a65f-5bf828d72fdf service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:16:28.320991 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cd1f6-a35d-4ea2-a65f-5bf828d72fdf service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:16:28.321268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cd1f6-a35d-4ea2-a65f-5bf828d72fdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:16:28.323288 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-1d7cd1f6-a35d-4ea2-a65f-5bf828d72fdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:16:28.392244 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7cd1f6-a35d-4ea2-a65f-5bf828d72fdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:16:28.393680 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7cd1f6-a35d-4ea2-a65f-5bf828d72fdf service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:16:28.402509 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1244/2471] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:16:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:16:28.659286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9330e3-5ca8-48ca-bc64-dc73f2f0498d service placement] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:16:28.668926 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9330e3-5ca8-48ca-bc64-dc73f2f0498d service placement] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:16:28.673367 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8d90d-cfd8-45aa-b70f-d893d1eef7d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:16:28.674220 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8d90d-cfd8-45aa-b70f-d893d1eef7d2 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:16:28.674408 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8d90d-cfd8-45aa-b70f-d893d1eef7d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:16:28.674688 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8d90d-cfd8-45aa-b70f-d893d1eef7d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:16:28.677238 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-92f8d90d-cfd8-45aa-b70f-d893d1eef7d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:16:28.734742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8d90d-cfd8-45aa-b70f-d893d1eef7d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:16:28.736208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8d90d-cfd8-45aa-b70f-d893d1eef7d2 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:16:28.744830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1228/2472] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:16:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:17:55.925042 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cd1f6-a35d-4ea2-a65f-5bf828d72fdf service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:17:55.926754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-1d7cd1f6-a35d-4ea2-a65f-5bf828d72fdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:17:55.996425 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cd1f6-a35d-4ea2-a65f-5bf828d72fdf service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:17:56.000644 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da3a28-f0ce-4822-8302-a9472223181f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:17:56.001304 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da3a28-f0ce-4822-8302-a9472223181f service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:17:56.001587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da3a28-f0ce-4822-8302-a9472223181f service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:17:56.001858 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da3a28-f0ce-4822-8302-a9472223181f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:17:56.003983 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-13da3a28-f0ce-4822-8302-a9472223181f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:17:56.014277 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da3a28-f0ce-4822-8302-a9472223181f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:17:56.015755 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da3a28-f0ce-4822-8302-a9472223181f service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:17:56.024044 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1245/2473] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:17:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:18:29.653496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8d90d-cfd8-45aa-b70f-d893d1eef7d2 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:18:29.663375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8d90d-cfd8-45aa-b70f-d893d1eef7d2 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:18:29.668532 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509ea7a-0b2e-43f4-b5fb-7b88c2a15533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:18:29.669173 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509ea7a-0b2e-43f4-b5fb-7b88c2a15533 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:18:29.669465 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509ea7a-0b2e-43f4-b5fb-7b88c2a15533 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:18:29.669738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509ea7a-0b2e-43f4-b5fb-7b88c2a15533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:18:29.672192 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-5509ea7a-0b2e-43f4-b5fb-7b88c2a15533 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:18:29.744610 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509ea7a-0b2e-43f4-b5fb-7b88c2a15533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:18:29.746033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509ea7a-0b2e-43f4-b5fb-7b88c2a15533 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:18:29.755096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1229/2474] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:18:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:19:45.242684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da3a28-f0ce-4822-8302-a9472223181f service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:19:45.244323 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-13da3a28-f0ce-4822-8302-a9472223181f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:19:45.256822 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da3a28-f0ce-4822-8302-a9472223181f service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:19:45.261468 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabddb7-6f9a-4b13-b96a-59c4183ba595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:19:45.262125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabddb7-6f9a-4b13-b96a-59c4183ba595 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:19:45.262400 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabddb7-6f9a-4b13-b96a-59c4183ba595 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:19:45.262681 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabddb7-6f9a-4b13-b96a-59c4183ba595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:19:45.264651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-efabddb7-6f9a-4b13-b96a-59c4183ba595 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:19:45.336776 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabddb7-6f9a-4b13-b96a-59c4183ba595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:19:45.338224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabddb7-6f9a-4b13-b96a-59c4183ba595 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:19:45.356776 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1246/2475] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:19:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:19:45.405330 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509ea7a-0b2e-43f4-b5fb-7b88c2a15533 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:19:45.416340 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509ea7a-0b2e-43f4-b5fb-7b88c2a15533 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:19:45.422833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513edfa9-538b-417d-a467-3abd91b76e6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:19:45.423756 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513edfa9-538b-417d-a467-3abd91b76e6e service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:19:45.424061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513edfa9-538b-417d-a467-3abd91b76e6e service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:19:45.424429 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513edfa9-538b-417d-a467-3abd91b76e6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:19:45.427424 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-513edfa9-538b-417d-a467-3abd91b76e6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:19:45.493712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513edfa9-538b-417d-a467-3abd91b76e6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:19:45.495426 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513edfa9-538b-417d-a467-3abd91b76e6e service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:19:45.504969 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1230/2476] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:19:45 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:20:30.098829 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabddb7-6f9a-4b13-b96a-59c4183ba595 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:30.127000 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabddb7-6f9a-4b13-b96a-59c4183ba595 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:30.131840 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089330b-2d46-45ba-bcdd-9a9cd9001017 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:30.132562 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089330b-2d46-45ba-bcdd-9a9cd9001017 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:30.132844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089330b-2d46-45ba-bcdd-9a9cd9001017 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:30.133122 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089330b-2d46-45ba-bcdd-9a9cd9001017 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:30.135220 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-0089330b-2d46-45ba-bcdd-9a9cd9001017 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:20:30.204449 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089330b-2d46-45ba-bcdd-9a9cd9001017 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:30.206228 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089330b-2d46-45ba-bcdd-9a9cd9001017 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:30.224077 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1247/2477] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:20:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:20:30.465319 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513edfa9-538b-417d-a467-3abd91b76e6e service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:30.492976 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513edfa9-538b-417d-a467-3abd91b76e6e service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:30.497626 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc3464-6c86-4128-a424-4cc389960d8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:30.498274 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc3464-6c86-4128-a424-4cc389960d8d service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:30.498564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc3464-6c86-4128-a424-4cc389960d8d service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:30.498846 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc3464-6c86-4128-a424-4cc389960d8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:30.501084 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-7ecc3464-6c86-4128-a424-4cc389960d8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:20:30.513511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application [None req-7ecc3464-6c86-4128-a424-4cc389960d8d service cinder] Could not find project: df1112183d9b427aab35174082d08212.: keystone.exception.ProjectNotFound: Could not find project: df1112183d9b427aab35174082d08212. May 04 22:20:30.513511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 22:20:30.513511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 22:20:30.513511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 22:20:30.513511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 22:20:30.513511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 22:20:30.513511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 22:20:30.513511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 22:20:30.513511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 22:20:30.513511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 22:20:30.513511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 22:20:30.513511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 22:20:30.513511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get May 04 22:20:30.513511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') May 04 22:20:30.513511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 04 22:20:30.514681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 04 22:20:30.514681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 04 22:20:30.514681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 04 22:20:30.514681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 22:20:30.514681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 22:20:30.514681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token May 04 22:20:30.514681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application token = self._validate_token(token_id) May 04 22:20:30.514681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 22:20:30.514681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 22:20:30.514681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 22:20:30.514681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 22:20:30.514681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 22:20:30.514681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 22:20:30.514681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 22:20:30.514681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 22:20:30.514681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 22:20:30.514681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 22:20:30.516368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 22:20:30.516368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 22:20:30.516368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 22:20:30.516368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 22:20:30.516368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token May 04 22:20:30.516368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) May 04 22:20:30.516368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint May 04 22:20:30.516368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self._validate_token_resources() May 04 22:20:30.516368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources May 04 22:20:30.516368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): May 04 22:20:30.516368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project May 04 22:20:30.516368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( May 04 22:20:30.516368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 22:20:30.516368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 22:20:30.516368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 22:20:30.516368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 22:20:30.516368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 22:20:30.517612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.get_or_create( May 04 22:20:30.517612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 22:20:30.517612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application with Lock( May 04 22:20:30.517612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 22:20:30.517612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._enter() May 04 22:20:30.517612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 22:20:30.517612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 22:20:30.517612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 22:20:30.517612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.creator() May 04 22:20:30.517612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 22:20:30.517612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application created_value = creator( May 04 22:20:30.517612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 22:20:30.517612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 22:20:30.517612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 22:20:30.517612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 22:20:30.517612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 22:20:30.517612 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 22:20:30.519619 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: df1112183d9b427aab35174082d08212. May 04 22:20:30.519619 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: ERROR keystone.server.flask.application May 04 22:20:30.519619 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1231/2478] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:20:30 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 04 22:20:30.700762 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089330b-2d46-45ba-bcdd-9a9cd9001017 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:30.709477 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-0089330b-2d46-45ba-bcdd-9a9cd9001017 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:20:30.801774 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089330b-2d46-45ba-bcdd-9a9cd9001017 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:30.806763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1561c-6cce-49c6-9bd0-a75387bd91d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:30.807684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1561c-6cce-49c6-9bd0-a75387bd91d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:30.807971 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1561c-6cce-49c6-9bd0-a75387bd91d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:30.808250 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1561c-6cce-49c6-9bd0-a75387bd91d8 admin admin] PATH_INFO: `/v3/users/51b3208b05844f4980a2ea03f035b6e2` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:30.809456 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1561c-6cce-49c6-9bd0-a75387bd91d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51b3208b05844f4980a2ea03f035b6e2)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:30.811451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1561c-6cce-49c6-9bd0-a75387bd91d8 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:30.833758 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc3464-6c86-4128-a424-4cc389960d8d service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:30.836012 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-7ecc3464-6c86-4128-a424-4cc389960d8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:20:30.850703 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc3464-6c86-4128-a424-4cc389960d8d service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:30.854813 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae99019-52aa-4b30-81e3-54617888838e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:30.855916 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae99019-52aa-4b30-81e3-54617888838e service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:30.856171 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae99019-52aa-4b30-81e3-54617888838e service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:30.856632 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae99019-52aa-4b30-81e3-54617888838e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:30.859293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-4ae99019-52aa-4b30-81e3-54617888838e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:20:30.870866 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a2b1561c-6cce-49c6-9bd0-a75387bd91d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b3208b05844f4980a2ea03f035b6e2'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:20:30.884026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a2b1561c-6cce-49c6-9bd0-a75387bd91d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b3208b05844f4980a2ea03f035b6e2'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:20:30.885093 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a2b1561c-6cce-49c6-9bd0-a75387bd91d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b3208b05844f4980a2ea03f035b6e2'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:20:30.898185 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a2b1561c-6cce-49c6-9bd0-a75387bd91d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b3208b05844f4980a2ea03f035b6e2'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:20:30.908710 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a2b1561c-6cce-49c6-9bd0-a75387bd91d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b3208b05844f4980a2ea03f035b6e2'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:20:30.918567 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1248/2479] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:20:30 2022] DELETE /identity/v3/users/51b3208b05844f4980a2ea03f035b6e2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:20:30.923268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3e962-fdfa-4231-a859-e78e59250ba4 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:30.923605 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3e962-fdfa-4231-a859-e78e59250ba4 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:30.923894 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3e962-fdfa-4231-a859-e78e59250ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:30.943577 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-81a3e962-fdfa-4231-a859-e78e59250ba4 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:20:30.944825 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-81a3e962-fdfa-4231-a859-e78e59250ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:20:30.959827 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae99019-52aa-4b30-81e3-54617888838e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:30.961407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae99019-52aa-4b30-81e3-54617888838e service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:30.974966 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1232/2480] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:20:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:20:30.976041 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae99019-52aa-4b30-81e3-54617888838e service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:30.984373 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae99019-52aa-4b30-81e3-54617888838e service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:31.010660 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1249/2481] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:20:31.022453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3e962-fdfa-4231-a859-e78e59250ba4 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:31.027495 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-81a3e962-fdfa-4231-a859-e78e59250ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:20:31.046847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436ae5d-c355-4405-840b-74bf85d77285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:31.047533 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436ae5d-c355-4405-840b-74bf85d77285 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:31.047817 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436ae5d-c355-4405-840b-74bf85d77285 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:31.048094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436ae5d-c355-4405-840b-74bf85d77285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:31.049966 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a436ae5d-c355-4405-840b-74bf85d77285 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:20:31.084422 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3e962-fdfa-4231-a859-e78e59250ba4 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:31.089053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce85b1-4382-4dd6-98fd-8bd322baef12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:31.089706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce85b1-4382-4dd6-98fd-8bd322baef12 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:31.089987 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce85b1-4382-4dd6-98fd-8bd322baef12 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:31.090260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce85b1-4382-4dd6-98fd-8bd322baef12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:31.099637 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce85b1-4382-4dd6-98fd-8bd322baef12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:31.101148 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce85b1-4382-4dd6-98fd-8bd322baef12 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:31.110491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1250/2482] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:20:31.119984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436ae5d-c355-4405-840b-74bf85d77285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:31.121482 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436ae5d-c355-4405-840b-74bf85d77285 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:31.132583 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1233/2483] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:20:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:20:31.466043 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce85b1-4382-4dd6-98fd-8bd322baef12 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:31.467642 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a9ce85b1-4382-4dd6-98fd-8bd322baef12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:20:31.480992 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce85b1-4382-4dd6-98fd-8bd322baef12 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:31.486003 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e81d4a-eb00-41c2-a4c4-a806e6bb1ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:31.486886 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e81d4a-eb00-41c2-a4c4-a806e6bb1ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:31.487214 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e81d4a-eb00-41c2-a4c4-a806e6bb1ead admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:31.487712 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e81d4a-eb00-41c2-a4c4-a806e6bb1ead admin admin] PATH_INFO: `/v3/projects/8ecfd446c5794230b9c74c30098c36ba` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:31.489011 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e81d4a-eb00-41c2-a4c4-a806e6bb1ead admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ecfd446c5794230b9c74c30098c36ba)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:31.491282 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e81d4a-eb00-41c2-a4c4-a806e6bb1ead admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:31.539542 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d3e81d4a-eb00-41c2-a4c4-a806e6bb1ead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ecfd446c5794230b9c74c30098c36ba', 'request_id': 'req-d3e81d4a-eb00-41c2-a4c4-a806e6bb1ead'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:20:31.548930 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d3e81d4a-eb00-41c2-a4c4-a806e6bb1ead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ecfd446c5794230b9c74c30098c36ba', 'request_id': 'req-d3e81d4a-eb00-41c2-a4c4-a806e6bb1ead'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:20:31.555446 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d3e81d4a-eb00-41c2-a4c4-a806e6bb1ead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ecfd446c5794230b9c74c30098c36ba', 'request_id': 'req-d3e81d4a-eb00-41c2-a4c4-a806e6bb1ead'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:20:31.565251 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d3e81d4a-eb00-41c2-a4c4-a806e6bb1ead admin admin] The token cache is being invalidate because project 8ecfd446c5794230b9c74c30098c36ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:20:31.565515 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d3e81d4a-eb00-41c2-a4c4-a806e6bb1ead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:20:31.566195 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d3e81d4a-eb00-41c2-a4c4-a806e6bb1ead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:20:31.567992 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1251/2484] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:20:31 2022] DELETE /identity/v3/projects/8ecfd446c5794230b9c74c30098c36ba => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:20:31.572072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436ae5d-c355-4405-840b-74bf85d77285 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:31.582811 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436ae5d-c355-4405-840b-74bf85d77285 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:31.648524 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeeb2eb-25c7-4808-b1b1-326aab920ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:31.649434 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeb2eb-25c7-4808-b1b1-326aab920ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:31.649697 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeb2eb-25c7-4808-b1b1-326aab920ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:31.649972 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeb2eb-25c7-4808-b1b1-326aab920ce3 admin admin] PATH_INFO: `/v3/users/cbd2806e59d64a5e834c6dc0c0a425c5` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:31.651210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeeb2eb-25c7-4808-b1b1-326aab920ce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbd2806e59d64a5e834c6dc0c0a425c5)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:31.653144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeeb2eb-25c7-4808-b1b1-326aab920ce3 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:31.702406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-deeeb2eb-25c7-4808-b1b1-326aab920ce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbd2806e59d64a5e834c6dc0c0a425c5'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:20:31.711408 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-deeeb2eb-25c7-4808-b1b1-326aab920ce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbd2806e59d64a5e834c6dc0c0a425c5'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:20:31.718493 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-deeeb2eb-25c7-4808-b1b1-326aab920ce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbd2806e59d64a5e834c6dc0c0a425c5'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:20:31.719173 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-deeeb2eb-25c7-4808-b1b1-326aab920ce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbd2806e59d64a5e834c6dc0c0a425c5'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:20:31.719802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-deeeb2eb-25c7-4808-b1b1-326aab920ce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbd2806e59d64a5e834c6dc0c0a425c5'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:20:31.740671 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1234/2485] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:20:31 2022] DELETE /identity/v3/users/cbd2806e59d64a5e834c6dc0c0a425c5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:20:32.023585 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e81d4a-eb00-41c2-a4c4-a806e6bb1ead admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:32.025052 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-d3e81d4a-eb00-41c2-a4c4-a806e6bb1ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:20:32.039187 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e81d4a-eb00-41c2-a4c4-a806e6bb1ead admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:32.106852 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773b03f-55dc-4983-814a-6c6cbfc05ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:32.107768 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773b03f-55dc-4983-814a-6c6cbfc05ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:32.108063 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773b03f-55dc-4983-814a-6c6cbfc05ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:32.108314 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773b03f-55dc-4983-814a-6c6cbfc05ecf admin admin] PATH_INFO: `/v3/projects/73bfcc0c715946ac87628215b0f829e9` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:32.110131 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773b03f-55dc-4983-814a-6c6cbfc05ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=73bfcc0c715946ac87628215b0f829e9)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:32.112100 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773b03f-55dc-4983-814a-6c6cbfc05ecf admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:32.160952 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4773b03f-55dc-4983-814a-6c6cbfc05ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73bfcc0c715946ac87628215b0f829e9', 'request_id': 'req-4773b03f-55dc-4983-814a-6c6cbfc05ecf'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:20:32.170276 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4773b03f-55dc-4983-814a-6c6cbfc05ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73bfcc0c715946ac87628215b0f829e9', 'request_id': 'req-4773b03f-55dc-4983-814a-6c6cbfc05ecf'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:20:32.176827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4773b03f-55dc-4983-814a-6c6cbfc05ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73bfcc0c715946ac87628215b0f829e9', 'request_id': 'req-4773b03f-55dc-4983-814a-6c6cbfc05ecf'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:20:32.187833 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4773b03f-55dc-4983-814a-6c6cbfc05ecf admin admin] The token cache is being invalidate because project 73bfcc0c715946ac87628215b0f829e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:20:32.188149 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4773b03f-55dc-4983-814a-6c6cbfc05ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:20:32.188855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4773b03f-55dc-4983-814a-6c6cbfc05ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:20:32.190473 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1252/2486] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:20:32 2022] DELETE /identity/v3/projects/73bfcc0c715946ac87628215b0f829e9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:20:32.196981 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ccc81-5767-4f8f-8389-eadaf5abfa2a None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:32.197350 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ccc81-5767-4f8f-8389-eadaf5abfa2a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:32.197700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ccc81-5767-4f8f-8389-eadaf5abfa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:32.216782 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-842ccc81-5767-4f8f-8389-eadaf5abfa2a None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:20:32.217986 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-842ccc81-5767-4f8f-8389-eadaf5abfa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:20:32.281194 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1235/2487] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:20:32.289354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ec94e-b7af-4e60-abff-08e73700c614 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:32.289645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ec94e-b7af-4e60-abff-08e73700c614 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:32.289924 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ec94e-b7af-4e60-abff-08e73700c614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:32.309800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-4a0ec94e-b7af-4e60-abff-08e73700c614 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:20:32.311937 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-4a0ec94e-b7af-4e60-abff-08e73700c614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:20:32.323707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1253/2488] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:20:32.326216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ccc81-5767-4f8f-8389-eadaf5abfa2a None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:32.336338 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ccc81-5767-4f8f-8389-eadaf5abfa2a None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:32.341138 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108432f-b6ad-4cb2-81d4-c33078fbf6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:32.341799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108432f-b6ad-4cb2-81d4-c33078fbf6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:32.342067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108432f-b6ad-4cb2-81d4-c33078fbf6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:32.342339 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108432f-b6ad-4cb2-81d4-c33078fbf6c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:32.343080 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108432f-b6ad-4cb2-81d4-c33078fbf6c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:20:32.343392 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108432f-b6ad-4cb2-81d4-c33078fbf6c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:32.344990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108432f-b6ad-4cb2-81d4-c33078fbf6c8 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:32.356804 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1236/2489] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:20:32.360976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ec94e-b7af-4e60-abff-08e73700c614 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:32.370410 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ec94e-b7af-4e60-abff-08e73700c614 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:32.375307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a04941-8adf-453d-9964-7b7204362be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:32.375967 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a04941-8adf-453d-9964-7b7204362be1 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:32.376252 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a04941-8adf-453d-9964-7b7204362be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:32.376525 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a04941-8adf-453d-9964-7b7204362be1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:32.377215 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a04941-8adf-453d-9964-7b7204362be1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:32.379315 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a04941-8adf-453d-9964-7b7204362be1 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:32.407566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1254/2490] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:20:32 2022] POST /identity/v3/projects => generated 409 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:20:32.412355 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108432f-b6ad-4cb2-81d4-c33078fbf6c8 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:32.422588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108432f-b6ad-4cb2-81d4-c33078fbf6c8 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:32.479346 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297e7a3-035b-498a-bba3-c0b8954a4caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:32.480179 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297e7a3-035b-498a-bba3-c0b8954a4caa admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:32.480464 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297e7a3-035b-498a-bba3-c0b8954a4caa admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:32.480737 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297e7a3-035b-498a-bba3-c0b8954a4caa admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:32.481424 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297e7a3-035b-498a-bba3-c0b8954a4caa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:32.483665 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297e7a3-035b-498a-bba3-c0b8954a4caa admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:32.505599 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1237/2491] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:20:32 2022] POST /identity/v3/users => generated 305 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:20:32.510144 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a04941-8adf-453d-9964-7b7204362be1 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:32.520886 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a04941-8adf-453d-9964-7b7204362be1 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:32.525701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfc914-c041-4d78-a87c-8d1e12a5f155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:32.526359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfc914-c041-4d78-a87c-8d1e12a5f155 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:32.526643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfc914-c041-4d78-a87c-8d1e12a5f155 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:32.526908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfc914-c041-4d78-a87c-8d1e12a5f155 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:32.527808 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfc914-c041-4d78-a87c-8d1e12a5f155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:32.529426 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfc914-c041-4d78-a87c-8d1e12a5f155 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:32.540178 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1255/2492] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 22:20:32.544330 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297e7a3-035b-498a-bba3-c0b8954a4caa admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:32.554748 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297e7a3-035b-498a-bba3-c0b8954a4caa admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:32.560545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e9d40-8ab8-46f3-85e5-1845fb1bcbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:32.561204 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e9d40-8ab8-46f3-85e5-1845fb1bcbde admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:32.561518 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e9d40-8ab8-46f3-85e5-1845fb1bcbde admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:32.561792 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e9d40-8ab8-46f3-85e5-1845fb1bcbde admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:32.562522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e9d40-8ab8-46f3-85e5-1845fb1bcbde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:32.564158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e9d40-8ab8-46f3-85e5-1845fb1bcbde admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:32.576020 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1238/2493] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:20:32.580453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfc914-c041-4d78-a87c-8d1e12a5f155 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:32.591807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfc914-c041-4d78-a87c-8d1e12a5f155 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:32.597896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87e78e-ac29-4da7-8e2d-e76e89b75115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:32.598691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87e78e-ac29-4da7-8e2d-e76e89b75115 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:32.598974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87e78e-ac29-4da7-8e2d-e76e89b75115 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:32.599280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87e78e-ac29-4da7-8e2d-e76e89b75115 admin admin] PATH_INFO: `/v3/projects/fa0819da154240df899e70d54cf3f6ae/users/45e3fa35e73f466083ad39678aa60048/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:32.616005 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87e78e-ac29-4da7-8e2d-e76e89b75115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa0819da154240df899e70d54cf3f6ae, user_id=45e3fa35e73f466083ad39678aa60048, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:32.618683 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87e78e-ac29-4da7-8e2d-e76e89b75115 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:32.633816 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1256/2494] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:20:32 2022] PUT /identity/v3/projects/fa0819da154240df899e70d54cf3f6ae/users/45e3fa35e73f466083ad39678aa60048/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:20:32.645856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa363003-dc27-4f26-a41c-9206da19b71e None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:32.646152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa363003-dc27-4f26-a41c-9206da19b71e None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:32.646439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa363003-dc27-4f26-a41c-9206da19b71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:32.673884 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-aa363003-dc27-4f26-a41c-9206da19b71e None None] MFA Rules not processed for user `45e3fa35e73f466083ad39678aa60048`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:20:32.675194 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-aa363003-dc27-4f26-a41c-9206da19b71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:20:32.743432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1239/2495] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:20:32 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:20:32.748270 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87e78e-ac29-4da7-8e2d-e76e89b75115 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:32.812061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87e78e-ac29-4da7-8e2d-e76e89b75115 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:32.818276 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce891602-6b75-4e7e-9cba-fc4aa9b136e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:32.819321 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce891602-6b75-4e7e-9cba-fc4aa9b136e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:32.819692 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce891602-6b75-4e7e-9cba-fc4aa9b136e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:32.820038 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce891602-6b75-4e7e-9cba-fc4aa9b136e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:32.821119 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce891602-6b75-4e7e-9cba-fc4aa9b136e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:32.824206 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce891602-6b75-4e7e-9cba-fc4aa9b136e3 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:32.855424 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1257/2496] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:20:32 2022] POST /identity/v3/projects => generated 403 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:20:32.859799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa363003-dc27-4f26-a41c-9206da19b71e None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:32.871275 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa363003-dc27-4f26-a41c-9206da19b71e None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:32.930580 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ecbb4-af93-4e9f-ab0d-671721668912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:32.931212 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ecbb4-af93-4e9f-ab0d-671721668912 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:32.931497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ecbb4-af93-4e9f-ab0d-671721668912 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:32.931793 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ecbb4-af93-4e9f-ab0d-671721668912 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:32.932454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ecbb4-af93-4e9f-ab0d-671721668912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:32.934369 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ecbb4-af93-4e9f-ab0d-671721668912 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:32.956569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1240/2497] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:20:32 2022] POST /identity/v3/users => generated 308 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:20:32.960788 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce891602-6b75-4e7e-9cba-fc4aa9b136e3 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:32.971491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce891602-6b75-4e7e-9cba-fc4aa9b136e3 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:32.977390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c39a6-0113-4067-a287-58b00d76cc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:32.978051 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c39a6-0113-4067-a287-58b00d76cc76 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:32.978337 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c39a6-0113-4067-a287-58b00d76cc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:32.978613 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c39a6-0113-4067-a287-58b00d76cc76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:32.979377 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c39a6-0113-4067-a287-58b00d76cc76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:32.981017 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c39a6-0113-4067-a287-58b00d76cc76 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:32.992360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1258/2498] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:20:32.996525 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ecbb4-af93-4e9f-ab0d-671721668912 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:33.007428 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ecbb4-af93-4e9f-ab0d-671721668912 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:33.013098 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8fcc1-6291-449d-89f7-444d7ec63d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:33.014024 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8fcc1-6291-449d-89f7-444d7ec63d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:33.014303 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8fcc1-6291-449d-89f7-444d7ec63d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:33.014593 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8fcc1-6291-449d-89f7-444d7ec63d2d admin admin] PATH_INFO: `/v3/projects/5e4106b68d0246aca97f2c7cbce1fc67/users/39b28c7dc523409eb7326f75b7f92340/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:33.029517 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8fcc1-6291-449d-89f7-444d7ec63d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e4106b68d0246aca97f2c7cbce1fc67, user_id=39b28c7dc523409eb7326f75b7f92340, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:33.032234 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8fcc1-6291-449d-89f7-444d7ec63d2d admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:33.048004 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1241/2499] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:20:32 2022] PUT /identity/v3/projects/5e4106b68d0246aca97f2c7cbce1fc67/users/39b28c7dc523409eb7326f75b7f92340/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:20:33.052781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c39a6-0113-4067-a287-58b00d76cc76 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:33.063265 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c39a6-0113-4067-a287-58b00d76cc76 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:33.126387 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043cd85-ea0b-4590-bbd6-d5464e0c7267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:33.127118 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043cd85-ea0b-4590-bbd6-d5464e0c7267 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:33.127466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043cd85-ea0b-4590-bbd6-d5464e0c7267 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:33.127825 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043cd85-ea0b-4590-bbd6-d5464e0c7267 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:33.128885 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043cd85-ea0b-4590-bbd6-d5464e0c7267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:33.130723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043cd85-ea0b-4590-bbd6-d5464e0c7267 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:33.140973 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1259/2500] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 22:20:33.145387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8fcc1-6291-449d-89f7-444d7ec63d2d admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:33.156232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8fcc1-6291-449d-89f7-444d7ec63d2d admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:33.161977 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d9a3b-d5e2-482b-9a3f-58dbf0e5d45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:33.162937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d9a3b-d5e2-482b-9a3f-58dbf0e5d45a admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:33.163347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d9a3b-d5e2-482b-9a3f-58dbf0e5d45a admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:33.163550 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d9a3b-d5e2-482b-9a3f-58dbf0e5d45a admin admin] PATH_INFO: `/v3/projects/5e4106b68d0246aca97f2c7cbce1fc67/users/39b28c7dc523409eb7326f75b7f92340/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:33.165676 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d9a3b-d5e2-482b-9a3f-58dbf0e5d45a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e4106b68d0246aca97f2c7cbce1fc67, user_id=39b28c7dc523409eb7326f75b7f92340, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:33.168393 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d9a3b-d5e2-482b-9a3f-58dbf0e5d45a admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:33.179228 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1242/2501] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:20:33 2022] PUT /identity/v3/projects/5e4106b68d0246aca97f2c7cbce1fc67/users/39b28c7dc523409eb7326f75b7f92340/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:20:33.189831 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718d0bc-d7ec-444e-a707-053ca8cdad9a None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:33.190103 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718d0bc-d7ec-444e-a707-053ca8cdad9a None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:33.190391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718d0bc-d7ec-444e-a707-053ca8cdad9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:33.217855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-e718d0bc-d7ec-444e-a707-053ca8cdad9a None None] MFA Rules not processed for user `39b28c7dc523409eb7326f75b7f92340`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:20:33.219086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-e718d0bc-d7ec-444e-a707-053ca8cdad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:20:33.288830 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1260/2502] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:20:33 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:20:57.169374 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d9a3b-d5e2-482b-9a3f-58dbf0e5d45a admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:20:57.171296 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-373d9a3b-d5e2-482b-9a3f-58dbf0e5d45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:20:57.306894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d9a3b-d5e2-482b-9a3f-58dbf0e5d45a admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:20:57.312930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770fd50-3c97-4b20-b477-e6a2ce1b51c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e203d7077af54930a640b2334a1d8fa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:20:57.313590 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770fd50-3c97-4b20-b477-e6a2ce1b51c8 service placement] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:20:57.313875 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770fd50-3c97-4b20-b477-e6a2ce1b51c8 service placement] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:20:57.314174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770fd50-3c97-4b20-b477-e6a2ce1b51c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:20:57.316274 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f770fd50-3c97-4b20-b477-e6a2ce1b51c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:20:57.327787 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770fd50-3c97-4b20-b477-e6a2ce1b51c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:20:57.329400 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770fd50-3c97-4b20-b477-e6a2ce1b51c8 service placement] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:20:57.339608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1243/2503] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:20:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:21:37.241242 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718d0bc-d7ec-444e-a707-053ca8cdad9a None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:37.242881 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-e718d0bc-d7ec-444e-a707-053ca8cdad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:37.304735 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770fd50-3c97-4b20-b477-e6a2ce1b51c8 service placement] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:37.306311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f770fd50-3c97-4b20-b477-e6a2ce1b51c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:37.320942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770fd50-3c97-4b20-b477-e6a2ce1b51c8 service placement] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:37.321199 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718d0bc-d7ec-444e-a707-053ca8cdad9a None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:37.325736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b836027-00e5-4588-b8e5-e68102c0d5e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:37.325953 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd250d-f85c-4310-b350-4c05905d699a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:37.326465 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd250d-f85c-4310-b350-4c05905d699a service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:37.326753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd250d-f85c-4310-b350-4c05905d699a service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:37.326897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b836027-00e5-4588-b8e5-e68102c0d5e0 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:37.327139 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd250d-f85c-4310-b350-4c05905d699a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:37.327405 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b836027-00e5-4588-b8e5-e68102c0d5e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:37.327838 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b836027-00e5-4588-b8e5-e68102c0d5e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:37.330595 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5b836027-00e5-4588-b8e5-e68102c0d5e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:37.339553 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd250d-f85c-4310-b350-4c05905d699a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:37.341312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd250d-f85c-4310-b350-4c05905d699a service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:37.352214 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1244/2504] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:21:37 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:21:37.411461 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b836027-00e5-4588-b8e5-e68102c0d5e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:37.413185 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b836027-00e5-4588-b8e5-e68102c0d5e0 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:37.414768 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd250d-f85c-4310-b350-4c05905d699a service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:37.425124 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd250d-f85c-4310-b350-4c05905d699a service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:37.430241 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c7544-ca16-401d-b090-fe18da9e2a23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:37.430939 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c7544-ca16-401d-b090-fe18da9e2a23 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:37.431577 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c7544-ca16-401d-b090-fe18da9e2a23 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:37.431918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c7544-ca16-401d-b090-fe18da9e2a23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:37.433882 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1261/2505] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:21:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:21:37.442963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c7544-ca16-401d-b090-fe18da9e2a23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:37.445868 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c7544-ca16-401d-b090-fe18da9e2a23 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:37.456802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1245/2506] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:21:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:21:37.739583 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b836027-00e5-4588-b8e5-e68102c0d5e0 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:37.748636 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b836027-00e5-4588-b8e5-e68102c0d5e0 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:37.752615 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8c61a-0376-49c2-b740-0a76b1b4f11c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:37.753296 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8c61a-0376-49c2-b740-0a76b1b4f11c service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:37.753574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8c61a-0376-49c2-b740-0a76b1b4f11c service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:37.753846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8c61a-0376-49c2-b740-0a76b1b4f11c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:37.809456 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8c61a-0376-49c2-b740-0a76b1b4f11c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:37.810981 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8c61a-0376-49c2-b740-0a76b1b4f11c service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:37.820103 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1262/2507] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:21:37 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:21:39.086840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c7544-ca16-401d-b090-fe18da9e2a23 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:39.088417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-605c7544-ca16-401d-b090-fe18da9e2a23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:39.155803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c7544-ca16-401d-b090-fe18da9e2a23 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:39.160715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64944deb-6b39-4afd-b3b3-e696fe4e0c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:39.161536 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64944deb-6b39-4afd-b3b3-e696fe4e0c26 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:39.161816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64944deb-6b39-4afd-b3b3-e696fe4e0c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:39.162085 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64944deb-6b39-4afd-b3b3-e696fe4e0c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:39.165480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-64944deb-6b39-4afd-b3b3-e696fe4e0c26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:39.276122 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64944deb-6b39-4afd-b3b3-e696fe4e0c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:39.279750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64944deb-6b39-4afd-b3b3-e696fe4e0c26 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:39.295296 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1246/2508] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:21:39.466773 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8c61a-0376-49c2-b740-0a76b1b4f11c service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:39.468254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-83c8c61a-0376-49c2-b740-0a76b1b4f11c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:39.564953 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8c61a-0376-49c2-b740-0a76b1b4f11c service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:39.577893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece19fdd-50e8-4b8d-96fb-6a5194eddf4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:39.580248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19fdd-50e8-4b8d-96fb-6a5194eddf4a service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:39.580248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19fdd-50e8-4b8d-96fb-6a5194eddf4a service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:39.580248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece19fdd-50e8-4b8d-96fb-6a5194eddf4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:39.585200 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ece19fdd-50e8-4b8d-96fb-6a5194eddf4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:39.600756 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece19fdd-50e8-4b8d-96fb-6a5194eddf4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:39.603206 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece19fdd-50e8-4b8d-96fb-6a5194eddf4a service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:39.615232 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1263/2509] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:21:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:21:40.057030 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64944deb-6b39-4afd-b3b3-e696fe4e0c26 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:40.059514 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-64944deb-6b39-4afd-b3b3-e696fe4e0c26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:40.071588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64944deb-6b39-4afd-b3b3-e696fe4e0c26 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:40.076181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcc319-ad03-4721-bfb1-4c88f4550b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:40.076923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcc319-ad03-4721-bfb1-4c88f4550b8f service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:40.077266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcc319-ad03-4721-bfb1-4c88f4550b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:40.077619 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcc319-ad03-4721-bfb1-4c88f4550b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:40.081149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-02fcc319-ad03-4721-bfb1-4c88f4550b8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:40.093573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcc319-ad03-4721-bfb1-4c88f4550b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:40.095027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcc319-ad03-4721-bfb1-4c88f4550b8f service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:40.104810 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1247/2510] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:21:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:21:41.044419 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece19fdd-50e8-4b8d-96fb-6a5194eddf4a service nova] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:41.046583 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ece19fdd-50e8-4b8d-96fb-6a5194eddf4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:41.064312 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece19fdd-50e8-4b8d-96fb-6a5194eddf4a service nova] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:41.071210 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f3eec-5c34-4eb5-8845-e69b0b132cef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:41.072178 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f3eec-5c34-4eb5-8845-e69b0b132cef service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:41.072713 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f3eec-5c34-4eb5-8845-e69b0b132cef service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:41.073201 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f3eec-5c34-4eb5-8845-e69b0b132cef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:41.075396 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-415f3eec-5c34-4eb5-8845-e69b0b132cef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:41.090854 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f3eec-5c34-4eb5-8845-e69b0b132cef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:41.092947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f3eec-5c34-4eb5-8845-e69b0b132cef service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:41.124104 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1264/2511] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:21:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:21:43.666089 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcc319-ad03-4721-bfb1-4c88f4550b8f service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:43.667931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-02fcc319-ad03-4721-bfb1-4c88f4550b8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:43.702421 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcc319-ad03-4721-bfb1-4c88f4550b8f service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:43.718678 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c159092-fc72-46d9-87ee-8f8f16c3d9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:43.720474 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c159092-fc72-46d9-87ee-8f8f16c3d9de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:43.720998 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c159092-fc72-46d9-87ee-8f8f16c3d9de admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:43.721491 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c159092-fc72-46d9-87ee-8f8f16c3d9de admin admin] PATH_INFO: `/v3/users/2bf26e013e10482fae90fd291b1b90b2` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:43.741267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c159092-fc72-46d9-87ee-8f8f16c3d9de admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf26e013e10482fae90fd291b1b90b2)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:43.743260 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c159092-fc72-46d9-87ee-8f8f16c3d9de admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:43.827172 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1c159092-fc72-46d9-87ee-8f8f16c3d9de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf26e013e10482fae90fd291b1b90b2'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:43.838293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1c159092-fc72-46d9-87ee-8f8f16c3d9de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf26e013e10482fae90fd291b1b90b2'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:43.849873 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1c159092-fc72-46d9-87ee-8f8f16c3d9de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf26e013e10482fae90fd291b1b90b2'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:43.851154 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1c159092-fc72-46d9-87ee-8f8f16c3d9de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf26e013e10482fae90fd291b1b90b2'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:43.851995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1c159092-fc72-46d9-87ee-8f8f16c3d9de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf26e013e10482fae90fd291b1b90b2'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:43.882284 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1248/2512] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:21:43 2022] DELETE /identity/v3/users/2bf26e013e10482fae90fd291b1b90b2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:44.090300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f3eec-5c34-4eb5-8845-e69b0b132cef service nova] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:44.108664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f3eec-5c34-4eb5-8845-e69b0b132cef service nova] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:44.170734 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098f5a2-3bb6-48e3-bd10-14b77e31a60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:44.171644 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098f5a2-3bb6-48e3-bd10-14b77e31a60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:44.171933 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098f5a2-3bb6-48e3-bd10-14b77e31a60c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:44.172208 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098f5a2-3bb6-48e3-bd10-14b77e31a60c admin admin] PATH_INFO: `/v3/projects/687babab97b84c10a284e7d92f939fcc` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:44.183155 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098f5a2-3bb6-48e3-bd10-14b77e31a60c admin admin] RBAC: Authorizing `identity:delete_project(project_id=687babab97b84c10a284e7d92f939fcc)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:44.185115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098f5a2-3bb6-48e3-bd10-14b77e31a60c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:44.236323 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e098f5a2-3bb6-48e3-bd10-14b77e31a60c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '687babab97b84c10a284e7d92f939fcc', 'request_id': 'req-e098f5a2-3bb6-48e3-bd10-14b77e31a60c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:44.244900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e098f5a2-3bb6-48e3-bd10-14b77e31a60c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '687babab97b84c10a284e7d92f939fcc', 'request_id': 'req-e098f5a2-3bb6-48e3-bd10-14b77e31a60c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:44.252007 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e098f5a2-3bb6-48e3-bd10-14b77e31a60c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '687babab97b84c10a284e7d92f939fcc', 'request_id': 'req-e098f5a2-3bb6-48e3-bd10-14b77e31a60c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:44.262894 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e098f5a2-3bb6-48e3-bd10-14b77e31a60c admin admin] The token cache is being invalidate because project 687babab97b84c10a284e7d92f939fcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:21:44.263212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e098f5a2-3bb6-48e3-bd10-14b77e31a60c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:44.264505 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e098f5a2-3bb6-48e3-bd10-14b77e31a60c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:44.266519 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1265/2513] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:21:44 2022] DELETE /identity/v3/projects/687babab97b84c10a284e7d92f939fcc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:44.272531 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f2fa2-3adc-4bee-b8d6-8ecce64bc6c1 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:44.272863 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f2fa2-3adc-4bee-b8d6-8ecce64bc6c1 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:44.273120 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f2fa2-3adc-4bee-b8d6-8ecce64bc6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:44.295444 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-5d1f2fa2-3adc-4bee-b8d6-8ecce64bc6c1 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:44.296883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-5d1f2fa2-3adc-4bee-b8d6-8ecce64bc6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:44.363099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1249/2514] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:21:44.371815 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3398d3a-b055-41ce-8eb2-b1877caf113d None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:44.372215 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3398d3a-b055-41ce-8eb2-b1877caf113d None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:44.372528 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3398d3a-b055-41ce-8eb2-b1877caf113d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:44.390440 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-a3398d3a-b055-41ce-8eb2-b1877caf113d None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:44.391747 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a3398d3a-b055-41ce-8eb2-b1877caf113d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:44.400118 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1266/2515] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:21:44.404442 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f2fa2-3adc-4bee-b8d6-8ecce64bc6c1 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:44.416096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f2fa2-3adc-4bee-b8d6-8ecce64bc6c1 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:44.425202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a6fbc-224f-46e6-b0b7-7350bb525303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:44.426138 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a6fbc-224f-46e6-b0b7-7350bb525303 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:44.426590 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a6fbc-224f-46e6-b0b7-7350bb525303 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:44.427031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a6fbc-224f-46e6-b0b7-7350bb525303 admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:44.428597 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a6fbc-224f-46e6-b0b7-7350bb525303 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:21:44.429154 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a6fbc-224f-46e6-b0b7-7350bb525303 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:44.432448 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a6fbc-224f-46e6-b0b7-7350bb525303 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:44.450220 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1250/2516] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 22:21:44.451583 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3398d3a-b055-41ce-8eb2-b1877caf113d None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:44.461178 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3398d3a-b055-41ce-8eb2-b1877caf113d None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:44.465842 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36235c-a03e-44fe-836b-371eaefcf06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:44.466572 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36235c-a03e-44fe-836b-371eaefcf06f admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:44.467018 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36235c-a03e-44fe-836b-371eaefcf06f admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:44.467325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36235c-a03e-44fe-836b-371eaefcf06f admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:44.468109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36235c-a03e-44fe-836b-371eaefcf06f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:44.470069 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36235c-a03e-44fe-836b-371eaefcf06f admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:44.499899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1267/2517] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:21:44 2022] POST /identity/v3/projects => generated 401 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:21:44.504325 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a6fbc-224f-46e6-b0b7-7350bb525303 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:44.514930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a6fbc-224f-46e6-b0b7-7350bb525303 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:44.573261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcdf70-27f2-4c26-8df2-ca7085719d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:44.574052 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcdf70-27f2-4c26-8df2-ca7085719d66 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:44.574342 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcdf70-27f2-4c26-8df2-ca7085719d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:44.574622 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcdf70-27f2-4c26-8df2-ca7085719d66 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:44.575383 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcdf70-27f2-4c26-8df2-ca7085719d66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:44.577337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcdf70-27f2-4c26-8df2-ca7085719d66 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:44.601278 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1251/2518] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:21:44 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:21:44.605074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36235c-a03e-44fe-836b-371eaefcf06f admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:44.615817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36235c-a03e-44fe-836b-371eaefcf06f admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:44.620673 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652494b-002c-4881-b516-aef40eef34f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:44.621336 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652494b-002c-4881-b516-aef40eef34f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:44.621623 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652494b-002c-4881-b516-aef40eef34f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:44.621899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652494b-002c-4881-b516-aef40eef34f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:44.622633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652494b-002c-4881-b516-aef40eef34f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:44.624295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652494b-002c-4881-b516-aef40eef34f3 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:44.634837 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1268/2519] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:21:44.639011 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcdf70-27f2-4c26-8df2-ca7085719d66 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:44.650138 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcdf70-27f2-4c26-8df2-ca7085719d66 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:44.658189 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb46c3-3b7e-4d95-9605-cd96190c4fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:44.658716 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb46c3-3b7e-4d95-9605-cd96190c4fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:44.659008 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb46c3-3b7e-4d95-9605-cd96190c4fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:44.659335 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb46c3-3b7e-4d95-9605-cd96190c4fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:44.660139 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb46c3-3b7e-4d95-9605-cd96190c4fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:44.662035 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb46c3-3b7e-4d95-9605-cd96190c4fc5 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:44.675080 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1252/2520] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:21:44.677250 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652494b-002c-4881-b516-aef40eef34f3 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:44.687506 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652494b-002c-4881-b516-aef40eef34f3 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:44.692349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2a15d-4a12-4e14-9bd5-69f602a3a123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:44.693389 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2a15d-4a12-4e14-9bd5-69f602a3a123 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:44.693743 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2a15d-4a12-4e14-9bd5-69f602a3a123 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:44.694111 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2a15d-4a12-4e14-9bd5-69f602a3a123 admin admin] PATH_INFO: `/v3/projects/758c302257e049bbab536432d9ee3fe1/users/9444d0c8889545eea997deaa7ecf9174/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:44.709129 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2a15d-4a12-4e14-9bd5-69f602a3a123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758c302257e049bbab536432d9ee3fe1, user_id=9444d0c8889545eea997deaa7ecf9174, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:44.712053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2a15d-4a12-4e14-9bd5-69f602a3a123 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:44.730300 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1269/2521] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:21:44 2022] PUT /identity/v3/projects/758c302257e049bbab536432d9ee3fe1/users/9444d0c8889545eea997deaa7ecf9174/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:44.740719 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4f697-1f34-4c10-9722-3252cbc0de8c None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:44.741224 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4f697-1f34-4c10-9722-3252cbc0de8c None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:44.741512 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4f697-1f34-4c10-9722-3252cbc0de8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:44.768319 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-73f4f697-1f34-4c10-9722-3252cbc0de8c None None] MFA Rules not processed for user `9444d0c8889545eea997deaa7ecf9174`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:44.769547 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-73f4f697-1f34-4c10-9722-3252cbc0de8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:44.836435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1253/2522] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:21:44.841223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2a15d-4a12-4e14-9bd5-69f602a3a123 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:44.905030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2a15d-4a12-4e14-9bd5-69f602a3a123 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:44.910034 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c08e3-33a1-4c5a-9515-188a1af282d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:44.910918 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c08e3-33a1-4c5a-9515-188a1af282d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:44.911236 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c08e3-33a1-4c5a-9515-188a1af282d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:44.911519 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c08e3-33a1-4c5a-9515-188a1af282d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:44.912259 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c08e3-33a1-4c5a-9515-188a1af282d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:44.914217 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c08e3-33a1-4c5a-9515-188a1af282d1 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:44.943743 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1270/2523] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:21:44 2022] POST /identity/v3/projects => generated 399 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:21:44.948078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4f697-1f34-4c10-9722-3252cbc0de8c None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:44.969135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4f697-1f34-4c10-9722-3252cbc0de8c None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:45.024524 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94db43-017b-4274-ab38-1a41320c36d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:45.025153 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94db43-017b-4274-ab38-1a41320c36d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:45.025401 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94db43-017b-4274-ab38-1a41320c36d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:45.025676 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94db43-017b-4274-ab38-1a41320c36d4 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:45.026368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94db43-017b-4274-ab38-1a41320c36d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:45.028327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94db43-017b-4274-ab38-1a41320c36d4 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:45.052691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1254/2524] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:21:44 2022] POST /identity/v3/users => generated 306 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:21:45.056874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c08e3-33a1-4c5a-9515-188a1af282d1 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:45.068028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c08e3-33a1-4c5a-9515-188a1af282d1 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:45.073278 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a76cb-8c49-495d-9a22-c505f80958c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:45.073956 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a76cb-8c49-495d-9a22-c505f80958c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:45.074253 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a76cb-8c49-495d-9a22-c505f80958c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:45.074541 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a76cb-8c49-495d-9a22-c505f80958c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:45.075308 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a76cb-8c49-495d-9a22-c505f80958c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:45.076944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a76cb-8c49-495d-9a22-c505f80958c4 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:45.088363 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1271/2525] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:21:45.093664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94db43-017b-4274-ab38-1a41320c36d4 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:45.104032 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94db43-017b-4274-ab38-1a41320c36d4 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:45.112069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc9475-a05f-454b-975f-c440842ae47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:45.113022 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc9475-a05f-454b-975f-c440842ae47e admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:45.113436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc9475-a05f-454b-975f-c440842ae47e admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:45.113724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc9475-a05f-454b-975f-c440842ae47e admin admin] PATH_INFO: `/v3/projects/d8a4fbd50d4c448882e74584b3775c94/users/994e15fcf70d4dfcae06a6cb8ffb50b3/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:45.129721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc9475-a05f-454b-975f-c440842ae47e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a4fbd50d4c448882e74584b3775c94, user_id=994e15fcf70d4dfcae06a6cb8ffb50b3, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:45.132474 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc9475-a05f-454b-975f-c440842ae47e admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:45.149017 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1255/2526] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:21:45 2022] PUT /identity/v3/projects/d8a4fbd50d4c448882e74584b3775c94/users/994e15fcf70d4dfcae06a6cb8ffb50b3/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:45.152912 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a76cb-8c49-495d-9a22-c505f80958c4 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:45.165654 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a76cb-8c49-495d-9a22-c505f80958c4 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:45.235824 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b171c9d-b944-4b15-8047-f3d5490111e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:45.236510 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b171c9d-b944-4b15-8047-f3d5490111e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:45.236798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b171c9d-b944-4b15-8047-f3d5490111e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:45.237078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b171c9d-b944-4b15-8047-f3d5490111e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:45.237806 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b171c9d-b944-4b15-8047-f3d5490111e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:45.239816 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b171c9d-b944-4b15-8047-f3d5490111e4 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:45.249569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1272/2527] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:21:45.253893 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc9475-a05f-454b-975f-c440842ae47e admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:45.264495 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc9475-a05f-454b-975f-c440842ae47e admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:45.269801 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06971ae5-25cd-4158-8f65-fbc1d1081ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:45.270720 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06971ae5-25cd-4158-8f65-fbc1d1081ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:45.271006 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06971ae5-25cd-4158-8f65-fbc1d1081ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:45.272010 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06971ae5-25cd-4158-8f65-fbc1d1081ea4 admin admin] PATH_INFO: `/v3/projects/d8a4fbd50d4c448882e74584b3775c94/users/994e15fcf70d4dfcae06a6cb8ffb50b3/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:45.274464 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06971ae5-25cd-4158-8f65-fbc1d1081ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a4fbd50d4c448882e74584b3775c94, user_id=994e15fcf70d4dfcae06a6cb8ffb50b3, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:45.277266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06971ae5-25cd-4158-8f65-fbc1d1081ea4 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:45.288370 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1256/2528] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:21:45 2022] PUT /identity/v3/projects/d8a4fbd50d4c448882e74584b3775c94/users/994e15fcf70d4dfcae06a6cb8ffb50b3/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:21:45.300643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc6bfe-a392-4d08-9f40-c50e1a1e5978 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:45.300996 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc6bfe-a392-4d08-9f40-c50e1a1e5978 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:45.303475 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc6bfe-a392-4d08-9f40-c50e1a1e5978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:45.332708 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-54dc6bfe-a392-4d08-9f40-c50e1a1e5978 None None] MFA Rules not processed for user `994e15fcf70d4dfcae06a6cb8ffb50b3`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:45.333939 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-54dc6bfe-a392-4d08-9f40-c50e1a1e5978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:45.404297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1273/2529] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:45 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:21:45.416247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06971ae5-25cd-4158-8f65-fbc1d1081ea4 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:45.418274 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-06971ae5-25cd-4158-8f65-fbc1d1081ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:45.480825 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06971ae5-25cd-4158-8f65-fbc1d1081ea4 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:45.484744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4535d3-4f0b-48e3-bc76-2f70fa28b55e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:45.485395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4535d3-4f0b-48e3-bc76-2f70fa28b55e service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:45.485678 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4535d3-4f0b-48e3-bc76-2f70fa28b55e service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:45.485952 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4535d3-4f0b-48e3-bc76-2f70fa28b55e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:45.495374 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4535d3-4f0b-48e3-bc76-2f70fa28b55e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:45.496993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4535d3-4f0b-48e3-bc76-2f70fa28b55e service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:45.506774 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1257/2530] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:21:45 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:21:45.587870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc6bfe-a392-4d08-9f40-c50e1a1e5978 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:45.597919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc6bfe-a392-4d08-9f40-c50e1a1e5978 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:45.602225 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9d830-d8bd-4427-b9e4-37c1d1bb4a85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:45.602879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9d830-d8bd-4427-b9e4-37c1d1bb4a85 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:45.603197 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9d830-d8bd-4427-b9e4-37c1d1bb4a85 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:45.603479 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9d830-d8bd-4427-b9e4-37c1d1bb4a85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:45.660078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9d830-d8bd-4427-b9e4-37c1d1bb4a85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:45.661713 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9d830-d8bd-4427-b9e4-37c1d1bb4a85 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:45.670754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1274/2531] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:21:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:21:46.539225 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4535d3-4f0b-48e3-bc76-2f70fa28b55e service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:46.540829 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-7d4535d3-4f0b-48e3-bc76-2f70fa28b55e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:46.606199 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4535d3-4f0b-48e3-bc76-2f70fa28b55e service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:46.610696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d536e5-c439-4cd2-8608-bf8974169642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:46.611615 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d536e5-c439-4cd2-8608-bf8974169642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:46.611897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d536e5-c439-4cd2-8608-bf8974169642 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:46.612172 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d536e5-c439-4cd2-8608-bf8974169642 admin admin] PATH_INFO: `/v3/users/45e3fa35e73f466083ad39678aa60048` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:46.613522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d536e5-c439-4cd2-8608-bf8974169642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45e3fa35e73f466083ad39678aa60048)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:46.615503 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d536e5-c439-4cd2-8608-bf8974169642 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:46.665206 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-53d536e5-c439-4cd2-8608-bf8974169642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45e3fa35e73f466083ad39678aa60048'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:46.675765 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-53d536e5-c439-4cd2-8608-bf8974169642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45e3fa35e73f466083ad39678aa60048'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:46.682841 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-53d536e5-c439-4cd2-8608-bf8974169642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45e3fa35e73f466083ad39678aa60048'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:46.683515 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-53d536e5-c439-4cd2-8608-bf8974169642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45e3fa35e73f466083ad39678aa60048'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:46.684178 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-53d536e5-c439-4cd2-8608-bf8974169642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45e3fa35e73f466083ad39678aa60048'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:46.701451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1258/2532] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:21:46 2022] DELETE /identity/v3/users/45e3fa35e73f466083ad39678aa60048 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:46.706697 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8ce3-e5e1-4ad5-958e-dcdfd639cbc9 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:46.707314 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8ce3-e5e1-4ad5-958e-dcdfd639cbc9 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:46.707433 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8ce3-e5e1-4ad5-958e-dcdfd639cbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:46.728854 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-580c8ce3-e5e1-4ad5-958e-dcdfd639cbc9 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:46.730059 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-580c8ce3-e5e1-4ad5-958e-dcdfd639cbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:46.792929 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1275/2533] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:21:46.803170 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d536e5-c439-4cd2-8608-bf8974169642 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:46.804788 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-53d536e5-c439-4cd2-8608-bf8974169642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:46.865731 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d536e5-c439-4cd2-8608-bf8974169642 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:46.870353 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7c390-9f9f-4d1a-9bd1-5104b3cdb812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:46.871012 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7c390-9f9f-4d1a-9bd1-5104b3cdb812 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:46.871333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7c390-9f9f-4d1a-9bd1-5104b3cdb812 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:46.871603 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7c390-9f9f-4d1a-9bd1-5104b3cdb812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:46.882390 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7c390-9f9f-4d1a-9bd1-5104b3cdb812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:46.883878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7c390-9f9f-4d1a-9bd1-5104b3cdb812 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:46.893915 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1259/2534] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:21:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:21:47.164724 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c8ce3-e5e1-4ad5-958e-dcdfd639cbc9 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:47.166369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-580c8ce3-e5e1-4ad5-958e-dcdfd639cbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:47.185018 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c8ce3-e5e1-4ad5-958e-dcdfd639cbc9 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:47.191464 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d5cb9-293b-4366-907d-5595ba15970c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:47.192634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d5cb9-293b-4366-907d-5595ba15970c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:47.192880 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d5cb9-293b-4366-907d-5595ba15970c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:47.193301 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d5cb9-293b-4366-907d-5595ba15970c admin admin] PATH_INFO: `/v3/projects/fa0819da154240df899e70d54cf3f6ae` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:47.194757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d5cb9-293b-4366-907d-5595ba15970c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa0819da154240df899e70d54cf3f6ae)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:47.197208 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d5cb9-293b-4366-907d-5595ba15970c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:47.249747 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ab8d5cb9-293b-4366-907d-5595ba15970c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa0819da154240df899e70d54cf3f6ae', 'request_id': 'req-ab8d5cb9-293b-4366-907d-5595ba15970c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:47.261661 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ab8d5cb9-293b-4366-907d-5595ba15970c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa0819da154240df899e70d54cf3f6ae', 'request_id': 'req-ab8d5cb9-293b-4366-907d-5595ba15970c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:47.269001 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ab8d5cb9-293b-4366-907d-5595ba15970c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa0819da154240df899e70d54cf3f6ae', 'request_id': 'req-ab8d5cb9-293b-4366-907d-5595ba15970c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:47.280852 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ab8d5cb9-293b-4366-907d-5595ba15970c admin admin] The token cache is being invalidate because project fa0819da154240df899e70d54cf3f6ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:21:47.281141 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ab8d5cb9-293b-4366-907d-5595ba15970c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:47.281814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ab8d5cb9-293b-4366-907d-5595ba15970c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:47.283492 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1276/2535] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:21:47 2022] DELETE /identity/v3/projects/fa0819da154240df899e70d54cf3f6ae => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:47.291257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7c390-9f9f-4d1a-9bd1-5104b3cdb812 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:47.298486 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7c390-9f9f-4d1a-9bd1-5104b3cdb812 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:47.358915 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db07c5-618a-4efc-8efc-56f506964543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:47.359858 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db07c5-618a-4efc-8efc-56f506964543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:47.360138 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db07c5-618a-4efc-8efc-56f506964543 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:47.360454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db07c5-618a-4efc-8efc-56f506964543 admin admin] PATH_INFO: `/v3/users/39b28c7dc523409eb7326f75b7f92340` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:47.361620 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db07c5-618a-4efc-8efc-56f506964543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39b28c7dc523409eb7326f75b7f92340)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:47.364022 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db07c5-618a-4efc-8efc-56f506964543 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:47.414268 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-95db07c5-618a-4efc-8efc-56f506964543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39b28c7dc523409eb7326f75b7f92340'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:47.423125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-95db07c5-618a-4efc-8efc-56f506964543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39b28c7dc523409eb7326f75b7f92340'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:47.430767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-95db07c5-618a-4efc-8efc-56f506964543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39b28c7dc523409eb7326f75b7f92340'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:47.431498 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-95db07c5-618a-4efc-8efc-56f506964543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39b28c7dc523409eb7326f75b7f92340'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:47.432104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-95db07c5-618a-4efc-8efc-56f506964543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39b28c7dc523409eb7326f75b7f92340'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:47.449103 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1260/2536] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:21:47 2022] DELETE /identity/v3/users/39b28c7dc523409eb7326f75b7f92340 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:47.755671 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d5cb9-293b-4366-907d-5595ba15970c admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:47.757349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ab8d5cb9-293b-4366-907d-5595ba15970c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:47.771892 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d5cb9-293b-4366-907d-5595ba15970c admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:47.830348 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24c1f8-a036-4957-a44c-1b240dcae1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:47.831134 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24c1f8-a036-4957-a44c-1b240dcae1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:47.831415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24c1f8-a036-4957-a44c-1b240dcae1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:47.831693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24c1f8-a036-4957-a44c-1b240dcae1ff admin admin] PATH_INFO: `/v3/projects/5e4106b68d0246aca97f2c7cbce1fc67` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:47.833113 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24c1f8-a036-4957-a44c-1b240dcae1ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e4106b68d0246aca97f2c7cbce1fc67)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:47.835071 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24c1f8-a036-4957-a44c-1b240dcae1ff admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:47.884936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4c24c1f8-a036-4957-a44c-1b240dcae1ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e4106b68d0246aca97f2c7cbce1fc67', 'request_id': 'req-4c24c1f8-a036-4957-a44c-1b240dcae1ff'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:47.893529 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4c24c1f8-a036-4957-a44c-1b240dcae1ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e4106b68d0246aca97f2c7cbce1fc67', 'request_id': 'req-4c24c1f8-a036-4957-a44c-1b240dcae1ff'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:47.900232 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4c24c1f8-a036-4957-a44c-1b240dcae1ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e4106b68d0246aca97f2c7cbce1fc67', 'request_id': 'req-4c24c1f8-a036-4957-a44c-1b240dcae1ff'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:47.913000 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4c24c1f8-a036-4957-a44c-1b240dcae1ff admin admin] The token cache is being invalidate because project 5e4106b68d0246aca97f2c7cbce1fc67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:21:47.913288 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4c24c1f8-a036-4957-a44c-1b240dcae1ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:47.914064 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-4c24c1f8-a036-4957-a44c-1b240dcae1ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:47.915790 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1277/2537] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:21:47 2022] DELETE /identity/v3/projects/5e4106b68d0246aca97f2c7cbce1fc67 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:47.921164 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93474cfd-eb59-450d-8432-5b59027ac7dc None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:47.921674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93474cfd-eb59-450d-8432-5b59027ac7dc None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:47.921797 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93474cfd-eb59-450d-8432-5b59027ac7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:47.940374 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-93474cfd-eb59-450d-8432-5b59027ac7dc None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:47.941628 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-93474cfd-eb59-450d-8432-5b59027ac7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:48.011062 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1261/2538] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:21:48.022544 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8b43a-02e3-4a5e-b481-850af24976e7 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:48.022937 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8b43a-02e3-4a5e-b481-850af24976e7 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:48.023252 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8b43a-02e3-4a5e-b481-850af24976e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:48.043333 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-41b8b43a-02e3-4a5e-b481-850af24976e7 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:48.044519 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-41b8b43a-02e3-4a5e-b481-850af24976e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:48.054673 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1278/2539] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:21:48.059157 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93474cfd-eb59-450d-8432-5b59027ac7dc None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:48.069406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93474cfd-eb59-450d-8432-5b59027ac7dc None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:48.074688 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fb0df-7855-498d-ab18-4a5989a6221f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:48.075429 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fb0df-7855-498d-ab18-4a5989a6221f admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:48.075720 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fb0df-7855-498d-ab18-4a5989a6221f admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:48.075996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fb0df-7855-498d-ab18-4a5989a6221f admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:48.076736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fb0df-7855-498d-ab18-4a5989a6221f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:21:48.077049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fb0df-7855-498d-ab18-4a5989a6221f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:48.078669 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fb0df-7855-498d-ab18-4a5989a6221f admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:48.091406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1262/2540] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:21:48.095885 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8b43a-02e3-4a5e-b481-850af24976e7 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:48.105572 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8b43a-02e3-4a5e-b481-850af24976e7 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:48.110421 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214aeed-7c05-45ef-915a-6905fd276ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:48.111249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214aeed-7c05-45ef-915a-6905fd276ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:48.111536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214aeed-7c05-45ef-915a-6905fd276ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:48.111815 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214aeed-7c05-45ef-915a-6905fd276ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:48.112527 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214aeed-7c05-45ef-915a-6905fd276ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:48.114709 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214aeed-7c05-45ef-915a-6905fd276ed5 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:48.148200 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1279/2541] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:21:48 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:21:48.152490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fb0df-7855-498d-ab18-4a5989a6221f admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:48.162652 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fb0df-7855-498d-ab18-4a5989a6221f admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:48.219017 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5eb8d2-b686-4a6e-a1e5-0543d10b052e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:48.219779 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5eb8d2-b686-4a6e-a1e5-0543d10b052e admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:48.220081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5eb8d2-b686-4a6e-a1e5-0543d10b052e admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:48.220356 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5eb8d2-b686-4a6e-a1e5-0543d10b052e admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:48.221094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5eb8d2-b686-4a6e-a1e5-0543d10b052e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:48.223308 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5eb8d2-b686-4a6e-a1e5-0543d10b052e admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:48.244971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1263/2542] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:21:48 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:21:48.249060 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214aeed-7c05-45ef-915a-6905fd276ed5 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:48.264544 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214aeed-7c05-45ef-915a-6905fd276ed5 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:48.269521 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4ae73-b3ec-4a48-a079-34d094284495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:48.270563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4ae73-b3ec-4a48-a079-34d094284495 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:48.270868 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4ae73-b3ec-4a48-a079-34d094284495 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:48.271174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4ae73-b3ec-4a48-a079-34d094284495 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:48.271911 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4ae73-b3ec-4a48-a079-34d094284495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:48.273537 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4ae73-b3ec-4a48-a079-34d094284495 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:48.287117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1280/2543] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:21:48.288415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5eb8d2-b686-4a6e-a1e5-0543d10b052e admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:48.299074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5eb8d2-b686-4a6e-a1e5-0543d10b052e admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:48.305099 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448f0d9-66de-4595-b417-f6294d928b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:48.305927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448f0d9-66de-4595-b417-f6294d928b6e admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:48.306280 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448f0d9-66de-4595-b417-f6294d928b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:48.306627 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448f0d9-66de-4595-b417-f6294d928b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:48.307470 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448f0d9-66de-4595-b417-f6294d928b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:48.309182 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448f0d9-66de-4595-b417-f6294d928b6e admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:48.323276 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1264/2544] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:21:48.324429 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4ae73-b3ec-4a48-a079-34d094284495 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:48.336435 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4ae73-b3ec-4a48-a079-34d094284495 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:48.349199 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34390619-ee3e-45bc-a788-97829974dfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:48.349199 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34390619-ee3e-45bc-a788-97829974dfdc admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:48.349199 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34390619-ee3e-45bc-a788-97829974dfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:48.349199 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34390619-ee3e-45bc-a788-97829974dfdc admin admin] PATH_INFO: `/v3/projects/2d5f623a50de4ff889cc36f83b1522ef/users/78a28695b2ee492785ec900ba5e387eb/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:48.358619 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34390619-ee3e-45bc-a788-97829974dfdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5f623a50de4ff889cc36f83b1522ef, user_id=78a28695b2ee492785ec900ba5e387eb, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:48.361451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34390619-ee3e-45bc-a788-97829974dfdc admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:48.380792 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1281/2545] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:21:48 2022] PUT /identity/v3/projects/2d5f623a50de4ff889cc36f83b1522ef/users/78a28695b2ee492785ec900ba5e387eb/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:48.392088 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a8915-8a69-4ba2-9623-b369f7769386 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:48.392641 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a8915-8a69-4ba2-9623-b369f7769386 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:48.392933 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a8915-8a69-4ba2-9623-b369f7769386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:48.421421 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-809a8915-8a69-4ba2-9623-b369f7769386 None None] MFA Rules not processed for user `78a28695b2ee492785ec900ba5e387eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:48.422645 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-809a8915-8a69-4ba2-9623-b369f7769386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:48.496490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1265/2546] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 22:21:48.505432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34390619-ee3e-45bc-a788-97829974dfdc admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:48.509355 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-34390619-ee3e-45bc-a788-97829974dfdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:48.650309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34390619-ee3e-45bc-a788-97829974dfdc admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:48.654513 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05edee1-e23b-4aea-bd5b-a92badb1bf72 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c61205d7e96f496ab9f8ca84ab9408b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:48.655265 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05edee1-e23b-4aea-bd5b-a92badb1bf72 service glance] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:48.655686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05edee1-e23b-4aea-bd5b-a92badb1bf72 service glance] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:48.655979 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05edee1-e23b-4aea-bd5b-a92badb1bf72 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:48.665436 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05edee1-e23b-4aea-bd5b-a92badb1bf72 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:48.667297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05edee1-e23b-4aea-bd5b-a92badb1bf72 service glance] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:48.677361 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1282/2547] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:21:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:21:49.785653 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a8915-8a69-4ba2-9623-b369f7769386 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:49.787300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-809a8915-8a69-4ba2-9623-b369f7769386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:49.852172 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a8915-8a69-4ba2-9623-b369f7769386 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:49.857276 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfdb0e-ed34-4e09-831f-55e5c86da4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:49.858059 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfdb0e-ed34-4e09-831f-55e5c86da4c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:49.858403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfdb0e-ed34-4e09-831f-55e5c86da4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:49.858702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfdb0e-ed34-4e09-831f-55e5c86da4c9 admin admin] PATH_INFO: `/v3/users/9444d0c8889545eea997deaa7ecf9174` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:49.861679 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcfdb0e-ed34-4e09-831f-55e5c86da4c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9444d0c8889545eea997deaa7ecf9174)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:49.864020 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcfdb0e-ed34-4e09-831f-55e5c86da4c9 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:49.917770 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5bcfdb0e-ed34-4e09-831f-55e5c86da4c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9444d0c8889545eea997deaa7ecf9174'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:49.929310 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5bcfdb0e-ed34-4e09-831f-55e5c86da4c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9444d0c8889545eea997deaa7ecf9174'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:49.936578 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5bcfdb0e-ed34-4e09-831f-55e5c86da4c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9444d0c8889545eea997deaa7ecf9174'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:49.937258 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5bcfdb0e-ed34-4e09-831f-55e5c86da4c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9444d0c8889545eea997deaa7ecf9174'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:49.937873 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5bcfdb0e-ed34-4e09-831f-55e5c86da4c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9444d0c8889545eea997deaa7ecf9174'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:49.957265 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1266/2548] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:21:49 2022] DELETE /identity/v3/users/9444d0c8889545eea997deaa7ecf9174 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:49.962195 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b844d71-dc17-4068-a34e-6ac1670149d3 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:49.963104 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b844d71-dc17-4068-a34e-6ac1670149d3 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:49.963563 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b844d71-dc17-4068-a34e-6ac1670149d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:49.983145 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-5b844d71-dc17-4068-a34e-6ac1670149d3 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:49.984640 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5b844d71-dc17-4068-a34e-6ac1670149d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:50.044863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1283/2549] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 22:21:50.054879 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfdb0e-ed34-4e09-831f-55e5c86da4c9 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:50.056457 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-5bcfdb0e-ed34-4e09-831f-55e5c86da4c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:50.116150 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfdb0e-ed34-4e09-831f-55e5c86da4c9 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:50.120564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c8827-3514-4d76-b354-54a69f8d80a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:50.121233 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8827-3514-4d76-b354-54a69f8d80a7 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:50.121516 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8827-3514-4d76-b354-54a69f8d80a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:50.121786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8827-3514-4d76-b354-54a69f8d80a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:50.132023 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c8827-3514-4d76-b354-54a69f8d80a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:50.133397 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c8827-3514-4d76-b354-54a69f8d80a7 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:50.143442 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1267/2550] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:21:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:21:50.451157 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b844d71-dc17-4068-a34e-6ac1670149d3 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:50.452202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5b844d71-dc17-4068-a34e-6ac1670149d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:50.466835 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b844d71-dc17-4068-a34e-6ac1670149d3 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:50.472131 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe10f61-5941-4ebf-bca1-0e8839c5ce2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:50.473402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe10f61-5941-4ebf-bca1-0e8839c5ce2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:50.473684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe10f61-5941-4ebf-bca1-0e8839c5ce2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:50.474007 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe10f61-5941-4ebf-bca1-0e8839c5ce2e admin admin] PATH_INFO: `/v3/projects/758c302257e049bbab536432d9ee3fe1` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:50.475459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe10f61-5941-4ebf-bca1-0e8839c5ce2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=758c302257e049bbab536432d9ee3fe1)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:50.477426 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe10f61-5941-4ebf-bca1-0e8839c5ce2e admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:50.534483 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-dbe10f61-5941-4ebf-bca1-0e8839c5ce2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758c302257e049bbab536432d9ee3fe1', 'request_id': 'req-dbe10f61-5941-4ebf-bca1-0e8839c5ce2e'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:50.546085 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-dbe10f61-5941-4ebf-bca1-0e8839c5ce2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758c302257e049bbab536432d9ee3fe1', 'request_id': 'req-dbe10f61-5941-4ebf-bca1-0e8839c5ce2e'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:50.554001 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-dbe10f61-5941-4ebf-bca1-0e8839c5ce2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758c302257e049bbab536432d9ee3fe1', 'request_id': 'req-dbe10f61-5941-4ebf-bca1-0e8839c5ce2e'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:50.567331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-dbe10f61-5941-4ebf-bca1-0e8839c5ce2e admin admin] The token cache is being invalidate because project 758c302257e049bbab536432d9ee3fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:21:50.567739 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-dbe10f61-5941-4ebf-bca1-0e8839c5ce2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:50.568429 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-dbe10f61-5941-4ebf-bca1-0e8839c5ce2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:50.570527 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1284/2551] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:21:50 2022] DELETE /identity/v3/projects/758c302257e049bbab536432d9ee3fe1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:50.574339 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c8827-3514-4d76-b354-54a69f8d80a7 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:50.585256 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c8827-3514-4d76-b354-54a69f8d80a7 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:50.646592 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81430510-f001-4bde-8884-eaf724cfd076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:50.647582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81430510-f001-4bde-8884-eaf724cfd076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:50.648135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81430510-f001-4bde-8884-eaf724cfd076 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:50.648416 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81430510-f001-4bde-8884-eaf724cfd076 admin admin] PATH_INFO: `/v3/users/994e15fcf70d4dfcae06a6cb8ffb50b3` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:50.649806 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81430510-f001-4bde-8884-eaf724cfd076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=994e15fcf70d4dfcae06a6cb8ffb50b3)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:50.651831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81430510-f001-4bde-8884-eaf724cfd076 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:50.700942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-81430510-f001-4bde-8884-eaf724cfd076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '994e15fcf70d4dfcae06a6cb8ffb50b3'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:50.712251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-81430510-f001-4bde-8884-eaf724cfd076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '994e15fcf70d4dfcae06a6cb8ffb50b3'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:50.720176 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-81430510-f001-4bde-8884-eaf724cfd076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '994e15fcf70d4dfcae06a6cb8ffb50b3'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:50.721087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-81430510-f001-4bde-8884-eaf724cfd076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '994e15fcf70d4dfcae06a6cb8ffb50b3'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:50.721717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-81430510-f001-4bde-8884-eaf724cfd076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '994e15fcf70d4dfcae06a6cb8ffb50b3'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:50.739030 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1268/2552] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:21:50 2022] DELETE /identity/v3/users/994e15fcf70d4dfcae06a6cb8ffb50b3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:51.167238 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe10f61-5941-4ebf-bca1-0e8839c5ce2e admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:51.169244 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-dbe10f61-5941-4ebf-bca1-0e8839c5ce2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:51.191847 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe10f61-5941-4ebf-bca1-0e8839c5ce2e admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:51.272904 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931162f6-ed51-43a4-bfd2-dea01d5d2670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:51.273816 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931162f6-ed51-43a4-bfd2-dea01d5d2670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:51.274254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931162f6-ed51-43a4-bfd2-dea01d5d2670 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:51.274542 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931162f6-ed51-43a4-bfd2-dea01d5d2670 admin admin] PATH_INFO: `/v3/projects/d8a4fbd50d4c448882e74584b3775c94` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:51.276014 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931162f6-ed51-43a4-bfd2-dea01d5d2670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a4fbd50d4c448882e74584b3775c94)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:51.277965 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931162f6-ed51-43a4-bfd2-dea01d5d2670 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:51.333948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-931162f6-ed51-43a4-bfd2-dea01d5d2670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a4fbd50d4c448882e74584b3775c94', 'request_id': 'req-931162f6-ed51-43a4-bfd2-dea01d5d2670'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:51.342574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-931162f6-ed51-43a4-bfd2-dea01d5d2670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a4fbd50d4c448882e74584b3775c94', 'request_id': 'req-931162f6-ed51-43a4-bfd2-dea01d5d2670'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:51.349906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-931162f6-ed51-43a4-bfd2-dea01d5d2670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a4fbd50d4c448882e74584b3775c94', 'request_id': 'req-931162f6-ed51-43a4-bfd2-dea01d5d2670'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:51.360453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-931162f6-ed51-43a4-bfd2-dea01d5d2670 admin admin] The token cache is being invalidate because project d8a4fbd50d4c448882e74584b3775c94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:21:51.360766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-931162f6-ed51-43a4-bfd2-dea01d5d2670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:51.361418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-931162f6-ed51-43a4-bfd2-dea01d5d2670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:51.362990 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1285/2553] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:21:51 2022] DELETE /identity/v3/projects/d8a4fbd50d4c448882e74584b3775c94 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:51.368532 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a45017-1e88-40c5-8e9d-cb2a3ec2fcd7 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:51.369419 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a45017-1e88-40c5-8e9d-cb2a3ec2fcd7 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:51.369705 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a45017-1e88-40c5-8e9d-cb2a3ec2fcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:51.388509 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-05a45017-1e88-40c5-8e9d-cb2a3ec2fcd7 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:51.389726 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-05a45017-1e88-40c5-8e9d-cb2a3ec2fcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:51.456106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1269/2554] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:21:51.464167 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3871a-eb43-40ed-8f50-a01ba982e942 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:51.464486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3871a-eb43-40ed-8f50-a01ba982e942 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:51.464766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3871a-eb43-40ed-8f50-a01ba982e942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:51.484816 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-87c3871a-eb43-40ed-8f50-a01ba982e942 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:51.486426 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-87c3871a-eb43-40ed-8f50-a01ba982e942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:51.500310 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1286/2555] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:21:51.505036 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a45017-1e88-40c5-8e9d-cb2a3ec2fcd7 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:51.515338 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a45017-1e88-40c5-8e9d-cb2a3ec2fcd7 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:51.520401 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f388c4-5468-4c57-aa14-1a685425b7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:51.521327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f388c4-5468-4c57-aa14-1a685425b7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:51.521924 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f388c4-5468-4c57-aa14-1a685425b7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:51.522386 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f388c4-5468-4c57-aa14-1a685425b7f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:51.523158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f388c4-5468-4c57-aa14-1a685425b7f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:21:51.523469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f388c4-5468-4c57-aa14-1a685425b7f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:51.525532 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f388c4-5468-4c57-aa14-1a685425b7f6 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:51.543415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1270/2556] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:21:51.547967 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3871a-eb43-40ed-8f50-a01ba982e942 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:51.559229 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3871a-eb43-40ed-8f50-a01ba982e942 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:51.564674 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb77d0-2038-46e3-818c-f1abeb0e8a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:51.565503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb77d0-2038-46e3-818c-f1abeb0e8a1e admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:51.565794 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb77d0-2038-46e3-818c-f1abeb0e8a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:51.566159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb77d0-2038-46e3-818c-f1abeb0e8a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:51.566833 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb77d0-2038-46e3-818c-f1abeb0e8a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:51.568811 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb77d0-2038-46e3-818c-f1abeb0e8a1e admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:51.604812 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1287/2557] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:21:51 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:21:51.606322 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f388c4-5468-4c57-aa14-1a685425b7f6 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:51.617263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f388c4-5468-4c57-aa14-1a685425b7f6 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:51.675470 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af894dbd-2f64-427d-8cb7-38a26b7f554c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:51.676283 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af894dbd-2f64-427d-8cb7-38a26b7f554c admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:51.676568 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af894dbd-2f64-427d-8cb7-38a26b7f554c admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:51.676846 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af894dbd-2f64-427d-8cb7-38a26b7f554c admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:51.677546 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af894dbd-2f64-427d-8cb7-38a26b7f554c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:51.679506 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af894dbd-2f64-427d-8cb7-38a26b7f554c admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:51.705790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1271/2558] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:21:51 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:21:51.710285 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb77d0-2038-46e3-818c-f1abeb0e8a1e admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:51.720613 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb77d0-2038-46e3-818c-f1abeb0e8a1e admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:51.725825 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9cf0c-aa8c-468a-9c40-534891f367e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:51.726490 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9cf0c-aa8c-468a-9c40-534891f367e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:51.726771 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9cf0c-aa8c-468a-9c40-534891f367e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:51.727082 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9cf0c-aa8c-468a-9c40-534891f367e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:51.728623 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9cf0c-aa8c-468a-9c40-534891f367e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:51.730271 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9cf0c-aa8c-468a-9c40-534891f367e4 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:51.741583 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1288/2559] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:21:51.745983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af894dbd-2f64-427d-8cb7-38a26b7f554c admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:51.756608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af894dbd-2f64-427d-8cb7-38a26b7f554c admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:51.761543 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f6908-0be7-412e-a0f4-9387934bfb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:51.762218 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f6908-0be7-412e-a0f4-9387934bfb26 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:51.762506 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f6908-0be7-412e-a0f4-9387934bfb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:51.762785 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f6908-0be7-412e-a0f4-9387934bfb26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:51.763569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f6908-0be7-412e-a0f4-9387934bfb26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:51.765176 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f6908-0be7-412e-a0f4-9387934bfb26 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:51.775228 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1272/2560] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:21:51.779535 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9cf0c-aa8c-468a-9c40-534891f367e4 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:51.789961 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9cf0c-aa8c-468a-9c40-534891f367e4 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:51.794696 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c5985-8ce4-40da-a99d-44dc6c0982c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:51.795701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c5985-8ce4-40da-a99d-44dc6c0982c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:51.795899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c5985-8ce4-40da-a99d-44dc6c0982c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:51.796177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c5985-8ce4-40da-a99d-44dc6c0982c2 admin admin] PATH_INFO: `/v3/projects/438248bcc17d4c7ca76845d98c4d9cd7/users/bfe3b51143ac43e5963d10c9c25d1537/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:51.811991 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c5985-8ce4-40da-a99d-44dc6c0982c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=438248bcc17d4c7ca76845d98c4d9cd7, user_id=bfe3b51143ac43e5963d10c9c25d1537, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:51.814685 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c5985-8ce4-40da-a99d-44dc6c0982c2 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:51.829427 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1289/2561] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:21:51 2022] PUT /identity/v3/projects/438248bcc17d4c7ca76845d98c4d9cd7/users/bfe3b51143ac43e5963d10c9c25d1537/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:21:51.841748 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca686a-00fd-4abe-908e-fa91f9f603fc None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:51.842042 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca686a-00fd-4abe-908e-fa91f9f603fc None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:51.842328 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca686a-00fd-4abe-908e-fa91f9f603fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:51.871783 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-a8ca686a-00fd-4abe-908e-fa91f9f603fc None None] MFA Rules not processed for user `bfe3b51143ac43e5963d10c9c25d1537`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:51.873001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a8ca686a-00fd-4abe-908e-fa91f9f603fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:51.937921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1273/2562] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:21:51.942594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c5985-8ce4-40da-a99d-44dc6c0982c2 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:52.004134 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c5985-8ce4-40da-a99d-44dc6c0982c2 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:52.009651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259563b-bd9b-41a1-8be8-46bfefed1457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:52.010317 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259563b-bd9b-41a1-8be8-46bfefed1457 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:52.010606 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259563b-bd9b-41a1-8be8-46bfefed1457 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:52.010878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259563b-bd9b-41a1-8be8-46bfefed1457 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:52.011631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259563b-bd9b-41a1-8be8-46bfefed1457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:52.013553 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259563b-bd9b-41a1-8be8-46bfefed1457 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:52.041875 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1290/2563] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:21:51 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:21:52.046870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca686a-00fd-4abe-908e-fa91f9f603fc None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:52.058343 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca686a-00fd-4abe-908e-fa91f9f603fc None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:52.115511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7156b-cbff-4c99-9ba5-ef257818f6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:52.116201 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7156b-cbff-4c99-9ba5-ef257818f6ed admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:52.116481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7156b-cbff-4c99-9ba5-ef257818f6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:52.116766 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7156b-cbff-4c99-9ba5-ef257818f6ed admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:52.117480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7156b-cbff-4c99-9ba5-ef257818f6ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:52.119458 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7156b-cbff-4c99-9ba5-ef257818f6ed admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:52.140876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1274/2564] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:21:52 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:21:52.145200 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259563b-bd9b-41a1-8be8-46bfefed1457 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:52.155610 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259563b-bd9b-41a1-8be8-46bfefed1457 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:52.161710 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b75ea-65b8-406f-811a-509fc0d3e6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:52.162388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b75ea-65b8-406f-811a-509fc0d3e6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:52.162677 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b75ea-65b8-406f-811a-509fc0d3e6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:52.162967 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b75ea-65b8-406f-811a-509fc0d3e6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:52.163763 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b75ea-65b8-406f-811a-509fc0d3e6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:52.165642 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b75ea-65b8-406f-811a-509fc0d3e6b2 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:52.177282 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1291/2565] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:21:52.181836 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7156b-cbff-4c99-9ba5-ef257818f6ed admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:52.192922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7156b-cbff-4c99-9ba5-ef257818f6ed admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:52.199156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba3ad6-a168-45f2-8d78-3b166d3b56e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:52.200046 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba3ad6-a168-45f2-8d78-3b166d3b56e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:52.200332 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba3ad6-a168-45f2-8d78-3b166d3b56e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:52.200602 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba3ad6-a168-45f2-8d78-3b166d3b56e4 admin admin] PATH_INFO: `/v3/projects/3c24fc964645438f9fa7f08af5bf0f4b/users/3cac679601f948908d42e9f76fde1b4f/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:52.217244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba3ad6-a168-45f2-8d78-3b166d3b56e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c24fc964645438f9fa7f08af5bf0f4b, user_id=3cac679601f948908d42e9f76fde1b4f, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:52.220124 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba3ad6-a168-45f2-8d78-3b166d3b56e4 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:52.237642 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1275/2566] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:21:52 2022] PUT /identity/v3/projects/3c24fc964645438f9fa7f08af5bf0f4b/users/3cac679601f948908d42e9f76fde1b4f/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:52.242566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b75ea-65b8-406f-811a-509fc0d3e6b2 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:52.253202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b75ea-65b8-406f-811a-509fc0d3e6b2 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:52.312657 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286e62a-26e4-4623-8e1d-c853a2176e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:52.313358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286e62a-26e4-4623-8e1d-c853a2176e3e admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:52.313664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286e62a-26e4-4623-8e1d-c853a2176e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:52.313953 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286e62a-26e4-4623-8e1d-c853a2176e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:52.314742 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286e62a-26e4-4623-8e1d-c853a2176e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:52.316721 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286e62a-26e4-4623-8e1d-c853a2176e3e admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:52.328097 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1292/2567] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:21:52.332511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba3ad6-a168-45f2-8d78-3b166d3b56e4 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:52.343230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba3ad6-a168-45f2-8d78-3b166d3b56e4 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:52.349144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ff0e2-0524-4ef5-9882-b29ceb13de15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:52.350045 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ff0e2-0524-4ef5-9882-b29ceb13de15 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:52.350347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ff0e2-0524-4ef5-9882-b29ceb13de15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:52.350608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ff0e2-0524-4ef5-9882-b29ceb13de15 admin admin] PATH_INFO: `/v3/projects/3c24fc964645438f9fa7f08af5bf0f4b/users/3cac679601f948908d42e9f76fde1b4f/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:52.352683 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ff0e2-0524-4ef5-9882-b29ceb13de15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c24fc964645438f9fa7f08af5bf0f4b, user_id=3cac679601f948908d42e9f76fde1b4f, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:52.352804 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286e62a-26e4-4623-8e1d-c853a2176e3e admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:52.354536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-e286e62a-26e4-4623-8e1d-c853a2176e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:52.355485 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ff0e2-0524-4ef5-9882-b29ceb13de15 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:52.367351 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1276/2568] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:21:52 2022] PUT /identity/v3/projects/3c24fc964645438f9fa7f08af5bf0f4b/users/3cac679601f948908d42e9f76fde1b4f/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:52.377273 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55759bb-3f88-4c04-b7c0-5e93d8061f90 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:52.377907 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55759bb-3f88-4c04-b7c0-5e93d8061f90 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:52.377907 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55759bb-3f88-4c04-b7c0-5e93d8061f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:52.404336 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-e55759bb-3f88-4c04-b7c0-5e93d8061f90 None None] MFA Rules not processed for user `3cac679601f948908d42e9f76fde1b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:52.405577 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e55759bb-3f88-4c04-b7c0-5e93d8061f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:52.419215 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286e62a-26e4-4623-8e1d-c853a2176e3e admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:52.472838 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b1adb-6740-4e55-858e-60cd849e7998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:52.473436 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b1adb-6740-4e55-858e-60cd849e7998 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:52.473719 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b1adb-6740-4e55-858e-60cd849e7998 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:52.474022 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b1adb-6740-4e55-858e-60cd849e7998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:52.476037 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-dd9b1adb-6740-4e55-858e-60cd849e7998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:52.477870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1277/2569] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:52 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 22:21:52.489465 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55759bb-3f88-4c04-b7c0-5e93d8061f90 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:52.490838 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e55759bb-3f88-4c04-b7c0-5e93d8061f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:52.538795 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b1adb-6740-4e55-858e-60cd849e7998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:52.540438 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b1adb-6740-4e55-858e-60cd849e7998 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:52.546753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55759bb-3f88-4c04-b7c0-5e93d8061f90 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:52.550030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1293/2570] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:21:52.551417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea1797-ed60-4a42-8d6d-262136c5a563 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:52.552141 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea1797-ed60-4a42-8d6d-262136c5a563 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:52.552522 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea1797-ed60-4a42-8d6d-262136c5a563 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:52.552826 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea1797-ed60-4a42-8d6d-262136c5a563 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:52.565237 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea1797-ed60-4a42-8d6d-262136c5a563 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:52.571247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea1797-ed60-4a42-8d6d-262136c5a563 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:52.594080 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1278/2571] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:21:52 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:21:52.683009 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b1adb-6740-4e55-858e-60cd849e7998 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:52.692458 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b1adb-6740-4e55-858e-60cd849e7998 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:52.696132 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655fd2b-8137-41df-95fc-4a72b19758f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:52.696797 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655fd2b-8137-41df-95fc-4a72b19758f5 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:52.697109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655fd2b-8137-41df-95fc-4a72b19758f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:52.697388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655fd2b-8137-41df-95fc-4a72b19758f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:52.759094 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655fd2b-8137-41df-95fc-4a72b19758f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:52.760730 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655fd2b-8137-41df-95fc-4a72b19758f5 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:52.776015 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1294/2572] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:21:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:21:56.060035 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea1797-ed60-4a42-8d6d-262136c5a563 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:56.061700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-79ea1797-ed60-4a42-8d6d-262136c5a563 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:56.076921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea1797-ed60-4a42-8d6d-262136c5a563 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:56.082969 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a887087-b886-4058-b30d-de5ae9b534ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:56.083892 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a887087-b886-4058-b30d-de5ae9b534ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:56.084174 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a887087-b886-4058-b30d-de5ae9b534ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:56.084452 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a887087-b886-4058-b30d-de5ae9b534ef admin admin] PATH_INFO: `/v3/users/440a9798bf914da4af0398483e23e33c` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:56.085684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a887087-b886-4058-b30d-de5ae9b534ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=440a9798bf914da4af0398483e23e33c)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:56.087684 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a887087-b886-4058-b30d-de5ae9b534ef admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:56.141994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0a887087-b886-4058-b30d-de5ae9b534ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '440a9798bf914da4af0398483e23e33c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:56.152393 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0a887087-b886-4058-b30d-de5ae9b534ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '440a9798bf914da4af0398483e23e33c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:56.160588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0a887087-b886-4058-b30d-de5ae9b534ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '440a9798bf914da4af0398483e23e33c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:56.161274 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0a887087-b886-4058-b30d-de5ae9b534ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '440a9798bf914da4af0398483e23e33c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:56.161874 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0a887087-b886-4058-b30d-de5ae9b534ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '440a9798bf914da4af0398483e23e33c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:56.179957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1279/2573] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:21:56 2022] DELETE /identity/v3/users/440a9798bf914da4af0398483e23e33c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:56.375176 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655fd2b-8137-41df-95fc-4a72b19758f5 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:56.394328 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655fd2b-8137-41df-95fc-4a72b19758f5 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:56.465384 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0da7c-7e13-4268-a678-38b36579be0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:56.469021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0da7c-7e13-4268-a678-38b36579be0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:56.469304 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0da7c-7e13-4268-a678-38b36579be0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:56.469655 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0da7c-7e13-4268-a678-38b36579be0c admin admin] PATH_INFO: `/v3/projects/41ec8820e4eb4796a959c58da599f5df` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:56.470913 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0da7c-7e13-4268-a678-38b36579be0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=41ec8820e4eb4796a959c58da599f5df)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:56.473329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0da7c-7e13-4268-a678-38b36579be0c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:56.520917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d8d0da7c-7e13-4268-a678-38b36579be0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ec8820e4eb4796a959c58da599f5df', 'request_id': 'req-d8d0da7c-7e13-4268-a678-38b36579be0c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:56.532862 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d8d0da7c-7e13-4268-a678-38b36579be0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ec8820e4eb4796a959c58da599f5df', 'request_id': 'req-d8d0da7c-7e13-4268-a678-38b36579be0c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:56.541193 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d8d0da7c-7e13-4268-a678-38b36579be0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ec8820e4eb4796a959c58da599f5df', 'request_id': 'req-d8d0da7c-7e13-4268-a678-38b36579be0c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:56.552013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d8d0da7c-7e13-4268-a678-38b36579be0c admin admin] The token cache is being invalidate because project 41ec8820e4eb4796a959c58da599f5df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:21:56.552951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d8d0da7c-7e13-4268-a678-38b36579be0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:56.553696 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d8d0da7c-7e13-4268-a678-38b36579be0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:56.555560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1295/2574] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:21:56 2022] DELETE /identity/v3/projects/41ec8820e4eb4796a959c58da599f5df => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:56.566627 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b06f6-14d8-4962-ac7e-e89988883552 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:56.567666 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b06f6-14d8-4962-ac7e-e89988883552 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:56.568162 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b06f6-14d8-4962-ac7e-e89988883552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:56.602928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-ac0b06f6-14d8-4962-ac7e-e89988883552 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:56.604252 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ac0b06f6-14d8-4962-ac7e-e89988883552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:56.668634 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1280/2575] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:21:56.677437 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066669ce-35d1-45e3-8106-ef471d3072a1 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:56.677758 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066669ce-35d1-45e3-8106-ef471d3072a1 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:56.678040 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066669ce-35d1-45e3-8106-ef471d3072a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:56.698112 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-066669ce-35d1-45e3-8106-ef471d3072a1 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:56.699346 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-066669ce-35d1-45e3-8106-ef471d3072a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:56.709416 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1296/2576] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:21:56.714143 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b06f6-14d8-4962-ac7e-e89988883552 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:56.724876 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b06f6-14d8-4962-ac7e-e89988883552 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:56.730186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f076e-8bf7-4baa-b050-681a19156727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:56.730902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f076e-8bf7-4baa-b050-681a19156727 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:56.731202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f076e-8bf7-4baa-b050-681a19156727 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:56.731480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f076e-8bf7-4baa-b050-681a19156727 admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:56.732209 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f076e-8bf7-4baa-b050-681a19156727 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:21:56.732523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f076e-8bf7-4baa-b050-681a19156727 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:56.734149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f076e-8bf7-4baa-b050-681a19156727 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:56.746895 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1281/2577] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:21:56.751522 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066669ce-35d1-45e3-8106-ef471d3072a1 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:56.766803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066669ce-35d1-45e3-8106-ef471d3072a1 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:56.772537 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf97f4-d487-4e83-9268-54a6193f8581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:56.773214 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf97f4-d487-4e83-9268-54a6193f8581 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:56.773501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf97f4-d487-4e83-9268-54a6193f8581 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:56.773779 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf97f4-d487-4e83-9268-54a6193f8581 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:56.774494 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf97f4-d487-4e83-9268-54a6193f8581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:56.776554 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf97f4-d487-4e83-9268-54a6193f8581 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:56.804590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1297/2578] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:21:56 2022] POST /identity/v3/projects => generated 357 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:21:56.809124 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f076e-8bf7-4baa-b050-681a19156727 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:56.819397 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f076e-8bf7-4baa-b050-681a19156727 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:56.879355 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7a185-4c80-415d-b81d-1e835c87852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:56.880040 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7a185-4c80-415d-b81d-1e835c87852f admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:56.880317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7a185-4c80-415d-b81d-1e835c87852f admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:56.880596 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7a185-4c80-415d-b81d-1e835c87852f admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:56.881294 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7a185-4c80-415d-b81d-1e835c87852f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:56.883297 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7a185-4c80-415d-b81d-1e835c87852f admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:56.908111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1282/2579] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:21:56 2022] POST /identity/v3/users => generated 279 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:21:56.913249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf97f4-d487-4e83-9268-54a6193f8581 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:56.924947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf97f4-d487-4e83-9268-54a6193f8581 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:56.930928 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd3b85-685a-44b3-ba12-f06e23fe99d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:56.931630 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd3b85-685a-44b3-ba12-f06e23fe99d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:56.931910 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd3b85-685a-44b3-ba12-f06e23fe99d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:56.932183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd3b85-685a-44b3-ba12-f06e23fe99d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:56.932928 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd3b85-685a-44b3-ba12-f06e23fe99d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:56.934535 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd3b85-685a-44b3-ba12-f06e23fe99d5 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:56.946624 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1298/2580] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:21:56.951229 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7a185-4c80-415d-b81d-1e835c87852f admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:56.962591 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7a185-4c80-415d-b81d-1e835c87852f admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:56.968096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e497b7-06fb-44ec-9428-4853524f5b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:56.968765 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e497b7-06fb-44ec-9428-4853524f5b08 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:56.969052 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e497b7-06fb-44ec-9428-4853524f5b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:56.969327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e497b7-06fb-44ec-9428-4853524f5b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:56.970083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e497b7-06fb-44ec-9428-4853524f5b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:56.971730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e497b7-06fb-44ec-9428-4853524f5b08 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:56.981908 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1283/2581] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:21:56.986738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd3b85-685a-44b3-ba12-f06e23fe99d5 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:56.997832 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd3b85-685a-44b3-ba12-f06e23fe99d5 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:57.003957 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d4cd5-43cd-4884-b79c-8c5352650306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:57.005067 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d4cd5-43cd-4884-b79c-8c5352650306 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:57.005386 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d4cd5-43cd-4884-b79c-8c5352650306 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:57.005795 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d4cd5-43cd-4884-b79c-8c5352650306 admin admin] PATH_INFO: `/v3/projects/398dd487b2e849b186b94e3285901b48/users/373efde97bea429ebaaa18113f4c1926/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:57.021313 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d4cd5-43cd-4884-b79c-8c5352650306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398dd487b2e849b186b94e3285901b48, user_id=373efde97bea429ebaaa18113f4c1926, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:57.024069 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d4cd5-43cd-4884-b79c-8c5352650306 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:57.042724 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1299/2582] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:21:56 2022] PUT /identity/v3/projects/398dd487b2e849b186b94e3285901b48/users/373efde97bea429ebaaa18113f4c1926/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:57.054885 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6f638-66eb-4fc3-9907-65e9cd12545d None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:57.055127 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6f638-66eb-4fc3-9907-65e9cd12545d None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:57.055491 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6f638-66eb-4fc3-9907-65e9cd12545d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:57.087829 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-c2a6f638-66eb-4fc3-9907-65e9cd12545d None None] MFA Rules not processed for user `373efde97bea429ebaaa18113f4c1926`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:57.089574 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c2a6f638-66eb-4fc3-9907-65e9cd12545d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:57.163968 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1284/2583] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:57 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:21:57.168594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d4cd5-43cd-4884-b79c-8c5352650306 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:57.233920 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d4cd5-43cd-4884-b79c-8c5352650306 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:57.239510 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0e030-8e98-4f84-968e-fb285302f8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:57.240167 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0e030-8e98-4f84-968e-fb285302f8ed admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:57.240585 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0e030-8e98-4f84-968e-fb285302f8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:57.240878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0e030-8e98-4f84-968e-fb285302f8ed admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:57.241738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0e030-8e98-4f84-968e-fb285302f8ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:57.243708 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0e030-8e98-4f84-968e-fb285302f8ed admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:57.272783 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1300/2584] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:21:57 2022] POST /identity/v3/projects => generated 357 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:21:57.277721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6f638-66eb-4fc3-9907-65e9cd12545d None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:57.289970 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6f638-66eb-4fc3-9907-65e9cd12545d None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:57.354655 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3a491-f735-4a01-b254-1ef0d779ad81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:57.355268 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3a491-f735-4a01-b254-1ef0d779ad81 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:57.355549 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3a491-f735-4a01-b254-1ef0d779ad81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:57.355820 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3a491-f735-4a01-b254-1ef0d779ad81 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:57.356506 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3a491-f735-4a01-b254-1ef0d779ad81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:57.358816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3a491-f735-4a01-b254-1ef0d779ad81 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:57.384980 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1285/2585] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:21:57 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:21:57.389536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0e030-8e98-4f84-968e-fb285302f8ed admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:57.400118 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0e030-8e98-4f84-968e-fb285302f8ed admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:57.405128 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15e824-0487-43b1-8e08-8825342e9757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:57.405842 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15e824-0487-43b1-8e08-8825342e9757 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:57.406159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15e824-0487-43b1-8e08-8825342e9757 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:57.406462 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15e824-0487-43b1-8e08-8825342e9757 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:57.407268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15e824-0487-43b1-8e08-8825342e9757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:57.409030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15e824-0487-43b1-8e08-8825342e9757 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:57.420898 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1301/2586] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:21:57.425384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3a491-f735-4a01-b254-1ef0d779ad81 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:57.435566 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3a491-f735-4a01-b254-1ef0d779ad81 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:57.441194 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7debc7-272a-47d0-86d5-14b653701e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:57.442096 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7debc7-272a-47d0-86d5-14b653701e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:57.442377 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7debc7-272a-47d0-86d5-14b653701e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:57.442661 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7debc7-272a-47d0-86d5-14b653701e52 admin admin] PATH_INFO: `/v3/projects/9882afe73ef14f898b797a52e7989dc2/users/4b3f880d5f22476aad4011be08a37424/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:57.458449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7debc7-272a-47d0-86d5-14b653701e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9882afe73ef14f898b797a52e7989dc2, user_id=4b3f880d5f22476aad4011be08a37424, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:57.461293 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7debc7-272a-47d0-86d5-14b653701e52 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:57.480641 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1286/2587] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:21:57 2022] PUT /identity/v3/projects/9882afe73ef14f898b797a52e7989dc2/users/4b3f880d5f22476aad4011be08a37424/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:57.486543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15e824-0487-43b1-8e08-8825342e9757 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:57.501545 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15e824-0487-43b1-8e08-8825342e9757 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:57.563342 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ac303-a9cb-4c12-a937-32eabcf25651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:57.564108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ac303-a9cb-4c12-a937-32eabcf25651 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:57.564417 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ac303-a9cb-4c12-a937-32eabcf25651 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:57.564698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ac303-a9cb-4c12-a937-32eabcf25651 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:57.565436 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ac303-a9cb-4c12-a937-32eabcf25651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:57.567205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ac303-a9cb-4c12-a937-32eabcf25651 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:57.577615 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1302/2588] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:21:57.582453 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7debc7-272a-47d0-86d5-14b653701e52 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:57.593062 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7debc7-272a-47d0-86d5-14b653701e52 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:57.599170 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b72b41-8b1f-4a32-a9c6-b765b067c38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:57.600151 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b72b41-8b1f-4a32-a9c6-b765b067c38a admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:57.600551 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b72b41-8b1f-4a32-a9c6-b765b067c38a admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:57.600974 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b72b41-8b1f-4a32-a9c6-b765b067c38a admin admin] PATH_INFO: `/v3/projects/9882afe73ef14f898b797a52e7989dc2/users/4b3f880d5f22476aad4011be08a37424/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:57.603255 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b72b41-8b1f-4a32-a9c6-b765b067c38a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9882afe73ef14f898b797a52e7989dc2, user_id=4b3f880d5f22476aad4011be08a37424, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:57.606716 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b72b41-8b1f-4a32-a9c6-b765b067c38a admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:57.620476 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1287/2589] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:21:57 2022] PUT /identity/v3/projects/9882afe73ef14f898b797a52e7989dc2/users/4b3f880d5f22476aad4011be08a37424/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:21:57.632394 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aba742-1a5b-4638-8cd8-26881c690af8 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:57.633230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aba742-1a5b-4638-8cd8-26881c690af8 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:57.633230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aba742-1a5b-4638-8cd8-26881c690af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:57.669219 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-13aba742-1a5b-4638-8cd8-26881c690af8 None None] MFA Rules not processed for user `4b3f880d5f22476aad4011be08a37424`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:57.670837 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-13aba742-1a5b-4638-8cd8-26881c690af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:57.741713 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1303/2590] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:57 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:21:57.756680 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b72b41-8b1f-4a32-a9c6-b765b067c38a admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:57.758431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-65b72b41-8b1f-4a32-a9c6-b765b067c38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:57.774479 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aba742-1a5b-4638-8cd8-26881c690af8 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:57.776052 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-13aba742-1a5b-4638-8cd8-26881c690af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:57.816837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b72b41-8b1f-4a32-a9c6-b765b067c38a admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:57.820928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbb6a8-6a6a-4f6e-b1f4-f818a82c1719 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:57.821863 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbb6a8-6a6a-4f6e-b1f4-f818a82c1719 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:57.822295 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbb6a8-6a6a-4f6e-b1f4-f818a82c1719 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:57.822733 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbb6a8-6a6a-4f6e-b1f4-f818a82c1719 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:57.833923 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbb6a8-6a6a-4f6e-b1f4-f818a82c1719 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:57.835410 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbb6a8-6a6a-4f6e-b1f4-f818a82c1719 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:57.841344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aba742-1a5b-4638-8cd8-26881c690af8 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:57.845200 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1288/2591] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:21:57 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:21:57.846450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264be192-206f-4b6a-8591-62df794c6740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:57.847639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264be192-206f-4b6a-8591-62df794c6740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:57.848035 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264be192-206f-4b6a-8591-62df794c6740 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:57.848344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264be192-206f-4b6a-8591-62df794c6740 admin admin] PATH_INFO: `/v3/users/bfe3b51143ac43e5963d10c9c25d1537` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:57.849640 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264be192-206f-4b6a-8591-62df794c6740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe3b51143ac43e5963d10c9c25d1537)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:57.851835 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264be192-206f-4b6a-8591-62df794c6740 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:57.904034 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-264be192-206f-4b6a-8591-62df794c6740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe3b51143ac43e5963d10c9c25d1537'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:57.911744 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-264be192-206f-4b6a-8591-62df794c6740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe3b51143ac43e5963d10c9c25d1537'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:57.912502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-264be192-206f-4b6a-8591-62df794c6740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe3b51143ac43e5963d10c9c25d1537'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:57.921793 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbb6a8-6a6a-4f6e-b1f4-f818a82c1719 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:57.924653 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-264be192-206f-4b6a-8591-62df794c6740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe3b51143ac43e5963d10c9c25d1537'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:57.930694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbb6a8-6a6a-4f6e-b1f4-f818a82c1719 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:57.934957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619044d-f303-4c2b-b036-dc32c8bb2273 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:57.935633 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619044d-f303-4c2b-b036-dc32c8bb2273 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:57.935918 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619044d-f303-4c2b-b036-dc32c8bb2273 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:57.936200 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619044d-f303-4c2b-b036-dc32c8bb2273 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:57.936657 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-264be192-206f-4b6a-8591-62df794c6740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe3b51143ac43e5963d10c9c25d1537'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:57.938171 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-3619044d-f303-4c2b-b036-dc32c8bb2273 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:57.943325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1304/2592] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:21:57 2022] DELETE /identity/v3/users/bfe3b51143ac43e5963d10c9c25d1537 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:21:57.947943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f025e4-3c8f-410e-a23d-1d7f8e7391c6 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:57.948235 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f025e4-3c8f-410e-a23d-1d7f8e7391c6 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:57.948510 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f025e4-3c8f-410e-a23d-1d7f8e7391c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:57.966082 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-90f025e4-3c8f-410e-a23d-1d7f8e7391c6 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:57.967318 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-90f025e4-3c8f-410e-a23d-1d7f8e7391c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:58.001888 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619044d-f303-4c2b-b036-dc32c8bb2273 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:58.003374 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619044d-f303-4c2b-b036-dc32c8bb2273 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:58.011969 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1289/2593] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:21:57 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:21:58.027450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1305/2594] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:21:58.037608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619044d-f303-4c2b-b036-dc32c8bb2273 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:58.039028 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-3619044d-f303-4c2b-b036-dc32c8bb2273 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:58.096984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619044d-f303-4c2b-b036-dc32c8bb2273 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:58.150160 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e1fe4-b9d3-4003-975a-2ab8fac3a82c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:58.150860 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e1fe4-b9d3-4003-975a-2ab8fac3a82c service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:58.151181 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e1fe4-b9d3-4003-975a-2ab8fac3a82c service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:58.151462 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e1fe4-b9d3-4003-975a-2ab8fac3a82c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:58.160576 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e1fe4-b9d3-4003-975a-2ab8fac3a82c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:58.162017 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e1fe4-b9d3-4003-975a-2ab8fac3a82c service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:58.171377 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1290/2595] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:21:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:21:58.450955 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f025e4-3c8f-410e-a23d-1d7f8e7391c6 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:58.452643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-90f025e4-3c8f-410e-a23d-1d7f8e7391c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:58.467583 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f025e4-3c8f-410e-a23d-1d7f8e7391c6 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:58.473826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab168d-69a5-4ecf-a469-313a66dc6ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:58.474877 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab168d-69a5-4ecf-a469-313a66dc6ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:58.475195 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab168d-69a5-4ecf-a469-313a66dc6ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:58.475469 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab168d-69a5-4ecf-a469-313a66dc6ab0 admin admin] PATH_INFO: `/v3/projects/438248bcc17d4c7ca76845d98c4d9cd7` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:58.476699 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab168d-69a5-4ecf-a469-313a66dc6ab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=438248bcc17d4c7ca76845d98c4d9cd7)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:58.478734 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab168d-69a5-4ecf-a469-313a66dc6ab0 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:58.529157 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-52ab168d-69a5-4ecf-a469-313a66dc6ab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '438248bcc17d4c7ca76845d98c4d9cd7', 'request_id': 'req-52ab168d-69a5-4ecf-a469-313a66dc6ab0'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:58.538585 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-52ab168d-69a5-4ecf-a469-313a66dc6ab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '438248bcc17d4c7ca76845d98c4d9cd7', 'request_id': 'req-52ab168d-69a5-4ecf-a469-313a66dc6ab0'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:58.544843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-52ab168d-69a5-4ecf-a469-313a66dc6ab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '438248bcc17d4c7ca76845d98c4d9cd7', 'request_id': 'req-52ab168d-69a5-4ecf-a469-313a66dc6ab0'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:58.555494 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-52ab168d-69a5-4ecf-a469-313a66dc6ab0 admin admin] The token cache is being invalidate because project 438248bcc17d4c7ca76845d98c4d9cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:21:58.555792 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-52ab168d-69a5-4ecf-a469-313a66dc6ab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:58.556415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-52ab168d-69a5-4ecf-a469-313a66dc6ab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:58.558318 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1306/2596] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:21:58 2022] DELETE /identity/v3/projects/438248bcc17d4c7ca76845d98c4d9cd7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:58.562516 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e1fe4-b9d3-4003-975a-2ab8fac3a82c service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:58.575365 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e1fe4-b9d3-4003-975a-2ab8fac3a82c service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:58.640633 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1266aa-3869-4b2e-a32e-3ed25b6ca5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:58.641435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1266aa-3869-4b2e-a32e-3ed25b6ca5ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:58.641715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1266aa-3869-4b2e-a32e-3ed25b6ca5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:58.642310 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1266aa-3869-4b2e-a32e-3ed25b6ca5ad admin admin] PATH_INFO: `/v3/users/3cac679601f948908d42e9f76fde1b4f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:58.643469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1266aa-3869-4b2e-a32e-3ed25b6ca5ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cac679601f948908d42e9f76fde1b4f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:58.645539 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1266aa-3869-4b2e-a32e-3ed25b6ca5ad admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:58.707195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-ac1266aa-3869-4b2e-a32e-3ed25b6ca5ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cac679601f948908d42e9f76fde1b4f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:58.716260 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-ac1266aa-3869-4b2e-a32e-3ed25b6ca5ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cac679601f948908d42e9f76fde1b4f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:58.724921 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-ac1266aa-3869-4b2e-a32e-3ed25b6ca5ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cac679601f948908d42e9f76fde1b4f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:58.735414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-ac1266aa-3869-4b2e-a32e-3ed25b6ca5ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cac679601f948908d42e9f76fde1b4f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:58.736162 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-ac1266aa-3869-4b2e-a32e-3ed25b6ca5ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cac679601f948908d42e9f76fde1b4f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:58.754611 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1291/2597] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:21:58 2022] DELETE /identity/v3/users/3cac679601f948908d42e9f76fde1b4f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:59.045248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab168d-69a5-4ecf-a469-313a66dc6ab0 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:59.047327 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-52ab168d-69a5-4ecf-a469-313a66dc6ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:59.062443 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab168d-69a5-4ecf-a469-313a66dc6ab0 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:59.118122 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561d6ec-49d2-4025-8bb8-885eb16ebe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:59.118983 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561d6ec-49d2-4025-8bb8-885eb16ebe6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:59.119292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561d6ec-49d2-4025-8bb8-885eb16ebe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:59.119591 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561d6ec-49d2-4025-8bb8-885eb16ebe6b admin admin] PATH_INFO: `/v3/projects/3c24fc964645438f9fa7f08af5bf0f4b` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:59.120806 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561d6ec-49d2-4025-8bb8-885eb16ebe6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c24fc964645438f9fa7f08af5bf0f4b)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:59.122736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561d6ec-49d2-4025-8bb8-885eb16ebe6b admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:59.171374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-1561d6ec-49d2-4025-8bb8-885eb16ebe6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c24fc964645438f9fa7f08af5bf0f4b', 'request_id': 'req-1561d6ec-49d2-4025-8bb8-885eb16ebe6b'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:59.180490 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-1561d6ec-49d2-4025-8bb8-885eb16ebe6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c24fc964645438f9fa7f08af5bf0f4b', 'request_id': 'req-1561d6ec-49d2-4025-8bb8-885eb16ebe6b'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:59.187561 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-1561d6ec-49d2-4025-8bb8-885eb16ebe6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c24fc964645438f9fa7f08af5bf0f4b', 'request_id': 'req-1561d6ec-49d2-4025-8bb8-885eb16ebe6b'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:59.199764 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-1561d6ec-49d2-4025-8bb8-885eb16ebe6b admin admin] The token cache is being invalidate because project 3c24fc964645438f9fa7f08af5bf0f4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:21:59.200050 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-1561d6ec-49d2-4025-8bb8-885eb16ebe6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:59.200884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-1561d6ec-49d2-4025-8bb8-885eb16ebe6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:21:59.203018 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1307/2598] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:21:59 2022] DELETE /identity/v3/projects/3c24fc964645438f9fa7f08af5bf0f4b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:59.208420 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8281d90-7d18-4cfc-b18e-e7649248b995 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:59.208948 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8281d90-7d18-4cfc-b18e-e7649248b995 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:59.209056 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8281d90-7d18-4cfc-b18e-e7649248b995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:59.228497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-c8281d90-7d18-4cfc-b18e-e7649248b995 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:59.229844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c8281d90-7d18-4cfc-b18e-e7649248b995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:59.296732 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1292/2599] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:21:59.298086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304f8e4-7a12-4141-8fe6-cd03c894c4fc None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:59.298414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304f8e4-7a12-4141-8fe6-cd03c894c4fc None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:59.298693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304f8e4-7a12-4141-8fe6-cd03c894c4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:59.321679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-4304f8e4-7a12-4141-8fe6-cd03c894c4fc None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:59.322915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-4304f8e4-7a12-4141-8fe6-cd03c894c4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:59.331255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1308/2600] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 22:21:59.336162 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8281d90-7d18-4cfc-b18e-e7649248b995 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:59.345696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8281d90-7d18-4cfc-b18e-e7649248b995 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:59.350471 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba1110-21bb-41a4-9a1b-71448ee1d3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:59.351172 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba1110-21bb-41a4-9a1b-71448ee1d3ac admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:59.351453 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba1110-21bb-41a4-9a1b-71448ee1d3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:59.351726 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba1110-21bb-41a4-9a1b-71448ee1d3ac admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:59.352457 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba1110-21bb-41a4-9a1b-71448ee1d3ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:21:59.352758 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba1110-21bb-41a4-9a1b-71448ee1d3ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:59.354372 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba1110-21bb-41a4-9a1b-71448ee1d3ac admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:59.369297 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1293/2601] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:21:59.374427 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304f8e4-7a12-4141-8fe6-cd03c894c4fc None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:59.387498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304f8e4-7a12-4141-8fe6-cd03c894c4fc None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:59.395546 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eb092-6f1c-4003-b24e-383972e48b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:59.396207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eb092-6f1c-4003-b24e-383972e48b68 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:59.396480 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eb092-6f1c-4003-b24e-383972e48b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:59.396771 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eb092-6f1c-4003-b24e-383972e48b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:59.397475 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684eb092-6f1c-4003-b24e-383972e48b68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:59.399430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684eb092-6f1c-4003-b24e-383972e48b68 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:59.428171 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1309/2602] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:21:59 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:21:59.433264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba1110-21bb-41a4-9a1b-71448ee1d3ac admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:59.444893 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba1110-21bb-41a4-9a1b-71448ee1d3ac admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:59.506408 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff9f1c-585c-46e1-bece-00e74e1b4046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:59.507175 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff9f1c-585c-46e1-bece-00e74e1b4046 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:59.507459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff9f1c-585c-46e1-bece-00e74e1b4046 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:59.507721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff9f1c-585c-46e1-bece-00e74e1b4046 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:59.508438 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff9f1c-585c-46e1-bece-00e74e1b4046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:59.510349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff9f1c-585c-46e1-bece-00e74e1b4046 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:59.533454 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1294/2603] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:21:59 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:21:59.538458 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eb092-6f1c-4003-b24e-383972e48b68 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:59.548835 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eb092-6f1c-4003-b24e-383972e48b68 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:59.553900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ecf2e-e5e7-46fe-ae32-cdb1fcca0d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:59.554567 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ecf2e-e5e7-46fe-ae32-cdb1fcca0d79 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:59.554851 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ecf2e-e5e7-46fe-ae32-cdb1fcca0d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:59.555163 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ecf2e-e5e7-46fe-ae32-cdb1fcca0d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:59.555921 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ecf2e-e5e7-46fe-ae32-cdb1fcca0d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:59.557528 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ecf2e-e5e7-46fe-ae32-cdb1fcca0d79 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:59.571069 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1310/2604] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:21:59.572288 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff9f1c-585c-46e1-bece-00e74e1b4046 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:59.582799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff9f1c-585c-46e1-bece-00e74e1b4046 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:59.587919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61029c-f944-4a0c-80eb-f07245c6de1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:59.588566 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61029c-f944-4a0c-80eb-f07245c6de1d admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:59.588847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61029c-f944-4a0c-80eb-f07245c6de1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:59.589119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61029c-f944-4a0c-80eb-f07245c6de1d admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:59.589849 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61029c-f944-4a0c-80eb-f07245c6de1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:59.591510 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61029c-f944-4a0c-80eb-f07245c6de1d admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:59.601796 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1295/2605] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:21:59.606034 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ecf2e-e5e7-46fe-ae32-cdb1fcca0d79 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:59.615841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ecf2e-e5e7-46fe-ae32-cdb1fcca0d79 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:59.620873 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9feaab-cd95-4556-aabd-6acc43ebc40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:59.621737 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9feaab-cd95-4556-aabd-6acc43ebc40d admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:59.622026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9feaab-cd95-4556-aabd-6acc43ebc40d admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:59.622299 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9feaab-cd95-4556-aabd-6acc43ebc40d admin admin] PATH_INFO: `/v3/projects/4cbf47f3374643bb83221ac22ed56756/users/8a0bd3933bb94de0a494e0b5986a1fdf/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:59.636743 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9feaab-cd95-4556-aabd-6acc43ebc40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cbf47f3374643bb83221ac22ed56756, user_id=8a0bd3933bb94de0a494e0b5986a1fdf, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:59.639455 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9feaab-cd95-4556-aabd-6acc43ebc40d admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:59.654944 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1311/2606] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:21:59 2022] PUT /identity/v3/projects/4cbf47f3374643bb83221ac22ed56756/users/8a0bd3933bb94de0a494e0b5986a1fdf/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:21:59.666100 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e082fd-d11e-4cdd-b7aa-aed8a810f209 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:59.666397 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e082fd-d11e-4cdd-b7aa-aed8a810f209 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:59.666676 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e082fd-d11e-4cdd-b7aa-aed8a810f209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:59.695026 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-26e082fd-d11e-4cdd-b7aa-aed8a810f209 None None] MFA Rules not processed for user `8a0bd3933bb94de0a494e0b5986a1fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:21:59.696259 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-26e082fd-d11e-4cdd-b7aa-aed8a810f209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:21:59.762260 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1296/2607] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:21:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:21:59.766897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9feaab-cd95-4556-aabd-6acc43ebc40d admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:59.825222 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9feaab-cd95-4556-aabd-6acc43ebc40d admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:59.831310 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b072c7-2439-4f6b-9db0-755491c54aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:59.831985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b072c7-2439-4f6b-9db0-755491c54aae admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:59.832280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b072c7-2439-4f6b-9db0-755491c54aae admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:59.832558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b072c7-2439-4f6b-9db0-755491c54aae admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:59.833255 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b072c7-2439-4f6b-9db0-755491c54aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:59.835266 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b072c7-2439-4f6b-9db0-755491c54aae admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:59.864470 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1312/2608] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:21:59 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:21:59.868691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e082fd-d11e-4cdd-b7aa-aed8a810f209 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:59.880427 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e082fd-d11e-4cdd-b7aa-aed8a810f209 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:59.937446 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe3cc4-e4f3-45bf-8998-f37bc9406e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:59.938046 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe3cc4-e4f3-45bf-8998-f37bc9406e75 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:59.938329 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe3cc4-e4f3-45bf-8998-f37bc9406e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:59.938607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe3cc4-e4f3-45bf-8998-f37bc9406e75 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:59.939327 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe3cc4-e4f3-45bf-8998-f37bc9406e75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:59.941302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe3cc4-e4f3-45bf-8998-f37bc9406e75 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:21:59.965813 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1297/2609] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:21:59 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:21:59.970499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b072c7-2439-4f6b-9db0-755491c54aae admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:21:59.986477 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b072c7-2439-4f6b-9db0-755491c54aae admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:21:59.992903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c58cf-aa0f-42fd-bd58-f1c10cf77e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:21:59.993573 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c58cf-aa0f-42fd-bd58-f1c10cf77e28 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:21:59.993862 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c58cf-aa0f-42fd-bd58-f1c10cf77e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:21:59.994137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c58cf-aa0f-42fd-bd58-f1c10cf77e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:21:59.994874 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c58cf-aa0f-42fd-bd58-f1c10cf77e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:21:59.996504 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c58cf-aa0f-42fd-bd58-f1c10cf77e28 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:00.007327 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1313/2610] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:00.011605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe3cc4-e4f3-45bf-8998-f37bc9406e75 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:00.022024 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe3cc4-e4f3-45bf-8998-f37bc9406e75 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:00.028097 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a3ea3-a044-4322-9ade-6541fcae47d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:00.028985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a3ea3-a044-4322-9ade-6541fcae47d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:00.029269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a3ea3-a044-4322-9ade-6541fcae47d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:00.029552 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a3ea3-a044-4322-9ade-6541fcae47d7 admin admin] PATH_INFO: `/v3/projects/c8dc2017088346f4b8557dd6c2ecc991/users/77ac7cec82b647c0bc04d2bd551e819c/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:00.044913 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a3ea3-a044-4322-9ade-6541fcae47d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8dc2017088346f4b8557dd6c2ecc991, user_id=77ac7cec82b647c0bc04d2bd551e819c, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:00.047631 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a3ea3-a044-4322-9ade-6541fcae47d7 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:00.063238 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1298/2611] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:00 2022] PUT /identity/v3/projects/c8dc2017088346f4b8557dd6c2ecc991/users/77ac7cec82b647c0bc04d2bd551e819c/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:00.067553 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c58cf-aa0f-42fd-bd58-f1c10cf77e28 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:00.077600 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c58cf-aa0f-42fd-bd58-f1c10cf77e28 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:00.136909 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26642fa8-926b-49b8-b03e-f9ead87c597c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:00.137574 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26642fa8-926b-49b8-b03e-f9ead87c597c admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:00.137871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26642fa8-926b-49b8-b03e-f9ead87c597c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:00.138155 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26642fa8-926b-49b8-b03e-f9ead87c597c admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:00.138893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26642fa8-926b-49b8-b03e-f9ead87c597c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:00.140530 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26642fa8-926b-49b8-b03e-f9ead87c597c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:00.150341 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1314/2612] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:00.154863 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a3ea3-a044-4322-9ade-6541fcae47d7 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:00.164894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a3ea3-a044-4322-9ade-6541fcae47d7 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:00.169563 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09185e7-f554-4721-bb9d-bd823feb38a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:00.170449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09185e7-f554-4721-bb9d-bd823feb38a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:00.170733 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09185e7-f554-4721-bb9d-bd823feb38a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:00.171008 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09185e7-f554-4721-bb9d-bd823feb38a6 admin admin] PATH_INFO: `/v3/projects/c8dc2017088346f4b8557dd6c2ecc991/users/77ac7cec82b647c0bc04d2bd551e819c/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:00.172988 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09185e7-f554-4721-bb9d-bd823feb38a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8dc2017088346f4b8557dd6c2ecc991, user_id=77ac7cec82b647c0bc04d2bd551e819c, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:00.175703 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09185e7-f554-4721-bb9d-bd823feb38a6 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:00.186706 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1299/2613] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:00 2022] PUT /identity/v3/projects/c8dc2017088346f4b8557dd6c2ecc991/users/77ac7cec82b647c0bc04d2bd551e819c/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:00.197482 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb5344-eebe-4d8d-b5fd-67a4d38a3ad2 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:00.197662 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb5344-eebe-4d8d-b5fd-67a4d38a3ad2 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:00.197970 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb5344-eebe-4d8d-b5fd-67a4d38a3ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:00.225499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-f0eb5344-eebe-4d8d-b5fd-67a4d38a3ad2 None None] MFA Rules not processed for user `77ac7cec82b647c0bc04d2bd551e819c`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:00.226701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-f0eb5344-eebe-4d8d-b5fd-67a4d38a3ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:00.300413 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1315/2614] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:00.312608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09185e7-f554-4721-bb9d-bd823feb38a6 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:00.314716 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e09185e7-f554-4721-bb9d-bd823feb38a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:00.374346 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09185e7-f554-4721-bb9d-bd823feb38a6 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:00.378278 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d0d09-f961-4cbf-9953-ee7cef5bb1a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:00.379004 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d0d09-f961-4cbf-9953-ee7cef5bb1a7 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:00.379323 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d0d09-f961-4cbf-9953-ee7cef5bb1a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:00.379603 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d0d09-f961-4cbf-9953-ee7cef5bb1a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:00.388850 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d0d09-f961-4cbf-9953-ee7cef5bb1a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:00.390278 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d0d09-f961-4cbf-9953-ee7cef5bb1a7 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:00.399820 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1300/2615] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:00.470899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb5344-eebe-4d8d-b5fd-67a4d38a3ad2 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:00.482209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb5344-eebe-4d8d-b5fd-67a4d38a3ad2 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:00.486432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f92b5-425d-4bf0-a62a-d9591a18a844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:00.487212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f92b5-425d-4bf0-a62a-d9591a18a844 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:00.487498 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f92b5-425d-4bf0-a62a-d9591a18a844 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:00.487800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f92b5-425d-4bf0-a62a-d9591a18a844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:00.545823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f92b5-425d-4bf0-a62a-d9591a18a844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:00.547789 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f92b5-425d-4bf0-a62a-d9591a18a844 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:00.557697 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1316/2616] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:00.836042 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d0d09-f961-4cbf-9953-ee7cef5bb1a7 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:00.900149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d0d09-f961-4cbf-9953-ee7cef5bb1a7 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:00.905183 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fcce0-0e6a-4c4a-b33a-ed5e0af76d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:00.906077 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fcce0-0e6a-4c4a-b33a-ed5e0af76d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:00.906364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fcce0-0e6a-4c4a-b33a-ed5e0af76d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:00.906678 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fcce0-0e6a-4c4a-b33a-ed5e0af76d7c admin admin] PATH_INFO: `/v3/users/8a0bd3933bb94de0a494e0b5986a1fdf` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:00.908062 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fcce0-0e6a-4c4a-b33a-ed5e0af76d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a0bd3933bb94de0a494e0b5986a1fdf)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:00.910010 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fcce0-0e6a-4c4a-b33a-ed5e0af76d7c admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:00.958488 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-f14fcce0-0e6a-4c4a-b33a-ed5e0af76d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a0bd3933bb94de0a494e0b5986a1fdf'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:00.966782 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-f14fcce0-0e6a-4c4a-b33a-ed5e0af76d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a0bd3933bb94de0a494e0b5986a1fdf'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:00.973538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-f14fcce0-0e6a-4c4a-b33a-ed5e0af76d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a0bd3933bb94de0a494e0b5986a1fdf'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:00.974236 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-f14fcce0-0e6a-4c4a-b33a-ed5e0af76d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a0bd3933bb94de0a494e0b5986a1fdf'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:00.974944 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-f14fcce0-0e6a-4c4a-b33a-ed5e0af76d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a0bd3933bb94de0a494e0b5986a1fdf'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:00.992726 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1301/2617] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:00 2022] DELETE /identity/v3/users/8a0bd3933bb94de0a494e0b5986a1fdf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:00.997555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eebf2f-79de-4ef4-b9bd-c78ab1b6eabe None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:00.997846 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eebf2f-79de-4ef4-b9bd-c78ab1b6eabe None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:00.998125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eebf2f-79de-4ef4-b9bd-c78ab1b6eabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:01.015191 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-23eebf2f-79de-4ef4-b9bd-c78ab1b6eabe None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:01.016378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-23eebf2f-79de-4ef4-b9bd-c78ab1b6eabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:01.079297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1317/2618] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:01.089582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fcce0-0e6a-4c4a-b33a-ed5e0af76d7c admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:01.091029 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f14fcce0-0e6a-4c4a-b33a-ed5e0af76d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:01.154240 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fcce0-0e6a-4c4a-b33a-ed5e0af76d7c admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:01.158091 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537de012-cbd1-42a1-89f8-21e0cf9ba3b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:01.158738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537de012-cbd1-42a1-89f8-21e0cf9ba3b9 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:01.159025 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537de012-cbd1-42a1-89f8-21e0cf9ba3b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:01.159340 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537de012-cbd1-42a1-89f8-21e0cf9ba3b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:01.168590 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537de012-cbd1-42a1-89f8-21e0cf9ba3b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:01.170016 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537de012-cbd1-42a1-89f8-21e0cf9ba3b9 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:01.179305 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1302/2619] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:01.459198 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eebf2f-79de-4ef4-b9bd-c78ab1b6eabe None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:01.460651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-23eebf2f-79de-4ef4-b9bd-c78ab1b6eabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:01.474103 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eebf2f-79de-4ef4-b9bd-c78ab1b6eabe None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:01.479218 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f8bdb-1df2-4b34-90c0-795066583092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:01.480139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f8bdb-1df2-4b34-90c0-795066583092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:01.480419 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f8bdb-1df2-4b34-90c0-795066583092 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:01.480692 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f8bdb-1df2-4b34-90c0-795066583092 admin admin] PATH_INFO: `/v3/projects/4cbf47f3374643bb83221ac22ed56756` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:01.481969 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f8bdb-1df2-4b34-90c0-795066583092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cbf47f3374643bb83221ac22ed56756)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:01.483961 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f8bdb-1df2-4b34-90c0-795066583092 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:01.530983 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-671f8bdb-1df2-4b34-90c0-795066583092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cbf47f3374643bb83221ac22ed56756', 'request_id': 'req-671f8bdb-1df2-4b34-90c0-795066583092'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:01.539747 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-671f8bdb-1df2-4b34-90c0-795066583092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cbf47f3374643bb83221ac22ed56756', 'request_id': 'req-671f8bdb-1df2-4b34-90c0-795066583092'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:01.545775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-671f8bdb-1df2-4b34-90c0-795066583092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cbf47f3374643bb83221ac22ed56756', 'request_id': 'req-671f8bdb-1df2-4b34-90c0-795066583092'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:01.555844 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-671f8bdb-1df2-4b34-90c0-795066583092 admin admin] The token cache is being invalidate because project 4cbf47f3374643bb83221ac22ed56756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:01.556477 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-671f8bdb-1df2-4b34-90c0-795066583092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:01.556749 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-671f8bdb-1df2-4b34-90c0-795066583092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:01.558284 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1318/2620] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:01 2022] DELETE /identity/v3/projects/4cbf47f3374643bb83221ac22ed56756 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:01.562368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537de012-cbd1-42a1-89f8-21e0cf9ba3b9 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:01.571864 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537de012-cbd1-42a1-89f8-21e0cf9ba3b9 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:01.631521 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f850ee6-1f3e-4887-9bfd-bf24eb82650c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:01.632411 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f850ee6-1f3e-4887-9bfd-bf24eb82650c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:01.632699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f850ee6-1f3e-4887-9bfd-bf24eb82650c admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:01.632980 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f850ee6-1f3e-4887-9bfd-bf24eb82650c admin admin] PATH_INFO: `/v3/users/77ac7cec82b647c0bc04d2bd551e819c` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:01.634251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f850ee6-1f3e-4887-9bfd-bf24eb82650c admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ac7cec82b647c0bc04d2bd551e819c)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:01.636235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f850ee6-1f3e-4887-9bfd-bf24eb82650c admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:01.686774 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-2f850ee6-1f3e-4887-9bfd-bf24eb82650c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ac7cec82b647c0bc04d2bd551e819c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:01.694740 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-2f850ee6-1f3e-4887-9bfd-bf24eb82650c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ac7cec82b647c0bc04d2bd551e819c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:01.701596 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-2f850ee6-1f3e-4887-9bfd-bf24eb82650c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ac7cec82b647c0bc04d2bd551e819c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:01.702229 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-2f850ee6-1f3e-4887-9bfd-bf24eb82650c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ac7cec82b647c0bc04d2bd551e819c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:01.702838 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-2f850ee6-1f3e-4887-9bfd-bf24eb82650c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ac7cec82b647c0bc04d2bd551e819c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:01.720158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1303/2621] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:01 2022] DELETE /identity/v3/users/77ac7cec82b647c0bc04d2bd551e819c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:02.022729 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f8bdb-1df2-4b34-90c0-795066583092 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:02.024388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-671f8bdb-1df2-4b34-90c0-795066583092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:02.038203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f8bdb-1df2-4b34-90c0-795066583092 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:02.097766 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad2503-ea44-4396-9f7f-c264330a2257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:02.098671 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad2503-ea44-4396-9f7f-c264330a2257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:02.098991 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad2503-ea44-4396-9f7f-c264330a2257 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:02.099257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad2503-ea44-4396-9f7f-c264330a2257 admin admin] PATH_INFO: `/v3/projects/c8dc2017088346f4b8557dd6c2ecc991` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:02.100438 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad2503-ea44-4396-9f7f-c264330a2257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8dc2017088346f4b8557dd6c2ecc991)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:02.102392 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad2503-ea44-4396-9f7f-c264330a2257 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:02.149773 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-80ad2503-ea44-4396-9f7f-c264330a2257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8dc2017088346f4b8557dd6c2ecc991', 'request_id': 'req-80ad2503-ea44-4396-9f7f-c264330a2257'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:02.158107 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-80ad2503-ea44-4396-9f7f-c264330a2257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8dc2017088346f4b8557dd6c2ecc991', 'request_id': 'req-80ad2503-ea44-4396-9f7f-c264330a2257'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:02.164593 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-80ad2503-ea44-4396-9f7f-c264330a2257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8dc2017088346f4b8557dd6c2ecc991', 'request_id': 'req-80ad2503-ea44-4396-9f7f-c264330a2257'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:02.175016 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-80ad2503-ea44-4396-9f7f-c264330a2257 admin admin] The token cache is being invalidate because project c8dc2017088346f4b8557dd6c2ecc991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:02.175337 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-80ad2503-ea44-4396-9f7f-c264330a2257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:02.176062 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-80ad2503-ea44-4396-9f7f-c264330a2257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:02.177898 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1319/2622] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:02 2022] DELETE /identity/v3/projects/c8dc2017088346f4b8557dd6c2ecc991 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:02.182616 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd9922-ff32-4872-a442-9122e2eff7da None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:02.182937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd9922-ff32-4872-a442-9122e2eff7da None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:02.183263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd9922-ff32-4872-a442-9122e2eff7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:02.201989 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-3ebd9922-ff32-4872-a442-9122e2eff7da None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:02.203362 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-3ebd9922-ff32-4872-a442-9122e2eff7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:02.264533 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1304/2623] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:02.272494 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cf9a2-8680-4d7e-856b-f5c0e6ea9240 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:02.272750 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cf9a2-8680-4d7e-856b-f5c0e6ea9240 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:02.273023 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cf9a2-8680-4d7e-856b-f5c0e6ea9240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:02.291402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-164cf9a2-8680-4d7e-856b-f5c0e6ea9240 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:02.292494 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-164cf9a2-8680-4d7e-856b-f5c0e6ea9240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:02.301030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1320/2624] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 22:22:02.305430 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd9922-ff32-4872-a442-9122e2eff7da None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:02.315443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd9922-ff32-4872-a442-9122e2eff7da None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:02.320692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006025a-7683-417e-8438-667fef9179f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:02.321357 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006025a-7683-417e-8438-667fef9179f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:02.321668 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006025a-7683-417e-8438-667fef9179f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:02.322144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006025a-7683-417e-8438-667fef9179f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:02.323382 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006025a-7683-417e-8438-667fef9179f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:22:02.323697 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006025a-7683-417e-8438-667fef9179f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:02.325291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006025a-7683-417e-8438-667fef9179f3 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:02.337930 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1305/2625] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:22:02.342340 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cf9a2-8680-4d7e-856b-f5c0e6ea9240 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:02.351758 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cf9a2-8680-4d7e-856b-f5c0e6ea9240 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:02.356671 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54219d2f-7b52-4fd2-88c1-9d8cef016546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:02.357357 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54219d2f-7b52-4fd2-88c1-9d8cef016546 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:02.357665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54219d2f-7b52-4fd2-88c1-9d8cef016546 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:02.357959 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54219d2f-7b52-4fd2-88c1-9d8cef016546 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:02.358688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54219d2f-7b52-4fd2-88c1-9d8cef016546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:02.360644 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54219d2f-7b52-4fd2-88c1-9d8cef016546 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:02.386715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1321/2626] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:22:02 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:02.391081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006025a-7683-417e-8438-667fef9179f3 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:02.401326 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006025a-7683-417e-8438-667fef9179f3 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:02.463447 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5593f9e-6785-4c08-91ec-803b6d60c1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:02.464231 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5593f9e-6785-4c08-91ec-803b6d60c1fc admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:02.464517 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5593f9e-6785-4c08-91ec-803b6d60c1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:02.464794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5593f9e-6785-4c08-91ec-803b6d60c1fc admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:02.465505 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5593f9e-6785-4c08-91ec-803b6d60c1fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:02.467457 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5593f9e-6785-4c08-91ec-803b6d60c1fc admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:02.487310 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1306/2627] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:22:02 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:22:02.491941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54219d2f-7b52-4fd2-88c1-9d8cef016546 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:02.503453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54219d2f-7b52-4fd2-88c1-9d8cef016546 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:02.509463 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2904a6e-40d2-49b3-b643-08f9aeb6a5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:02.510431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2904a6e-40d2-49b3-b643-08f9aeb6a5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:02.510841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2904a6e-40d2-49b3-b643-08f9aeb6a5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:02.511413 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2904a6e-40d2-49b3-b643-08f9aeb6a5d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:02.512381 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2904a6e-40d2-49b3-b643-08f9aeb6a5d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:02.514376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2904a6e-40d2-49b3-b643-08f9aeb6a5d8 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:02.526899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1322/2628] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:02.532938 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5593f9e-6785-4c08-91ec-803b6d60c1fc admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:02.543977 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5593f9e-6785-4c08-91ec-803b6d60c1fc admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:02.549694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfd6a6-5e8b-4e74-bb75-bd3cb247468b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:02.550369 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfd6a6-5e8b-4e74-bb75-bd3cb247468b admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:02.550657 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfd6a6-5e8b-4e74-bb75-bd3cb247468b admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:02.550935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfd6a6-5e8b-4e74-bb75-bd3cb247468b admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:02.551676 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfd6a6-5e8b-4e74-bb75-bd3cb247468b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:02.553434 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfd6a6-5e8b-4e74-bb75-bd3cb247468b admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:02.563706 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1307/2629] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:02.568115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2904a6e-40d2-49b3-b643-08f9aeb6a5d8 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:02.578520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2904a6e-40d2-49b3-b643-08f9aeb6a5d8 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:02.584551 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b53400-30a4-415b-aa07-4726f6087007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:02.585456 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b53400-30a4-415b-aa07-4726f6087007 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:02.586095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b53400-30a4-415b-aa07-4726f6087007 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:02.586095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b53400-30a4-415b-aa07-4726f6087007 admin admin] PATH_INFO: `/v3/projects/a2e2b8f6191d4eda8f94fceffc2749d2/users/87b86448c8964c169d5f94999241f28c/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:02.601858 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b53400-30a4-415b-aa07-4726f6087007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e2b8f6191d4eda8f94fceffc2749d2, user_id=87b86448c8964c169d5f94999241f28c, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:02.604692 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b53400-30a4-415b-aa07-4726f6087007 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:02.621928 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1323/2630] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:02 2022] PUT /identity/v3/projects/a2e2b8f6191d4eda8f94fceffc2749d2/users/87b86448c8964c169d5f94999241f28c/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:02.633641 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c891c-33fb-40dd-8120-9ab3c4a370a5 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:02.633948 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c891c-33fb-40dd-8120-9ab3c4a370a5 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:02.634226 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c891c-33fb-40dd-8120-9ab3c4a370a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:02.660790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-881c891c-33fb-40dd-8120-9ab3c4a370a5 None None] MFA Rules not processed for user `87b86448c8964c169d5f94999241f28c`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:02.661993 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-881c891c-33fb-40dd-8120-9ab3c4a370a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:02.728214 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1308/2631] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:02.739698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b53400-30a4-415b-aa07-4726f6087007 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:02.741794 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-d8b53400-30a4-415b-aa07-4726f6087007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:02.803708 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b53400-30a4-415b-aa07-4726f6087007 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:02.809671 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e68302-72a7-42b0-a1a7-53a0e94831f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:02.811525 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e68302-72a7-42b0-a1a7-53a0e94831f2 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:02.811791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e68302-72a7-42b0-a1a7-53a0e94831f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:02.812067 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e68302-72a7-42b0-a1a7-53a0e94831f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:02.822110 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e68302-72a7-42b0-a1a7-53a0e94831f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:02.823601 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e68302-72a7-42b0-a1a7-53a0e94831f2 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:02.833794 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1324/2632] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:05.337925 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c891c-33fb-40dd-8120-9ab3c4a370a5 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:05.339578 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-881c891c-33fb-40dd-8120-9ab3c4a370a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:05.407158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c891c-33fb-40dd-8120-9ab3c4a370a5 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:05.412899 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40235b-9aea-4d25-937e-ff44b9201578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:05.413777 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40235b-9aea-4d25-937e-ff44b9201578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:05.414081 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40235b-9aea-4d25-937e-ff44b9201578 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:05.414330 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40235b-9aea-4d25-937e-ff44b9201578 admin admin] PATH_INFO: `/v3/users/78a28695b2ee492785ec900ba5e387eb` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:05.415811 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40235b-9aea-4d25-937e-ff44b9201578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78a28695b2ee492785ec900ba5e387eb)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:05.417731 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40235b-9aea-4d25-937e-ff44b9201578 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:05.473595 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-6e40235b-9aea-4d25-937e-ff44b9201578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78a28695b2ee492785ec900ba5e387eb'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:05.485205 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-6e40235b-9aea-4d25-937e-ff44b9201578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78a28695b2ee492785ec900ba5e387eb'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:05.496451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-6e40235b-9aea-4d25-937e-ff44b9201578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78a28695b2ee492785ec900ba5e387eb'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:05.497383 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-6e40235b-9aea-4d25-937e-ff44b9201578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78a28695b2ee492785ec900ba5e387eb'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:05.498298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-6e40235b-9aea-4d25-937e-ff44b9201578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78a28695b2ee492785ec900ba5e387eb'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:05.518033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1309/2633] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:05 2022] DELETE /identity/v3/users/78a28695b2ee492785ec900ba5e387eb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:05.522923 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd883ced-386c-4af0-98a0-59cac9a5eb28 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:05.523469 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd883ced-386c-4af0-98a0-59cac9a5eb28 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:05.523573 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd883ced-386c-4af0-98a0-59cac9a5eb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:05.540643 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-bd883ced-386c-4af0-98a0-59cac9a5eb28 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:05.541819 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-bd883ced-386c-4af0-98a0-59cac9a5eb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:05.606850 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1325/2634] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:05.617626 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40235b-9aea-4d25-937e-ff44b9201578 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:05.619491 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-6e40235b-9aea-4d25-937e-ff44b9201578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:05.680039 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40235b-9aea-4d25-937e-ff44b9201578 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:05.684177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfaa2b-87ed-475d-a877-c7859e13d8aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:05.684835 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfaa2b-87ed-475d-a877-c7859e13d8aa service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:05.685124 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfaa2b-87ed-475d-a877-c7859e13d8aa service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:05.685382 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfaa2b-87ed-475d-a877-c7859e13d8aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:05.695329 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfaa2b-87ed-475d-a877-c7859e13d8aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:05.696679 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfaa2b-87ed-475d-a877-c7859e13d8aa service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:05.706564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1310/2635] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:05.894434 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd883ced-386c-4af0-98a0-59cac9a5eb28 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:05.896003 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-bd883ced-386c-4af0-98a0-59cac9a5eb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:05.908222 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd883ced-386c-4af0-98a0-59cac9a5eb28 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:05.913621 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcf866-9d23-426a-94ab-eda3a8a72249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:05.914491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcf866-9d23-426a-94ab-eda3a8a72249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:05.914760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcf866-9d23-426a-94ab-eda3a8a72249 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:05.915130 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcf866-9d23-426a-94ab-eda3a8a72249 admin admin] PATH_INFO: `/v3/users/87b86448c8964c169d5f94999241f28c` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:05.916446 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcf866-9d23-426a-94ab-eda3a8a72249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b86448c8964c169d5f94999241f28c)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:05.918848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcf866-9d23-426a-94ab-eda3a8a72249 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:05.972929 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-0fbcf866-9d23-426a-94ab-eda3a8a72249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b86448c8964c169d5f94999241f28c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:05.981262 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-0fbcf866-9d23-426a-94ab-eda3a8a72249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b86448c8964c169d5f94999241f28c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:05.982059 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-0fbcf866-9d23-426a-94ab-eda3a8a72249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b86448c8964c169d5f94999241f28c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:05.988697 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfaa2b-87ed-475d-a877-c7859e13d8aa service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:05.990317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-32bfaa2b-87ed-475d-a877-c7859e13d8aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:05.996428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-0fbcf866-9d23-426a-94ab-eda3a8a72249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b86448c8964c169d5f94999241f28c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:06.003280 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfaa2b-87ed-475d-a877-c7859e13d8aa service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:06.007909 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-0fbcf866-9d23-426a-94ab-eda3a8a72249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b86448c8964c169d5f94999241f28c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:06.009042 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002bcc7-7a12-4376-9b27-37a678eb1705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:06.010072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002bcc7-7a12-4376-9b27-37a678eb1705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:06.010568 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002bcc7-7a12-4376-9b27-37a678eb1705 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:06.011103 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002bcc7-7a12-4376-9b27-37a678eb1705 admin admin] PATH_INFO: `/v3/projects/2d5f623a50de4ff889cc36f83b1522ef` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:06.012585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002bcc7-7a12-4376-9b27-37a678eb1705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d5f623a50de4ff889cc36f83b1522ef)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:06.015451 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1326/2636] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:05 2022] DELETE /identity/v3/users/87b86448c8964c169d5f94999241f28c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:06.015781 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002bcc7-7a12-4376-9b27-37a678eb1705 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:06.019702 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b2edb-0035-4ae5-a691-c884f0d2eebf None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:06.020089 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b2edb-0035-4ae5-a691-c884f0d2eebf None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:06.020566 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b2edb-0035-4ae5-a691-c884f0d2eebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:06.040222 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-bc3b2edb-0035-4ae5-a691-c884f0d2eebf None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:06.041426 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-bc3b2edb-0035-4ae5-a691-c884f0d2eebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:06.080145 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1002bcc7-7a12-4376-9b27-37a678eb1705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d5f623a50de4ff889cc36f83b1522ef', 'request_id': 'req-1002bcc7-7a12-4376-9b27-37a678eb1705'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:06.087347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1002bcc7-7a12-4376-9b27-37a678eb1705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d5f623a50de4ff889cc36f83b1522ef', 'request_id': 'req-1002bcc7-7a12-4376-9b27-37a678eb1705'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:06.106046 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1002bcc7-7a12-4376-9b27-37a678eb1705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d5f623a50de4ff889cc36f83b1522ef', 'request_id': 'req-1002bcc7-7a12-4376-9b27-37a678eb1705'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:06.112365 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1327/2637] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 22:22:06.119328 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1002bcc7-7a12-4376-9b27-37a678eb1705 admin admin] The token cache is being invalidate because project 2d5f623a50de4ff889cc36f83b1522ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:06.119651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b2edb-0035-4ae5-a691-c884f0d2eebf None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:06.119782 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1002bcc7-7a12-4376-9b27-37a678eb1705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:06.120451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1002bcc7-7a12-4376-9b27-37a678eb1705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:06.121472 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-bc3b2edb-0035-4ae5-a691-c884f0d2eebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:06.122151 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1311/2638] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:05 2022] DELETE /identity/v3/projects/2d5f623a50de4ff889cc36f83b1522ef => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:22:06.126884 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c538b1-81d0-41fd-ba06-8b5a7ceec286 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:06.127435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c538b1-81d0-41fd-ba06-8b5a7ceec286 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:06.127938 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c538b1-81d0-41fd-ba06-8b5a7ceec286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:06.148506 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-d7c538b1-81d0-41fd-ba06-8b5a7ceec286 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:06.151018 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-d7c538b1-81d0-41fd-ba06-8b5a7ceec286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:06.185611 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b2edb-0035-4ae5-a691-c884f0d2eebf None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:06.223303 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1312/2639] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 22:22:06.232767 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f856e-7e72-4223-ad11-3549d8fe74a6 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:06.233375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f856e-7e72-4223-ad11-3549d8fe74a6 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:06.233815 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f856e-7e72-4223-ad11-3549d8fe74a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:06.247618 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e673a-e068-4b1f-9df1-551e6db0e29f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:06.248284 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e673a-e068-4b1f-9df1-551e6db0e29f service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:06.248571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e673a-e068-4b1f-9df1-551e6db0e29f service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:06.248847 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e673a-e068-4b1f-9df1-551e6db0e29f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:06.250938 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-458e673a-e068-4b1f-9df1-551e6db0e29f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:06.256385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-1e5f856e-7e72-4223-ad11-3549d8fe74a6 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:06.257783 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-1e5f856e-7e72-4223-ad11-3549d8fe74a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:06.265264 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e673a-e068-4b1f-9df1-551e6db0e29f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:06.266871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e673a-e068-4b1f-9df1-551e6db0e29f service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:06.278189 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1313/2640] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:06.278350 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1328/2641] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:22:06.279495 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f856e-7e72-4223-ad11-3549d8fe74a6 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:06.291997 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f856e-7e72-4223-ad11-3549d8fe74a6 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:06.305698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4297da3-bde3-4985-b38d-795267314591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:06.305698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4297da3-bde3-4985-b38d-795267314591 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:06.305698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4297da3-bde3-4985-b38d-795267314591 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:06.305698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4297da3-bde3-4985-b38d-795267314591 admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:06.306145 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4297da3-bde3-4985-b38d-795267314591 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:22:06.306145 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4297da3-bde3-4985-b38d-795267314591 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:06.306145 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4297da3-bde3-4985-b38d-795267314591 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:06.322563 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1314/2642] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:22:06.327638 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e673a-e068-4b1f-9df1-551e6db0e29f service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:06.339584 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e673a-e068-4b1f-9df1-551e6db0e29f service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:06.344715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51ebf4-bd87-43e3-913b-0749639aed07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:06.345503 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51ebf4-bd87-43e3-913b-0749639aed07 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:06.345662 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51ebf4-bd87-43e3-913b-0749639aed07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:06.345935 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51ebf4-bd87-43e3-913b-0749639aed07 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:06.346627 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51ebf4-bd87-43e3-913b-0749639aed07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:06.348867 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51ebf4-bd87-43e3-913b-0749639aed07 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:06.378250 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1329/2643] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:22:06 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:22:06.383603 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4297da3-bde3-4985-b38d-795267314591 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:06.395119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4297da3-bde3-4985-b38d-795267314591 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:06.465249 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93145d3-9da1-4c3f-82dc-6739079c3f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:06.465975 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93145d3-9da1-4c3f-82dc-6739079c3f6f admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:06.466263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93145d3-9da1-4c3f-82dc-6739079c3f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:06.466509 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93145d3-9da1-4c3f-82dc-6739079c3f6f admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:06.467237 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93145d3-9da1-4c3f-82dc-6739079c3f6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:06.469170 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93145d3-9da1-4c3f-82dc-6739079c3f6f admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:06.492998 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1315/2644] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:22:06 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:06.497913 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51ebf4-bd87-43e3-913b-0749639aed07 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:06.510109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51ebf4-bd87-43e3-913b-0749639aed07 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:06.516407 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71ed20-f586-4327-9d87-7ce1733e585b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:06.517043 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71ed20-f586-4327-9d87-7ce1733e585b admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:06.517320 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71ed20-f586-4327-9d87-7ce1733e585b admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:06.517593 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71ed20-f586-4327-9d87-7ce1733e585b admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:06.518330 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71ed20-f586-4327-9d87-7ce1733e585b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:06.520000 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71ed20-f586-4327-9d87-7ce1733e585b admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:06.534210 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1330/2645] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:06.535478 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93145d3-9da1-4c3f-82dc-6739079c3f6f admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:06.545812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93145d3-9da1-4c3f-82dc-6739079c3f6f admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:06.553994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d36560-3a6a-41fc-8021-4f76b2ccfb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:06.554385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d36560-3a6a-41fc-8021-4f76b2ccfb08 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:06.554654 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d36560-3a6a-41fc-8021-4f76b2ccfb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:06.554932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d36560-3a6a-41fc-8021-4f76b2ccfb08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:06.555799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d36560-3a6a-41fc-8021-4f76b2ccfb08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:06.557402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d36560-3a6a-41fc-8021-4f76b2ccfb08 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:06.568304 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1316/2646] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 22:22:06.573230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71ed20-f586-4327-9d87-7ce1733e585b admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:06.585624 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71ed20-f586-4327-9d87-7ce1733e585b admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:06.591644 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd2e7b-622f-4fa2-9d06-716852142d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:06.592554 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd2e7b-622f-4fa2-9d06-716852142d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:06.592945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd2e7b-622f-4fa2-9d06-716852142d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:06.593110 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd2e7b-622f-4fa2-9d06-716852142d13 admin admin] PATH_INFO: `/v3/projects/184c66d037ca4108bc2a0546ffd89a4d/users/fbacf68cef784ccca1d61e0034ee9915/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:06.597630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d36560-3a6a-41fc-8021-4f76b2ccfb08 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:06.599523 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-f8d36560-3a6a-41fc-8021-4f76b2ccfb08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:06.612787 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d36560-3a6a-41fc-8021-4f76b2ccfb08 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:06.614962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd2e7b-622f-4fa2-9d06-716852142d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=184c66d037ca4108bc2a0546ffd89a4d, user_id=fbacf68cef784ccca1d61e0034ee9915, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:06.618718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefa2a5-fbbe-476b-ba2b-fcb2dec0d0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:06.618896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd2e7b-622f-4fa2-9d06-716852142d13 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:06.620173 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefa2a5-fbbe-476b-ba2b-fcb2dec0d0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:06.620173 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefa2a5-fbbe-476b-ba2b-fcb2dec0d0da admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:06.620394 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefa2a5-fbbe-476b-ba2b-fcb2dec0d0da admin admin] PATH_INFO: `/v3/projects/a2e2b8f6191d4eda8f94fceffc2749d2` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:06.621427 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefa2a5-fbbe-476b-ba2b-fcb2dec0d0da admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e2b8f6191d4eda8f94fceffc2749d2)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:06.623600 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefa2a5-fbbe-476b-ba2b-fcb2dec0d0da admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:06.637632 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1331/2647] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:06 2022] PUT /identity/v3/projects/184c66d037ca4108bc2a0546ffd89a4d/users/fbacf68cef784ccca1d61e0034ee9915/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:22:06.642545 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78249898-cc86-45bb-90f3-80fa49260021 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:06.642842 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78249898-cc86-45bb-90f3-80fa49260021 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:06.643203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78249898-cc86-45bb-90f3-80fa49260021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:06.663352 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-78249898-cc86-45bb-90f3-80fa49260021 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:06.664632 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-78249898-cc86-45bb-90f3-80fa49260021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:06.680150 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8cefa2a5-fbbe-476b-ba2b-fcb2dec0d0da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e2b8f6191d4eda8f94fceffc2749d2', 'request_id': 'req-8cefa2a5-fbbe-476b-ba2b-fcb2dec0d0da'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:06.687032 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8cefa2a5-fbbe-476b-ba2b-fcb2dec0d0da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e2b8f6191d4eda8f94fceffc2749d2', 'request_id': 'req-8cefa2a5-fbbe-476b-ba2b-fcb2dec0d0da'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:06.696438 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8cefa2a5-fbbe-476b-ba2b-fcb2dec0d0da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e2b8f6191d4eda8f94fceffc2749d2', 'request_id': 'req-8cefa2a5-fbbe-476b-ba2b-fcb2dec0d0da'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:06.708509 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8cefa2a5-fbbe-476b-ba2b-fcb2dec0d0da admin admin] The token cache is being invalidate because project a2e2b8f6191d4eda8f94fceffc2749d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:06.708802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8cefa2a5-fbbe-476b-ba2b-fcb2dec0d0da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:06.709590 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8cefa2a5-fbbe-476b-ba2b-fcb2dec0d0da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:06.711775 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1317/2648] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:06 2022] DELETE /identity/v3/projects/a2e2b8f6191d4eda8f94fceffc2749d2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:22:06.716570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3393bd2-04c1-4760-bfb9-757646872060 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:06.716862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3393bd2-04c1-4760-bfb9-757646872060 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:06.717144 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3393bd2-04c1-4760-bfb9-757646872060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:06.726322 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1332/2649] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 22:22:06.734689 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-b3393bd2-04c1-4760-bfb9-757646872060 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:06.735922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b3393bd2-04c1-4760-bfb9-757646872060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:06.736068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78249898-cc86-45bb-90f3-80fa49260021 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:06.737393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-78249898-cc86-45bb-90f3-80fa49260021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:06.743852 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1318/2650] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 22:22:06.751121 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5757b-2d5b-497c-bc7a-384e0a8d90c1 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:06.751418 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5757b-2d5b-497c-bc7a-384e0a8d90c1 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:06.751700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5757b-2d5b-497c-bc7a-384e0a8d90c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:06.769678 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-16f5757b-2d5b-497c-bc7a-384e0a8d90c1 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:06.770884 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-16f5757b-2d5b-497c-bc7a-384e0a8d90c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:06.779173 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1319/2651] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 22:22:06.783228 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5757b-2d5b-497c-bc7a-384e0a8d90c1 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:06.792087 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5757b-2d5b-497c-bc7a-384e0a8d90c1 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:06.793701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78249898-cc86-45bb-90f3-80fa49260021 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:06.796654 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853416c-0773-4fde-8d06-798e180a9963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:06.797244 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d59db-0f62-4997-8811-35f739f2e477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:06.797384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853416c-0773-4fde-8d06-798e180a9963 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:06.797564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853416c-0773-4fde-8d06-798e180a9963 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:06.797840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853416c-0773-4fde-8d06-798e180a9963 admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:06.797953 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d59db-0f62-4997-8811-35f739f2e477 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:06.798150 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d59db-0f62-4997-8811-35f739f2e477 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:06.798424 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d59db-0f62-4997-8811-35f739f2e477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:06.798544 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853416c-0773-4fde-8d06-798e180a9963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:22:06.798884 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853416c-0773-4fde-8d06-798e180a9963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:06.800528 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853416c-0773-4fde-8d06-798e180a9963 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:06.807724 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d59db-0f62-4997-8811-35f739f2e477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:06.809151 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d59db-0f62-4997-8811-35f739f2e477 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:06.815211 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1320/2652] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 22:22:06.816121 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853416c-0773-4fde-8d06-798e180a9963 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:06.818649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1333/2653] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:22:06.825489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853416c-0773-4fde-8d06-798e180a9963 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:06.830756 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db836ee-1bd9-4212-834b-c0fecf39f3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:06.831245 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db836ee-1bd9-4212-834b-c0fecf39f3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:06.831533 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db836ee-1bd9-4212-834b-c0fecf39f3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:06.831811 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db836ee-1bd9-4212-834b-c0fecf39f3b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:06.832501 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db836ee-1bd9-4212-834b-c0fecf39f3b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:06.834479 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db836ee-1bd9-4212-834b-c0fecf39f3b8 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:06.869063 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1321/2654] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:22:06 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:22:06.870321 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d59db-0f62-4997-8811-35f739f2e477 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:06.880481 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d59db-0f62-4997-8811-35f739f2e477 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:06.937531 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b2b0b-97a4-4f2b-981d-f09bbda584a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:06.938211 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b2b0b-97a4-4f2b-981d-f09bbda584a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:06.938540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b2b0b-97a4-4f2b-981d-f09bbda584a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:06.938813 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b2b0b-97a4-4f2b-981d-f09bbda584a3 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:06.939504 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b2b0b-97a4-4f2b-981d-f09bbda584a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:06.941399 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b2b0b-97a4-4f2b-981d-f09bbda584a3 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:06.964235 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1334/2655] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:22:06 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:06.968823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db836ee-1bd9-4212-834b-c0fecf39f3b8 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:06.980070 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db836ee-1bd9-4212-834b-c0fecf39f3b8 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:06.985342 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f9feb-d975-48d7-9908-6372bf8fd543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:06.986035 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f9feb-d975-48d7-9908-6372bf8fd543 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:06.986302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f9feb-d975-48d7-9908-6372bf8fd543 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:06.986595 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f9feb-d975-48d7-9908-6372bf8fd543 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:06.987339 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f9feb-d975-48d7-9908-6372bf8fd543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:06.988961 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f9feb-d975-48d7-9908-6372bf8fd543 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:06.999408 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1322/2656] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:07.003481 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b2b0b-97a4-4f2b-981d-f09bbda584a3 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:07.013769 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b2b0b-97a4-4f2b-981d-f09bbda584a3 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:07.018406 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bf09f-9c51-4735-8b13-7b91b5768dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:07.019097 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bf09f-9c51-4735-8b13-7b91b5768dee admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:07.019388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bf09f-9c51-4735-8b13-7b91b5768dee admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:07.019668 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bf09f-9c51-4735-8b13-7b91b5768dee admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:07.020395 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274bf09f-9c51-4735-8b13-7b91b5768dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:07.022078 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274bf09f-9c51-4735-8b13-7b91b5768dee admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:07.032645 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1335/2657] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 22:22:07.037130 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f9feb-d975-48d7-9908-6372bf8fd543 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:07.047435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f9feb-d975-48d7-9908-6372bf8fd543 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:07.052004 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48b5a1-6679-40f0-801f-c6bf6a00a307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:07.052888 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48b5a1-6679-40f0-801f-c6bf6a00a307 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:07.053203 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48b5a1-6679-40f0-801f-c6bf6a00a307 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:07.053614 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48b5a1-6679-40f0-801f-c6bf6a00a307 admin admin] PATH_INFO: `/v3/projects/f59a3ef5d86843a885b95a562731c33b/users/07b0f9657aa44172a82ef5e029596250/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:07.069299 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48b5a1-6679-40f0-801f-c6bf6a00a307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59a3ef5d86843a885b95a562731c33b, user_id=07b0f9657aa44172a82ef5e029596250, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:07.072028 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48b5a1-6679-40f0-801f-c6bf6a00a307 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:07.087431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1323/2658] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:07 2022] PUT /identity/v3/projects/f59a3ef5d86843a885b95a562731c33b/users/07b0f9657aa44172a82ef5e029596250/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:22:07.099125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0534-8aa8-411b-886a-8a7aa74d2d0a None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:07.099364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0534-8aa8-411b-886a-8a7aa74d2d0a None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:07.099724 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0534-8aa8-411b-886a-8a7aa74d2d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:07.132216 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-6e9e0534-8aa8-411b-886a-8a7aa74d2d0a None None] MFA Rules not processed for user `07b0f9657aa44172a82ef5e029596250`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:07.133895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-6e9e0534-8aa8-411b-886a-8a7aa74d2d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:07.218760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1336/2659] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:07.226811 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48b5a1-6679-40f0-801f-c6bf6a00a307 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:07.296891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48b5a1-6679-40f0-801f-c6bf6a00a307 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:07.301837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c04c7e-c6d1-4e1d-be1b-e9f9632f51e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:07.302593 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c04c7e-c6d1-4e1d-be1b-e9f9632f51e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:07.302944 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c04c7e-c6d1-4e1d-be1b-e9f9632f51e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:07.303381 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c04c7e-c6d1-4e1d-be1b-e9f9632f51e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:07.304135 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c04c7e-c6d1-4e1d-be1b-e9f9632f51e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:07.306119 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c04c7e-c6d1-4e1d-be1b-e9f9632f51e9 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:07.338859 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1324/2660] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:22:07 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:07.340071 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e0534-8aa8-411b-886a-8a7aa74d2d0a None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:07.354098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e0534-8aa8-411b-886a-8a7aa74d2d0a None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:07.427410 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894feea-8106-4804-9ae8-71256164a8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:07.428396 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894feea-8106-4804-9ae8-71256164a8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:07.428834 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894feea-8106-4804-9ae8-71256164a8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:07.429184 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894feea-8106-4804-9ae8-71256164a8b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:07.430016 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894feea-8106-4804-9ae8-71256164a8b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:07.432247 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894feea-8106-4804-9ae8-71256164a8b1 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:07.462543 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1337/2661] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:22:07 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:07.471905 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c04c7e-c6d1-4e1d-be1b-e9f9632f51e9 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:07.472908 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a580e99-5b24-46c9-aab7-39989a66d278 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:07.473200 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a580e99-5b24-46c9-aab7-39989a66d278 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:07.473474 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a580e99-5b24-46c9-aab7-39989a66d278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:07.484618 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c04c7e-c6d1-4e1d-be1b-e9f9632f51e9 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:07.491280 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c282b9-e9b7-4fad-87f1-92418a1429c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:07.492187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c282b9-e9b7-4fad-87f1-92418a1429c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:07.492736 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c282b9-e9b7-4fad-87f1-92418a1429c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:07.493175 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c282b9-e9b7-4fad-87f1-92418a1429c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:07.494062 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c282b9-e9b7-4fad-87f1-92418a1429c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:07.495863 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c282b9-e9b7-4fad-87f1-92418a1429c5 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:07.507360 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1325/2662] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:07.511458 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c282b9-e9b7-4fad-87f1-92418a1429c5 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:07.512710 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-2a580e99-5b24-46c9-aab7-39989a66d278 None None] MFA Rules not processed for user `fbacf68cef784ccca1d61e0034ee9915`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:07.514111 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-2a580e99-5b24-46c9-aab7-39989a66d278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:07.525572 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c282b9-e9b7-4fad-87f1-92418a1429c5 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:07.531910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83236718-dc94-43dc-b961-904f8f0db1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:07.532778 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83236718-dc94-43dc-b961-904f8f0db1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:07.533166 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83236718-dc94-43dc-b961-904f8f0db1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:07.533542 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83236718-dc94-43dc-b961-904f8f0db1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:07.534510 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83236718-dc94-43dc-b961-904f8f0db1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:07.536244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83236718-dc94-43dc-b961-904f8f0db1f7 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:07.550501 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1326/2663] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 22:22:07.554499 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83236718-dc94-43dc-b961-904f8f0db1f7 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:07.569831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83236718-dc94-43dc-b961-904f8f0db1f7 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:07.574760 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b285bc-ac09-436c-9de0-01bae3d691e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:07.575806 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b285bc-ac09-436c-9de0-01bae3d691e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:07.576092 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b285bc-ac09-436c-9de0-01bae3d691e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:07.576666 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b285bc-ac09-436c-9de0-01bae3d691e5 admin admin] PATH_INFO: `/v3/projects/7d4030d98ec24d819d55e74b80c3d80a/users/ce2f879eeb6140b28dde96d03dd8babb/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:07.594922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b285bc-ac09-436c-9de0-01bae3d691e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d4030d98ec24d819d55e74b80c3d80a, user_id=ce2f879eeb6140b28dde96d03dd8babb, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:07.595649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1338/2664] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:07.601372 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b285bc-ac09-436c-9de0-01bae3d691e5 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:07.608751 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a580e99-5b24-46c9-aab7-39989a66d278 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:07.610808 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-2a580e99-5b24-46c9-aab7-39989a66d278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:07.620853 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1327/2665] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:07 2022] PUT /identity/v3/projects/7d4030d98ec24d819d55e74b80c3d80a/users/ce2f879eeb6140b28dde96d03dd8babb/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:07.689031 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3691ac-f8ea-4704-863e-e0d74323771f None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:07.689262 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3691ac-f8ea-4704-863e-e0d74323771f None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:07.689540 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3691ac-f8ea-4704-863e-e0d74323771f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:07.714435 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a580e99-5b24-46c9-aab7-39989a66d278 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:07.730271 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-ca3691ac-f8ea-4704-863e-e0d74323771f None None] MFA Rules not processed for user `ce2f879eeb6140b28dde96d03dd8babb`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:07.731389 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ca3691ac-f8ea-4704-863e-e0d74323771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:07.787314 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47221a7d-bda4-4914-b84f-9619ae92ab30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:07.788886 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47221a7d-bda4-4914-b84f-9619ae92ab30 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:07.789340 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47221a7d-bda4-4914-b84f-9619ae92ab30 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:07.789783 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47221a7d-bda4-4914-b84f-9619ae92ab30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:07.825395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1328/2666] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 22:22:07.830788 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3691ac-f8ea-4704-863e-e0d74323771f None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:07.851408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47221a7d-bda4-4914-b84f-9619ae92ab30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:07.852849 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47221a7d-bda4-4914-b84f-9619ae92ab30 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:07.862649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1339/2667] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:22:07.890575 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3691ac-f8ea-4704-863e-e0d74323771f None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:07.895427 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7bfed-5de2-489f-b9a4-32c51f067e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:07.896085 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7bfed-5de2-489f-b9a4-32c51f067e7a admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:07.896369 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7bfed-5de2-489f-b9a4-32c51f067e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:07.896638 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7bfed-5de2-489f-b9a4-32c51f067e7a admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:07.897979 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7bfed-5de2-489f-b9a4-32c51f067e7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:07.899783 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7bfed-5de2-489f-b9a4-32c51f067e7a admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:07.927197 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1329/2668] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:22:07 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:22:07.931318 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47221a7d-bda4-4914-b84f-9619ae92ab30 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:07.941840 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47221a7d-bda4-4914-b84f-9619ae92ab30 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:08.000480 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb95d1-5882-4c1e-b4ed-bf05df07d42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:08.001344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb95d1-5882-4c1e-b4ed-bf05df07d42b admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:08.001591 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb95d1-5882-4c1e-b4ed-bf05df07d42b admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:08.001896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb95d1-5882-4c1e-b4ed-bf05df07d42b admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:08.002710 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb95d1-5882-4c1e-b4ed-bf05df07d42b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:08.004783 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb95d1-5882-4c1e-b4ed-bf05df07d42b admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:08.027436 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1340/2669] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:22:07 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:08.031496 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7bfed-5de2-489f-b9a4-32c51f067e7a admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:08.042618 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7bfed-5de2-489f-b9a4-32c51f067e7a admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:08.047273 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee9a62-07e0-43a5-9fe0-24a9c12a6584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:08.047935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee9a62-07e0-43a5-9fe0-24a9c12a6584 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:08.048216 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee9a62-07e0-43a5-9fe0-24a9c12a6584 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:08.048492 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee9a62-07e0-43a5-9fe0-24a9c12a6584 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:08.049210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee9a62-07e0-43a5-9fe0-24a9c12a6584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:08.050800 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee9a62-07e0-43a5-9fe0-24a9c12a6584 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:08.063492 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1330/2670] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:08.067752 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb95d1-5882-4c1e-b4ed-bf05df07d42b admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:08.079098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb95d1-5882-4c1e-b4ed-bf05df07d42b admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:08.084569 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fc349-b50f-41fa-a601-be488e0f36ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:08.085556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fc349-b50f-41fa-a601-be488e0f36ea admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:08.085835 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fc349-b50f-41fa-a601-be488e0f36ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:08.086105 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fc349-b50f-41fa-a601-be488e0f36ea admin admin] PATH_INFO: `/v3/projects/fae0134a4c0b4bc4bc6127d5613c3bb6/users/11dd726d01384c39acc1683ae9bbcd28/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:08.101222 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fc349-b50f-41fa-a601-be488e0f36ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=fae0134a4c0b4bc4bc6127d5613c3bb6, user_id=11dd726d01384c39acc1683ae9bbcd28, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:08.103937 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fc349-b50f-41fa-a601-be488e0f36ea admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:08.118941 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1341/2671] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:08 2022] PUT /identity/v3/projects/fae0134a4c0b4bc4bc6127d5613c3bb6/users/11dd726d01384c39acc1683ae9bbcd28/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:22:08.122863 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee9a62-07e0-43a5-9fe0-24a9c12a6584 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:08.133076 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee9a62-07e0-43a5-9fe0-24a9c12a6584 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:08.199962 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d596acc-f8a0-4d5c-8ffc-5bbbf961874a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:08.200742 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d596acc-f8a0-4d5c-8ffc-5bbbf961874a admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:08.201064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d596acc-f8a0-4d5c-8ffc-5bbbf961874a admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:08.201366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d596acc-f8a0-4d5c-8ffc-5bbbf961874a admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:08.202187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d596acc-f8a0-4d5c-8ffc-5bbbf961874a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:08.204037 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d596acc-f8a0-4d5c-8ffc-5bbbf961874a admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:08.219139 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1331/2672] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:08.220966 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fc349-b50f-41fa-a601-be488e0f36ea admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:08.232353 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fc349-b50f-41fa-a601-be488e0f36ea admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:08.237295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274620bb-f35f-4a45-8b03-2c9a44485fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:08.238177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274620bb-f35f-4a45-8b03-2c9a44485fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:08.238458 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274620bb-f35f-4a45-8b03-2c9a44485fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:08.238735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274620bb-f35f-4a45-8b03-2c9a44485fa9 admin admin] PATH_INFO: `/v3/projects/fae0134a4c0b4bc4bc6127d5613c3bb6/users/11dd726d01384c39acc1683ae9bbcd28/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:08.240814 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274620bb-f35f-4a45-8b03-2c9a44485fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fae0134a4c0b4bc4bc6127d5613c3bb6, user_id=11dd726d01384c39acc1683ae9bbcd28, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:08.243526 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274620bb-f35f-4a45-8b03-2c9a44485fa9 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:08.253494 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1342/2673] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:08 2022] PUT /identity/v3/projects/fae0134a4c0b4bc4bc6127d5613c3bb6/users/11dd726d01384c39acc1683ae9bbcd28/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:08.264459 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399824e-8816-4538-9566-0dfcac72f222 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:08.264753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399824e-8816-4538-9566-0dfcac72f222 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:08.265035 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399824e-8816-4538-9566-0dfcac72f222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:08.290819 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-4399824e-8816-4538-9566-0dfcac72f222 None None] MFA Rules not processed for user `11dd726d01384c39acc1683ae9bbcd28`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:08.292088 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-4399824e-8816-4538-9566-0dfcac72f222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:08.359222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1332/2674] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:08 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:08.371600 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274620bb-f35f-4a45-8b03-2c9a44485fa9 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:08.374709 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-274620bb-f35f-4a45-8b03-2c9a44485fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:08.442423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274620bb-f35f-4a45-8b03-2c9a44485fa9 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:08.446210 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e77dc-8ec1-40a3-925b-2e18582750fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:08.446864 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e77dc-8ec1-40a3-925b-2e18582750fd service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:08.447194 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e77dc-8ec1-40a3-925b-2e18582750fd service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:08.447472 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e77dc-8ec1-40a3-925b-2e18582750fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:08.504131 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e77dc-8ec1-40a3-925b-2e18582750fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:08.505578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e77dc-8ec1-40a3-925b-2e18582750fd service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:08.515236 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1343/2675] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:09.285945 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2169be1-7a88-45ed-8f00-e5c6b3b09232 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:09.286573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2169be1-7a88-45ed-8f00-e5c6b3b09232 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:09.286573 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2169be1-7a88-45ed-8f00-e5c6b3b09232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:09.304295 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-a2169be1-7a88-45ed-8f00-e5c6b3b09232 None None] MFA Rules not processed for user `fbacf68cef784ccca1d61e0034ee9915`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:09.305489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a2169be1-7a88-45ed-8f00-e5c6b3b09232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:09.363778 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1333/2676] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:09.618724 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e77dc-8ec1-40a3-925b-2e18582750fd service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:09.620432 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-d10e77dc-8ec1-40a3-925b-2e18582750fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:09.676492 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e77dc-8ec1-40a3-925b-2e18582750fd service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:09.680694 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467aa38-88b5-40a5-98fd-a7fa2321afbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:09.681345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467aa38-88b5-40a5-98fd-a7fa2321afbe service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:09.681628 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467aa38-88b5-40a5-98fd-a7fa2321afbe service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:09.681903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467aa38-88b5-40a5-98fd-a7fa2321afbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:09.684003 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-6467aa38-88b5-40a5-98fd-a7fa2321afbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:09.693553 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467aa38-88b5-40a5-98fd-a7fa2321afbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:09.694976 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467aa38-88b5-40a5-98fd-a7fa2321afbe service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:09.703328 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1344/2677] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:10.020263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2169be1-7a88-45ed-8f00-e5c6b3b09232 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:10.032860 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2169be1-7a88-45ed-8f00-e5c6b3b09232 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:10.036687 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b699070-5b1f-40c1-bd09-3e7a3d41ebdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:10.037556 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b699070-5b1f-40c1-bd09-3e7a3d41ebdb service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:10.038073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b699070-5b1f-40c1-bd09-3e7a3d41ebdb service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:10.038380 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b699070-5b1f-40c1-bd09-3e7a3d41ebdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:10.050824 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467aa38-88b5-40a5-98fd-a7fa2321afbe service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:10.052271 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-6467aa38-88b5-40a5-98fd-a7fa2321afbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:10.117838 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b699070-5b1f-40c1-bd09-3e7a3d41ebdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:10.119540 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b699070-5b1f-40c1-bd09-3e7a3d41ebdb service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:10.128726 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467aa38-88b5-40a5-98fd-a7fa2321afbe service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:10.130003 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1334/2678] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:10.135609 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249f1b6-f3eb-4b1a-b1f4-33ac3c135e49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e203d7077af54930a640b2334a1d8fa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:10.136500 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249f1b6-f3eb-4b1a-b1f4-33ac3c135e49 service placement] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:10.137118 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249f1b6-f3eb-4b1a-b1f4-33ac3c135e49 service placement] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:10.137405 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249f1b6-f3eb-4b1a-b1f4-33ac3c135e49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:10.139215 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c249f1b6-f3eb-4b1a-b1f4-33ac3c135e49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:10.155999 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249f1b6-f3eb-4b1a-b1f4-33ac3c135e49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:10.158599 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249f1b6-f3eb-4b1a-b1f4-33ac3c135e49 service placement] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:10.172759 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1345/2679] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:22:10.754859 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b699070-5b1f-40c1-bd09-3e7a3d41ebdb service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:10.763814 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b699070-5b1f-40c1-bd09-3e7a3d41ebdb service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:10.767678 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105c471-44e2-4c11-af14-1c3a04400313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:10.768337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105c471-44e2-4c11-af14-1c3a04400313 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:10.768621 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105c471-44e2-4c11-af14-1c3a04400313 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:10.768897 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105c471-44e2-4c11-af14-1c3a04400313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:10.778738 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105c471-44e2-4c11-af14-1c3a04400313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:10.780229 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105c471-44e2-4c11-af14-1c3a04400313 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:10.789973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1335/2680] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:13.080489 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249f1b6-f3eb-4b1a-b1f4-33ac3c135e49 service placement] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:13.081938 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c249f1b6-f3eb-4b1a-b1f4-33ac3c135e49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:13.144515 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249f1b6-f3eb-4b1a-b1f4-33ac3c135e49 service placement] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:13.150260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f3ae9-e2a4-47aa-8c65-5591bdc615ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:13.151147 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f3ae9-e2a4-47aa-8c65-5591bdc615ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:13.151430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f3ae9-e2a4-47aa-8c65-5591bdc615ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:13.151702 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f3ae9-e2a4-47aa-8c65-5591bdc615ab admin admin] PATH_INFO: `/v3/users/373efde97bea429ebaaa18113f4c1926` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:13.153003 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f3ae9-e2a4-47aa-8c65-5591bdc615ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=373efde97bea429ebaaa18113f4c1926)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:13.154924 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f3ae9-e2a4-47aa-8c65-5591bdc615ab admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:13.204165 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d07f3ae9-e2a4-47aa-8c65-5591bdc615ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '373efde97bea429ebaaa18113f4c1926'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:13.212159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d07f3ae9-e2a4-47aa-8c65-5591bdc615ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '373efde97bea429ebaaa18113f4c1926'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:13.212924 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d07f3ae9-e2a4-47aa-8c65-5591bdc615ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '373efde97bea429ebaaa18113f4c1926'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:13.225343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d07f3ae9-e2a4-47aa-8c65-5591bdc615ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '373efde97bea429ebaaa18113f4c1926'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:13.234820 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-d07f3ae9-e2a4-47aa-8c65-5591bdc615ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '373efde97bea429ebaaa18113f4c1926'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:13.241314 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1346/2681] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:13 2022] DELETE /identity/v3/users/373efde97bea429ebaaa18113f4c1926 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:13.245649 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ce3cb-0859-4cf9-877a-ffcbb6b3cdd2 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:13.246187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ce3cb-0859-4cf9-877a-ffcbb6b3cdd2 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:13.246187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ce3cb-0859-4cf9-877a-ffcbb6b3cdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:13.264788 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-428ce3cb-0859-4cf9-877a-ffcbb6b3cdd2 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:13.266106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-428ce3cb-0859-4cf9-877a-ffcbb6b3cdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:13.330319 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1336/2682] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:13.340427 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f3ae9-e2a4-47aa-8c65-5591bdc615ab admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:13.341855 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-d07f3ae9-e2a4-47aa-8c65-5591bdc615ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:13.399487 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f3ae9-e2a4-47aa-8c65-5591bdc615ab admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:13.404309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a5de0-f9a5-4ca4-8f74-d9740f67c565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:13.405081 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a5de0-f9a5-4ca4-8f74-d9740f67c565 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:13.405369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a5de0-f9a5-4ca4-8f74-d9740f67c565 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:13.405950 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a5de0-f9a5-4ca4-8f74-d9740f67c565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:13.417805 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a5de0-f9a5-4ca4-8f74-d9740f67c565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:13.419305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a5de0-f9a5-4ca4-8f74-d9740f67c565 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:13.430546 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1347/2683] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:13.806368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ce3cb-0859-4cf9-877a-ffcbb6b3cdd2 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:13.808182 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-428ce3cb-0859-4cf9-877a-ffcbb6b3cdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:13.821721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ce3cb-0859-4cf9-877a-ffcbb6b3cdd2 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:13.826743 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7296f-414a-44f9-b6fc-f903477b5d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:13.827690 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7296f-414a-44f9-b6fc-f903477b5d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:13.827972 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7296f-414a-44f9-b6fc-f903477b5d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:13.828254 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7296f-414a-44f9-b6fc-f903477b5d05 admin admin] PATH_INFO: `/v3/projects/398dd487b2e849b186b94e3285901b48` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:13.830381 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7296f-414a-44f9-b6fc-f903477b5d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=398dd487b2e849b186b94e3285901b48)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:13.832707 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7296f-414a-44f9-b6fc-f903477b5d05 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:13.879703 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0ff7296f-414a-44f9-b6fc-f903477b5d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '398dd487b2e849b186b94e3285901b48', 'request_id': 'req-0ff7296f-414a-44f9-b6fc-f903477b5d05'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:13.886049 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0ff7296f-414a-44f9-b6fc-f903477b5d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '398dd487b2e849b186b94e3285901b48', 'request_id': 'req-0ff7296f-414a-44f9-b6fc-f903477b5d05'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:13.895316 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0ff7296f-414a-44f9-b6fc-f903477b5d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '398dd487b2e849b186b94e3285901b48', 'request_id': 'req-0ff7296f-414a-44f9-b6fc-f903477b5d05'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:13.906490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0ff7296f-414a-44f9-b6fc-f903477b5d05 admin admin] The token cache is being invalidate because project 398dd487b2e849b186b94e3285901b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:13.906786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0ff7296f-414a-44f9-b6fc-f903477b5d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:13.907457 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0ff7296f-414a-44f9-b6fc-f903477b5d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:13.909126 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1337/2684] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:13 2022] DELETE /identity/v3/projects/398dd487b2e849b186b94e3285901b48 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:13.913163 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a5de0-f9a5-4ca4-8f74-d9740f67c565 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:13.922821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a5de0-f9a5-4ca4-8f74-d9740f67c565 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:13.977729 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd15a44-2c19-484c-8423-7e3c8821d8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:13.978523 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd15a44-2c19-484c-8423-7e3c8821d8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:13.978798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd15a44-2c19-484c-8423-7e3c8821d8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:13.979136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd15a44-2c19-484c-8423-7e3c8821d8e0 admin admin] PATH_INFO: `/v3/users/4b3f880d5f22476aad4011be08a37424` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:13.980297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd15a44-2c19-484c-8423-7e3c8821d8e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3f880d5f22476aad4011be08a37424)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:13.982322 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd15a44-2c19-484c-8423-7e3c8821d8e0 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:14.029912 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ddd15a44-2c19-484c-8423-7e3c8821d8e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3f880d5f22476aad4011be08a37424'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:14.036704 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ddd15a44-2c19-484c-8423-7e3c8821d8e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3f880d5f22476aad4011be08a37424'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:14.037378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ddd15a44-2c19-484c-8423-7e3c8821d8e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3f880d5f22476aad4011be08a37424'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:14.049676 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ddd15a44-2c19-484c-8423-7e3c8821d8e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3f880d5f22476aad4011be08a37424'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:14.059273 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ddd15a44-2c19-484c-8423-7e3c8821d8e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3f880d5f22476aad4011be08a37424'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:14.065857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1348/2685] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:13 2022] DELETE /identity/v3/users/4b3f880d5f22476aad4011be08a37424 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:14.342828 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7296f-414a-44f9-b6fc-f903477b5d05 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:14.344377 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-0ff7296f-414a-44f9-b6fc-f903477b5d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:14.357648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7296f-414a-44f9-b6fc-f903477b5d05 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:14.417432 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad346b1-304a-4117-9c26-6a3e9394b758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:14.418318 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad346b1-304a-4117-9c26-6a3e9394b758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:14.418585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad346b1-304a-4117-9c26-6a3e9394b758 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:14.418859 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad346b1-304a-4117-9c26-6a3e9394b758 admin admin] PATH_INFO: `/v3/projects/9882afe73ef14f898b797a52e7989dc2` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:14.420143 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad346b1-304a-4117-9c26-6a3e9394b758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9882afe73ef14f898b797a52e7989dc2)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:14.422116 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad346b1-304a-4117-9c26-6a3e9394b758 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:14.473067 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-bad346b1-304a-4117-9c26-6a3e9394b758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9882afe73ef14f898b797a52e7989dc2', 'request_id': 'req-bad346b1-304a-4117-9c26-6a3e9394b758'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:14.479698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-bad346b1-304a-4117-9c26-6a3e9394b758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9882afe73ef14f898b797a52e7989dc2', 'request_id': 'req-bad346b1-304a-4117-9c26-6a3e9394b758'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:14.490702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-bad346b1-304a-4117-9c26-6a3e9394b758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9882afe73ef14f898b797a52e7989dc2', 'request_id': 'req-bad346b1-304a-4117-9c26-6a3e9394b758'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:14.501635 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-bad346b1-304a-4117-9c26-6a3e9394b758 admin admin] The token cache is being invalidate because project 9882afe73ef14f898b797a52e7989dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:14.501977 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-bad346b1-304a-4117-9c26-6a3e9394b758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:14.502584 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-bad346b1-304a-4117-9c26-6a3e9394b758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:14.504596 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1338/2686] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:14 2022] DELETE /identity/v3/projects/9882afe73ef14f898b797a52e7989dc2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:14.509704 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46137764-c1d0-4d75-9fd6-8532bf6e4284 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:14.510418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46137764-c1d0-4d75-9fd6-8532bf6e4284 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:14.510418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46137764-c1d0-4d75-9fd6-8532bf6e4284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:14.529828 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-46137764-c1d0-4d75-9fd6-8532bf6e4284 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:14.531074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-46137764-c1d0-4d75-9fd6-8532bf6e4284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:14.594910 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1349/2687] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:14.606007 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5c6f4-4404-496d-858e-683d2807f79a None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:14.606302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5c6f4-4404-496d-858e-683d2807f79a None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:14.606585 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5c6f4-4404-496d-858e-683d2807f79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:14.626440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-96b5c6f4-4404-496d-858e-683d2807f79a None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:14.627775 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-96b5c6f4-4404-496d-858e-683d2807f79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:14.640698 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1339/2688] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:14.644740 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46137764-c1d0-4d75-9fd6-8532bf6e4284 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:14.654661 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46137764-c1d0-4d75-9fd6-8532bf6e4284 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:14.660658 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef917149-2dc0-44aa-912e-67ec3a7906b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:14.660658 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef917149-2dc0-44aa-912e-67ec3a7906b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:14.660658 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef917149-2dc0-44aa-912e-67ec3a7906b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:14.663404 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef917149-2dc0-44aa-912e-67ec3a7906b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:14.664307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef917149-2dc0-44aa-912e-67ec3a7906b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:22:14.664637 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef917149-2dc0-44aa-912e-67ec3a7906b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:14.666275 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef917149-2dc0-44aa-912e-67ec3a7906b5 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:14.682248 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1350/2689] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 22:22:14.683462 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5c6f4-4404-496d-858e-683d2807f79a None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:14.692614 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5c6f4-4404-496d-858e-683d2807f79a None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:14.699690 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef917149-2dc0-44aa-912e-67ec3a7906b5 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:14.699857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc387c60-872c-456d-bb56-c96b9f44ade9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:14.700723 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc387c60-872c-456d-bb56-c96b9f44ade9 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:14.701008 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc387c60-872c-456d-bb56-c96b9f44ade9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:14.701420 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ef917149-2dc0-44aa-912e-67ec3a7906b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:14.701539 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc387c60-872c-456d-bb56-c96b9f44ade9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:14.702366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc387c60-872c-456d-bb56-c96b9f44ade9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:14.705506 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc387c60-872c-456d-bb56-c96b9f44ade9 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:14.716221 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef917149-2dc0-44aa-912e-67ec3a7906b5 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:14.721294 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39449dff-b808-46b6-81c1-3be8dffa3135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:14.722268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39449dff-b808-46b6-81c1-3be8dffa3135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:14.722545 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39449dff-b808-46b6-81c1-3be8dffa3135 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:14.722853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39449dff-b808-46b6-81c1-3be8dffa3135 admin admin] PATH_INFO: `/v3/users/07b0f9657aa44172a82ef5e029596250` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:14.724664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39449dff-b808-46b6-81c1-3be8dffa3135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07b0f9657aa44172a82ef5e029596250)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:14.726934 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39449dff-b808-46b6-81c1-3be8dffa3135 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:14.734614 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1340/2690] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:22:14 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:14.738271 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc387c60-872c-456d-bb56-c96b9f44ade9 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:14.780662 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-39449dff-b808-46b6-81c1-3be8dffa3135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07b0f9657aa44172a82ef5e029596250'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:14.787457 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-39449dff-b808-46b6-81c1-3be8dffa3135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07b0f9657aa44172a82ef5e029596250'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:14.788148 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-39449dff-b808-46b6-81c1-3be8dffa3135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07b0f9657aa44172a82ef5e029596250'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:14.799892 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-39449dff-b808-46b6-81c1-3be8dffa3135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07b0f9657aa44172a82ef5e029596250'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:14.802143 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc387c60-872c-456d-bb56-c96b9f44ade9 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:14.807890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed077bff-e49d-49ef-bb87-91bcf2de56f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:14.808583 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed077bff-e49d-49ef-bb87-91bcf2de56f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:14.808705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-39449dff-b808-46b6-81c1-3be8dffa3135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07b0f9657aa44172a82ef5e029596250'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:14.808889 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed077bff-e49d-49ef-bb87-91bcf2de56f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:14.809130 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed077bff-e49d-49ef-bb87-91bcf2de56f0 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:14.809995 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed077bff-e49d-49ef-bb87-91bcf2de56f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:14.811990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed077bff-e49d-49ef-bb87-91bcf2de56f0 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:14.815332 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1351/2691] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:14 2022] DELETE /identity/v3/users/07b0f9657aa44172a82ef5e029596250 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:22:14.819919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270fd6a-dadb-4ac2-9e62-2391b9a87494 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:14.820264 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270fd6a-dadb-4ac2-9e62-2391b9a87494 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:14.820596 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270fd6a-dadb-4ac2-9e62-2391b9a87494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:14.832504 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1341/2692] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:22:14 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:14.836571 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed077bff-e49d-49ef-bb87-91bcf2de56f0 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:14.838306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ed077bff-e49d-49ef-bb87-91bcf2de56f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:14.842292 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-c270fd6a-dadb-4ac2-9e62-2391b9a87494 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:14.843493 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c270fd6a-dadb-4ac2-9e62-2391b9a87494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:14.849967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed077bff-e49d-49ef-bb87-91bcf2de56f0 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:14.903033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1352/2693] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 22:22:14.904662 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd9b74-cd2f-4b20-b328-957f290dfd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:14.905350 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd9b74-cd2f-4b20-b328-957f290dfd55 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:14.905636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd9b74-cd2f-4b20-b328-957f290dfd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:14.905948 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd9b74-cd2f-4b20-b328-957f290dfd55 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:14.907125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd9b74-cd2f-4b20-b328-957f290dfd55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:14.908462 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd9b74-cd2f-4b20-b328-957f290dfd55 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:14.913044 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270fd6a-dadb-4ac2-9e62-2391b9a87494 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:14.914736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c270fd6a-dadb-4ac2-9e62-2391b9a87494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:14.919064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1342/2694] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 22:22:14.922696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd9b74-cd2f-4b20-b328-957f290dfd55 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:14.933581 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd9b74-cd2f-4b20-b328-957f290dfd55 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:14.938286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d33e0f-44b9-48a0-985f-c1d942e5f5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:14.938973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d33e0f-44b9-48a0-985f-c1d942e5f5bb admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:14.939266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d33e0f-44b9-48a0-985f-c1d942e5f5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:14.939545 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d33e0f-44b9-48a0-985f-c1d942e5f5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:14.940259 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d33e0f-44b9-48a0-985f-c1d942e5f5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:14.941848 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d33e0f-44b9-48a0-985f-c1d942e5f5bb admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:14.952003 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1343/2695] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:14.956281 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d33e0f-44b9-48a0-985f-c1d942e5f5bb admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:14.966225 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d33e0f-44b9-48a0-985f-c1d942e5f5bb admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:14.970864 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270fd6a-dadb-4ac2-9e62-2391b9a87494 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:14.971083 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699762c6-2dd8-4685-95cf-254da170ce78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:14.971919 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699762c6-2dd8-4685-95cf-254da170ce78 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:14.972201 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699762c6-2dd8-4685-95cf-254da170ce78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:14.972481 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699762c6-2dd8-4685-95cf-254da170ce78 admin admin] PATH_INFO: `/v3/projects/cf7aab834f1f4f0abd321fd593e2a9b3/users/88008f1bed02454e8b17303c77c7c2fa/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:14.974723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf4e2c-e403-46e1-8a14-7a9e3cb093b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:14.975406 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf4e2c-e403-46e1-8a14-7a9e3cb093b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:14.975684 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf4e2c-e403-46e1-8a14-7a9e3cb093b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:14.975961 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf4e2c-e403-46e1-8a14-7a9e3cb093b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:14.985093 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf4e2c-e403-46e1-8a14-7a9e3cb093b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:14.986523 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf4e2c-e403-46e1-8a14-7a9e3cb093b0 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:14.987324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699762c6-2dd8-4685-95cf-254da170ce78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7aab834f1f4f0abd321fd593e2a9b3, user_id=88008f1bed02454e8b17303c77c7c2fa, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:14.989981 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699762c6-2dd8-4685-95cf-254da170ce78 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:14.996122 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1353/2696] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:22:15.004786 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1344/2697] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:14 2022] PUT /identity/v3/projects/cf7aab834f1f4f0abd321fd593e2a9b3/users/88008f1bed02454e8b17303c77c7c2fa/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:15.014981 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876a938-99d7-4b0a-800c-cf8b10b8a7ce None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:15.015378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876a938-99d7-4b0a-800c-cf8b10b8a7ce None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:15.015725 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876a938-99d7-4b0a-800c-cf8b10b8a7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:15.042464 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-a876a938-99d7-4b0a-800c-cf8b10b8a7ce None None] MFA Rules not processed for user `88008f1bed02454e8b17303c77c7c2fa`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:15.043712 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a876a938-99d7-4b0a-800c-cf8b10b8a7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:15.106628 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1354/2698] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:15 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:15.111079 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699762c6-2dd8-4685-95cf-254da170ce78 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:15.181193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699762c6-2dd8-4685-95cf-254da170ce78 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:15.185952 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dc50e-f64a-4e0d-9a29-5a3dc4f4a778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:15.186637 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dc50e-f64a-4e0d-9a29-5a3dc4f4a778 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:15.186925 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dc50e-f64a-4e0d-9a29-5a3dc4f4a778 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:15.187238 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dc50e-f64a-4e0d-9a29-5a3dc4f4a778 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:15.187949 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165dc50e-f64a-4e0d-9a29-5a3dc4f4a778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:15.189871 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165dc50e-f64a-4e0d-9a29-5a3dc4f4a778 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:15.218122 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1345/2699] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:22:15 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:22:15.222573 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876a938-99d7-4b0a-800c-cf8b10b8a7ce None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:15.233431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876a938-99d7-4b0a-800c-cf8b10b8a7ce None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:15.279691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dc50e-f64a-4e0d-9a29-5a3dc4f4a778 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:15.281455 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-165dc50e-f64a-4e0d-9a29-5a3dc4f4a778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:15.291619 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6a67d-2a66-4dd5-896a-87c0839b343b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:15.292412 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6a67d-2a66-4dd5-896a-87c0839b343b admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:15.292858 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6a67d-2a66-4dd5-896a-87c0839b343b admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:15.293177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6a67d-2a66-4dd5-896a-87c0839b343b admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:15.293982 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6a67d-2a66-4dd5-896a-87c0839b343b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:15.296091 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6a67d-2a66-4dd5-896a-87c0839b343b admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:15.319083 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1355/2700] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:22:15 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:15.323525 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6a67d-2a66-4dd5-896a-87c0839b343b admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:15.333868 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6a67d-2a66-4dd5-896a-87c0839b343b admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:15.338866 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1e4f0-4545-4de2-b511-f851913c5cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:15.339641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1e4f0-4545-4de2-b511-f851913c5cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:15.339928 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1e4f0-4545-4de2-b511-f851913c5cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:15.340207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1e4f0-4545-4de2-b511-f851913c5cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:15.340939 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1e4f0-4545-4de2-b511-f851913c5cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:15.342558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1e4f0-4545-4de2-b511-f851913c5cb1 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:15.346260 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dc50e-f64a-4e0d-9a29-5a3dc4f4a778 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:15.351213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f359562-6847-4437-84b1-94da4114abd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:15.352262 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f359562-6847-4437-84b1-94da4114abd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:15.352557 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f359562-6847-4437-84b1-94da4114abd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:15.352713 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1356/2701] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 22:22:15.352819 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f359562-6847-4437-84b1-94da4114abd6 admin admin] PATH_INFO: `/v3/projects/f59a3ef5d86843a885b95a562731c33b` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:15.354038 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f359562-6847-4437-84b1-94da4114abd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f59a3ef5d86843a885b95a562731c33b)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:15.356098 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f359562-6847-4437-84b1-94da4114abd6 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:15.356717 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1e4f0-4545-4de2-b511-f851913c5cb1 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:15.366200 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1e4f0-4545-4de2-b511-f851913c5cb1 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:15.371145 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b64da-9651-46b0-b384-b41c6763bdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:15.372037 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b64da-9651-46b0-b384-b41c6763bdd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:15.372329 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b64da-9651-46b0-b384-b41c6763bdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:15.372614 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b64da-9651-46b0-b384-b41c6763bdd6 admin admin] PATH_INFO: `/v3/projects/7f4f132d963c40b2b67c4d15bfa0fc1a/users/8253e320d5e64b3e835787011528209c/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:15.387939 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b64da-9651-46b0-b384-b41c6763bdd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4f132d963c40b2b67c4d15bfa0fc1a, user_id=8253e320d5e64b3e835787011528209c, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:15.392061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b64da-9651-46b0-b384-b41c6763bdd6 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:15.407849 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-3f359562-6847-4437-84b1-94da4114abd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f59a3ef5d86843a885b95a562731c33b', 'request_id': 'req-3f359562-6847-4437-84b1-94da4114abd6'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:15.408234 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1357/2702] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:15 2022] PUT /identity/v3/projects/7f4f132d963c40b2b67c4d15bfa0fc1a/users/8253e320d5e64b3e835787011528209c/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:22:15.412362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b64da-9651-46b0-b384-b41c6763bdd6 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:15.414654 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-3f359562-6847-4437-84b1-94da4114abd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f59a3ef5d86843a885b95a562731c33b', 'request_id': 'req-3f359562-6847-4437-84b1-94da4114abd6'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:15.424531 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-3f359562-6847-4437-84b1-94da4114abd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f59a3ef5d86843a885b95a562731c33b', 'request_id': 'req-3f359562-6847-4437-84b1-94da4114abd6'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:15.435862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-3f359562-6847-4437-84b1-94da4114abd6 admin admin] The token cache is being invalidate because project f59a3ef5d86843a885b95a562731c33b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:15.436163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-3f359562-6847-4437-84b1-94da4114abd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:15.436932 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-3f359562-6847-4437-84b1-94da4114abd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:15.438633 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1346/2703] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:15 2022] DELETE /identity/v3/projects/f59a3ef5d86843a885b95a562731c33b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:22:15.442883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f359562-6847-4437-84b1-94da4114abd6 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:15.444260 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-3f359562-6847-4437-84b1-94da4114abd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:15.476945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b64da-9651-46b0-b384-b41c6763bdd6 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:15.481615 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f5536-c4c5-491c-a187-1b3bf38ed11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:15.482295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f5536-c4c5-491c-a187-1b3bf38ed11f admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:15.482578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f5536-c4c5-491c-a187-1b3bf38ed11f admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:15.482852 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f5536-c4c5-491c-a187-1b3bf38ed11f admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:15.483620 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f5536-c4c5-491c-a187-1b3bf38ed11f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:15.485214 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f5536-c4c5-491c-a187-1b3bf38ed11f admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:15.494978 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1358/2704] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:15.499137 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f5536-c4c5-491c-a187-1b3bf38ed11f admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:15.500784 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c23f5536-c4c5-491c-a187-1b3bf38ed11f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:15.506796 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f359562-6847-4437-84b1-94da4114abd6 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:15.512109 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac76dd-2c81-4c6d-afda-e390a0b653c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:15.512996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac76dd-2c81-4c6d-afda-e390a0b653c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:15.513279 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac76dd-2c81-4c6d-afda-e390a0b653c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:15.513421 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f5536-c4c5-491c-a187-1b3bf38ed11f admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:15.513889 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac76dd-2c81-4c6d-afda-e390a0b653c9 admin admin] PATH_INFO: `/v3/users/ce2f879eeb6140b28dde96d03dd8babb` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:15.514862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac76dd-2c81-4c6d-afda-e390a0b653c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce2f879eeb6140b28dde96d03dd8babb)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:15.516810 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac76dd-2c81-4c6d-afda-e390a0b653c9 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:15.518366 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a710f-19e0-422c-aa27-8f9b2bc15350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:15.519363 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a710f-19e0-422c-aa27-8f9b2bc15350 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:15.519650 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a710f-19e0-422c-aa27-8f9b2bc15350 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:15.519946 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a710f-19e0-422c-aa27-8f9b2bc15350 admin admin] PATH_INFO: `/v3/projects/7f4f132d963c40b2b67c4d15bfa0fc1a/users/8253e320d5e64b3e835787011528209c/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:15.521921 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a710f-19e0-422c-aa27-8f9b2bc15350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4f132d963c40b2b67c4d15bfa0fc1a, user_id=8253e320d5e64b3e835787011528209c, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:15.524903 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a710f-19e0-422c-aa27-8f9b2bc15350 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:15.535501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1359/2705] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:15 2022] PUT /identity/v3/projects/7f4f132d963c40b2b67c4d15bfa0fc1a/users/8253e320d5e64b3e835787011528209c/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:22:15.547671 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c89490-7ba9-4e48-990e-7bb5889fdb8f None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:15.547909 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c89490-7ba9-4e48-990e-7bb5889fdb8f None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:15.548192 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c89490-7ba9-4e48-990e-7bb5889fdb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:15.563445 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-96ac76dd-2c81-4c6d-afda-e390a0b653c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce2f879eeb6140b28dde96d03dd8babb'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:15.573715 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-96ac76dd-2c81-4c6d-afda-e390a0b653c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce2f879eeb6140b28dde96d03dd8babb'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:15.576501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-a3c89490-7ba9-4e48-990e-7bb5889fdb8f None None] MFA Rules not processed for user `8253e320d5e64b3e835787011528209c`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:15.577779 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a3c89490-7ba9-4e48-990e-7bb5889fdb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:15.583721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-96ac76dd-2c81-4c6d-afda-e390a0b653c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce2f879eeb6140b28dde96d03dd8babb'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:15.583721 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-96ac76dd-2c81-4c6d-afda-e390a0b653c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce2f879eeb6140b28dde96d03dd8babb'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:15.585094 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-96ac76dd-2c81-4c6d-afda-e390a0b653c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce2f879eeb6140b28dde96d03dd8babb'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:15.605412 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1347/2706] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:15 2022] DELETE /identity/v3/users/ce2f879eeb6140b28dde96d03dd8babb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:22:15.649339 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1360/2707] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:15 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:15.660946 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac76dd-2c81-4c6d-afda-e390a0b653c9 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:15.662393 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-96ac76dd-2c81-4c6d-afda-e390a0b653c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:15.720674 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac76dd-2c81-4c6d-afda-e390a0b653c9 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:15.724230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a2210-ec36-4e26-b3ab-522a67b8b3c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:15.724880 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a2210-ec36-4e26-b3ab-522a67b8b3c1 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:15.725162 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a2210-ec36-4e26-b3ab-522a67b8b3c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:15.725443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a2210-ec36-4e26-b3ab-522a67b8b3c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:15.785257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a2210-ec36-4e26-b3ab-522a67b8b3c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:15.786699 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a2210-ec36-4e26-b3ab-522a67b8b3c1 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:15.797981 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1348/2708] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:15 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:22:15.896632 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c89490-7ba9-4e48-990e-7bb5889fdb8f None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:15.919064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a2210-ec36-4e26-b3ab-522a67b8b3c1 service cinder] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:15.920756 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-922a2210-ec36-4e26-b3ab-522a67b8b3c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:15.955770 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c89490-7ba9-4e48-990e-7bb5889fdb8f None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:15.959761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94230790-377a-4294-98db-093670c41428 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:15.960633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94230790-377a-4294-98db-093670c41428 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:15.960979 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94230790-377a-4294-98db-093670c41428 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:15.961315 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94230790-377a-4294-98db-093670c41428 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:15.963593 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-94230790-377a-4294-98db-093670c41428 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:15.995514 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a2210-ec36-4e26-b3ab-522a67b8b3c1 service cinder] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:16.001497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c096f48-44dd-49b3-bd4e-0d84ea78b236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:16.002365 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c096f48-44dd-49b3-bd4e-0d84ea78b236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:16.002655 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c096f48-44dd-49b3-bd4e-0d84ea78b236 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:16.002936 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c096f48-44dd-49b3-bd4e-0d84ea78b236 admin admin] PATH_INFO: `/v3/projects/7d4030d98ec24d819d55e74b80c3d80a` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:16.004153 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c096f48-44dd-49b3-bd4e-0d84ea78b236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d4030d98ec24d819d55e74b80c3d80a)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:16.006078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c096f48-44dd-49b3-bd4e-0d84ea78b236 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:16.031127 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94230790-377a-4294-98db-093670c41428 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:16.032594 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94230790-377a-4294-98db-093670c41428 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:16.041953 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1361/2709] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:15 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:16.051343 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4c096f48-44dd-49b3-bd4e-0d84ea78b236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d4030d98ec24d819d55e74b80c3d80a', 'request_id': 'req-4c096f48-44dd-49b3-bd4e-0d84ea78b236'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:16.057580 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4c096f48-44dd-49b3-bd4e-0d84ea78b236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d4030d98ec24d819d55e74b80c3d80a', 'request_id': 'req-4c096f48-44dd-49b3-bd4e-0d84ea78b236'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:16.066854 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4c096f48-44dd-49b3-bd4e-0d84ea78b236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d4030d98ec24d819d55e74b80c3d80a', 'request_id': 'req-4c096f48-44dd-49b3-bd4e-0d84ea78b236'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:16.077387 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4c096f48-44dd-49b3-bd4e-0d84ea78b236 admin admin] The token cache is being invalidate because project 7d4030d98ec24d819d55e74b80c3d80a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:16.077753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4c096f48-44dd-49b3-bd4e-0d84ea78b236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:16.078393 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4c096f48-44dd-49b3-bd4e-0d84ea78b236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:16.080498 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1349/2710] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:15 2022] DELETE /identity/v3/projects/7d4030d98ec24d819d55e74b80c3d80a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:16.084567 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94230790-377a-4294-98db-093670c41428 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:16.096739 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94230790-377a-4294-98db-093670c41428 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:16.154015 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15802520-6137-4fa9-b976-f7b422d1b022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:16.154901 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15802520-6137-4fa9-b976-f7b422d1b022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:16.155214 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15802520-6137-4fa9-b976-f7b422d1b022 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:16.155489 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15802520-6137-4fa9-b976-f7b422d1b022 admin admin] PATH_INFO: `/v3/users/11dd726d01384c39acc1683ae9bbcd28` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:16.156690 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15802520-6137-4fa9-b976-f7b422d1b022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11dd726d01384c39acc1683ae9bbcd28)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:16.158606 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15802520-6137-4fa9-b976-f7b422d1b022 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:16.212049 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-15802520-6137-4fa9-b976-f7b422d1b022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11dd726d01384c39acc1683ae9bbcd28'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:16.218905 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-15802520-6137-4fa9-b976-f7b422d1b022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11dd726d01384c39acc1683ae9bbcd28'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:16.219677 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-15802520-6137-4fa9-b976-f7b422d1b022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11dd726d01384c39acc1683ae9bbcd28'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:16.231641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-15802520-6137-4fa9-b976-f7b422d1b022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11dd726d01384c39acc1683ae9bbcd28'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:16.240196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-15802520-6137-4fa9-b976-f7b422d1b022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11dd726d01384c39acc1683ae9bbcd28'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:16.246160 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1362/2711] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:16 2022] DELETE /identity/v3/users/11dd726d01384c39acc1683ae9bbcd28 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:22:16.526047 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c096f48-44dd-49b3-bd4e-0d84ea78b236 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:16.527718 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-4c096f48-44dd-49b3-bd4e-0d84ea78b236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:16.541086 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c096f48-44dd-49b3-bd4e-0d84ea78b236 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:16.602329 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb7fb7-0a52-4ef3-ae1a-47a2588f7101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:16.603251 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb7fb7-0a52-4ef3-ae1a-47a2588f7101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:16.603542 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb7fb7-0a52-4ef3-ae1a-47a2588f7101 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:16.603821 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb7fb7-0a52-4ef3-ae1a-47a2588f7101 admin admin] PATH_INFO: `/v3/projects/fae0134a4c0b4bc4bc6127d5613c3bb6` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:16.605039 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb7fb7-0a52-4ef3-ae1a-47a2588f7101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fae0134a4c0b4bc4bc6127d5613c3bb6)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:16.606967 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb7fb7-0a52-4ef3-ae1a-47a2588f7101 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:16.657857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e1fb7fb7-0a52-4ef3-ae1a-47a2588f7101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fae0134a4c0b4bc4bc6127d5613c3bb6', 'request_id': 'req-e1fb7fb7-0a52-4ef3-ae1a-47a2588f7101'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:16.664111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e1fb7fb7-0a52-4ef3-ae1a-47a2588f7101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fae0134a4c0b4bc4bc6127d5613c3bb6', 'request_id': 'req-e1fb7fb7-0a52-4ef3-ae1a-47a2588f7101'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:16.673337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e1fb7fb7-0a52-4ef3-ae1a-47a2588f7101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fae0134a4c0b4bc4bc6127d5613c3bb6', 'request_id': 'req-e1fb7fb7-0a52-4ef3-ae1a-47a2588f7101'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:16.684577 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e1fb7fb7-0a52-4ef3-ae1a-47a2588f7101 admin admin] The token cache is being invalidate because project fae0134a4c0b4bc4bc6127d5613c3bb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:16.684863 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e1fb7fb7-0a52-4ef3-ae1a-47a2588f7101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:16.685513 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e1fb7fb7-0a52-4ef3-ae1a-47a2588f7101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:16.687095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1350/2712] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:16 2022] DELETE /identity/v3/projects/fae0134a4c0b4bc4bc6127d5613c3bb6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:16.692893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63ce99-cc6f-43c3-98a7-180aae3cb4e1 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:16.693388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63ce99-cc6f-43c3-98a7-180aae3cb4e1 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:16.693502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63ce99-cc6f-43c3-98a7-180aae3cb4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:16.712196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-bc63ce99-cc6f-43c3-98a7-180aae3cb4e1 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:16.713419 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-bc63ce99-cc6f-43c3-98a7-180aae3cb4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:16.773773 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1363/2713] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:16.783453 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422434b-2bce-44e5-a2a7-2c888c4632a9 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:16.783799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422434b-2bce-44e5-a2a7-2c888c4632a9 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:16.784215 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422434b-2bce-44e5-a2a7-2c888c4632a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:16.802687 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-4422434b-2bce-44e5-a2a7-2c888c4632a9 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:16.803925 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-4422434b-2bce-44e5-a2a7-2c888c4632a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:16.812422 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1351/2714] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:16.817099 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63ce99-cc6f-43c3-98a7-180aae3cb4e1 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:16.827057 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63ce99-cc6f-43c3-98a7-180aae3cb4e1 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:16.832162 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bd9b3-e0a8-46f2-b6c6-d58b0cdde413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:16.832827 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bd9b3-e0a8-46f2-b6c6-d58b0cdde413 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:16.833112 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bd9b3-e0a8-46f2-b6c6-d58b0cdde413 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:16.833391 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bd9b3-e0a8-46f2-b6c6-d58b0cdde413 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:16.834121 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bd9b3-e0a8-46f2-b6c6-d58b0cdde413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:22:16.834435 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bd9b3-e0a8-46f2-b6c6-d58b0cdde413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:16.836109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bd9b3-e0a8-46f2-b6c6-d58b0cdde413 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:16.847850 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1364/2715] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:22:16.851994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422434b-2bce-44e5-a2a7-2c888c4632a9 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:16.862179 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422434b-2bce-44e5-a2a7-2c888c4632a9 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:16.867878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2aaf37-95eb-41aa-b714-51543690f1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:16.868546 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aaf37-95eb-41aa-b714-51543690f1ed admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:16.869013 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aaf37-95eb-41aa-b714-51543690f1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:16.869261 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aaf37-95eb-41aa-b714-51543690f1ed admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:16.869987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2aaf37-95eb-41aa-b714-51543690f1ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:16.872407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2aaf37-95eb-41aa-b714-51543690f1ed admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:16.905959 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1352/2716] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:22:16 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:16.910224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bd9b3-e0a8-46f2-b6c6-d58b0cdde413 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:16.920152 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bd9b3-e0a8-46f2-b6c6-d58b0cdde413 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:16.974778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d8fc9-7b19-4542-8706-445ed01b678f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:16.975491 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d8fc9-7b19-4542-8706-445ed01b678f admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:16.975754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d8fc9-7b19-4542-8706-445ed01b678f admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:16.976071 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d8fc9-7b19-4542-8706-445ed01b678f admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:16.976823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d8fc9-7b19-4542-8706-445ed01b678f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:16.978747 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d8fc9-7b19-4542-8706-445ed01b678f admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:17.000947 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1365/2717] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:22:16 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:17.004958 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2aaf37-95eb-41aa-b714-51543690f1ed admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:17.016339 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2aaf37-95eb-41aa-b714-51543690f1ed admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:17.021905 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f139e7-07af-4f51-a0d5-7d52e265ba25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:17.022607 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f139e7-07af-4f51-a0d5-7d52e265ba25 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:17.022950 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f139e7-07af-4f51-a0d5-7d52e265ba25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:17.023847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f139e7-07af-4f51-a0d5-7d52e265ba25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:17.024575 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f139e7-07af-4f51-a0d5-7d52e265ba25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:17.026255 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f139e7-07af-4f51-a0d5-7d52e265ba25 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:17.036864 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1353/2718] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:17.041633 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d8fc9-7b19-4542-8706-445ed01b678f admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:17.052800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d8fc9-7b19-4542-8706-445ed01b678f admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:17.059578 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aba358-224e-4349-af93-96c7b420895c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:17.060253 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aba358-224e-4349-af93-96c7b420895c admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:17.060540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aba358-224e-4349-af93-96c7b420895c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:17.060816 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aba358-224e-4349-af93-96c7b420895c admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:17.061553 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aba358-224e-4349-af93-96c7b420895c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:17.063196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aba358-224e-4349-af93-96c7b420895c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:17.078670 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1366/2719] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:17.080288 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f139e7-07af-4f51-a0d5-7d52e265ba25 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:17.091421 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f139e7-07af-4f51-a0d5-7d52e265ba25 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:17.096902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e59ec-cba6-4c9b-bd3b-5c494a5d8553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:17.097883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e59ec-cba6-4c9b-bd3b-5c494a5d8553 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:17.098171 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e59ec-cba6-4c9b-bd3b-5c494a5d8553 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:17.098431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e59ec-cba6-4c9b-bd3b-5c494a5d8553 admin admin] PATH_INFO: `/v3/projects/bc573b2c24a544c2a0fd2354d25d491f/users/7b6a3d4c023b4e04b711e6b25b3e86e9/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:17.113854 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e59ec-cba6-4c9b-bd3b-5c494a5d8553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc573b2c24a544c2a0fd2354d25d491f, user_id=7b6a3d4c023b4e04b711e6b25b3e86e9, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:17.116737 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e59ec-cba6-4c9b-bd3b-5c494a5d8553 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:17.134983 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1354/2720] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:17 2022] PUT /identity/v3/projects/bc573b2c24a544c2a0fd2354d25d491f/users/7b6a3d4c023b4e04b711e6b25b3e86e9/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:17.145372 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757267b-fc5e-4895-9b8d-c5b74b9e5203 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:17.145636 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757267b-fc5e-4895-9b8d-c5b74b9e5203 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:17.145915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757267b-fc5e-4895-9b8d-c5b74b9e5203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:17.173423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-5757267b-fc5e-4895-9b8d-c5b74b9e5203 None None] MFA Rules not processed for user `7b6a3d4c023b4e04b711e6b25b3e86e9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:17.174722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5757267b-fc5e-4895-9b8d-c5b74b9e5203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:17.243117 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1367/2721] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:17.254397 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e59ec-cba6-4c9b-bd3b-5c494a5d8553 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:17.256484 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c29e59ec-cba6-4c9b-bd3b-5c494a5d8553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:17.312019 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e59ec-cba6-4c9b-bd3b-5c494a5d8553 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:17.315654 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d954a-8b70-498a-a915-f4d91f98d7b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:17.316297 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d954a-8b70-498a-a915-f4d91f98d7b8 service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:17.316578 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d954a-8b70-498a-a915-f4d91f98d7b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:17.316850 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d954a-8b70-498a-a915-f4d91f98d7b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:17.325510 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d954a-8b70-498a-a915-f4d91f98d7b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:17.326928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d954a-8b70-498a-a915-f4d91f98d7b8 service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:17.336092 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1355/2722] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:17.364022 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757267b-fc5e-4895-9b8d-c5b74b9e5203 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:17.426897 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757267b-fc5e-4895-9b8d-c5b74b9e5203 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:17.432345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fb1af-8265-4485-9510-c4a1e28f4afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:17.433399 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fb1af-8265-4485-9510-c4a1e28f4afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:17.433792 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fb1af-8265-4485-9510-c4a1e28f4afe admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:17.434169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fb1af-8265-4485-9510-c4a1e28f4afe admin admin] PATH_INFO: `/v3/users/7b6a3d4c023b4e04b711e6b25b3e86e9` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:17.435651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fb1af-8265-4485-9510-c4a1e28f4afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b6a3d4c023b4e04b711e6b25b3e86e9)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:17.438190 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fb1af-8265-4485-9510-c4a1e28f4afe admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:17.505325 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-193fb1af-8265-4485-9510-c4a1e28f4afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b6a3d4c023b4e04b711e6b25b3e86e9'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:17.514449 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-193fb1af-8265-4485-9510-c4a1e28f4afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b6a3d4c023b4e04b711e6b25b3e86e9'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:17.515223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-193fb1af-8265-4485-9510-c4a1e28f4afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b6a3d4c023b4e04b711e6b25b3e86e9'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:17.528490 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-193fb1af-8265-4485-9510-c4a1e28f4afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b6a3d4c023b4e04b711e6b25b3e86e9'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:17.540762 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-193fb1af-8265-4485-9510-c4a1e28f4afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b6a3d4c023b4e04b711e6b25b3e86e9'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:17.547622 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1368/2723] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:17 2022] DELETE /identity/v3/users/7b6a3d4c023b4e04b711e6b25b3e86e9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:17.552569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbd571-fc6c-476e-9044-dc3a5483d59f None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:17.553055 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbd571-fc6c-476e-9044-dc3a5483d59f None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:17.553176 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbd571-fc6c-476e-9044-dc3a5483d59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:17.572490 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-8fbbd571-fc6c-476e-9044-dc3a5483d59f None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:17.573694 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-8fbbd571-fc6c-476e-9044-dc3a5483d59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:17.631444 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1356/2724] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:17.641223 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fb1af-8265-4485-9510-c4a1e28f4afe admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:17.642755 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-193fb1af-8265-4485-9510-c4a1e28f4afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:17.701341 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fb1af-8265-4485-9510-c4a1e28f4afe admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:17.705784 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8193b8-bd59-4b3e-8f0b-afed29567d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:17.706441 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8193b8-bd59-4b3e-8f0b-afed29567d81 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:17.706723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8193b8-bd59-4b3e-8f0b-afed29567d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:17.707030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8193b8-bd59-4b3e-8f0b-afed29567d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:17.717126 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8193b8-bd59-4b3e-8f0b-afed29567d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:17.718570 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8193b8-bd59-4b3e-8f0b-afed29567d81 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:17.728108 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1369/2725] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:17.993442 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbd571-fc6c-476e-9044-dc3a5483d59f None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:17.994953 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-8fbbd571-fc6c-476e-9044-dc3a5483d59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:18.006821 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbd571-fc6c-476e-9044-dc3a5483d59f None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:18.011872 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60f576-f2f6-411b-b048-d35e3a23928c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:18.012744 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60f576-f2f6-411b-b048-d35e3a23928c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:18.013027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60f576-f2f6-411b-b048-d35e3a23928c admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:18.013417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60f576-f2f6-411b-b048-d35e3a23928c admin admin] PATH_INFO: `/v3/projects/bc573b2c24a544c2a0fd2354d25d491f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:18.014638 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60f576-f2f6-411b-b048-d35e3a23928c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc573b2c24a544c2a0fd2354d25d491f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:18.016740 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60f576-f2f6-411b-b048-d35e3a23928c admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:18.064165 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5f60f576-f2f6-411b-b048-d35e3a23928c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc573b2c24a544c2a0fd2354d25d491f', 'request_id': 'req-5f60f576-f2f6-411b-b048-d35e3a23928c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:18.070186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5f60f576-f2f6-411b-b048-d35e3a23928c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc573b2c24a544c2a0fd2354d25d491f', 'request_id': 'req-5f60f576-f2f6-411b-b048-d35e3a23928c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:18.078840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5f60f576-f2f6-411b-b048-d35e3a23928c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc573b2c24a544c2a0fd2354d25d491f', 'request_id': 'req-5f60f576-f2f6-411b-b048-d35e3a23928c'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:18.090047 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5f60f576-f2f6-411b-b048-d35e3a23928c admin admin] The token cache is being invalidate because project bc573b2c24a544c2a0fd2354d25d491f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:18.090340 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5f60f576-f2f6-411b-b048-d35e3a23928c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:18.091016 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5f60f576-f2f6-411b-b048-d35e3a23928c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:18.092644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1357/2726] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:17 2022] DELETE /identity/v3/projects/bc573b2c24a544c2a0fd2354d25d491f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:18.887434 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8193b8-bd59-4b3e-8f0b-afed29567d81 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:18.889232 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-fd8193b8-bd59-4b3e-8f0b-afed29567d81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:18.986262 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8193b8-bd59-4b3e-8f0b-afed29567d81 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:19.053316 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44379fd4-99a0-4c97-aa86-6d7a24b1974c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:19.053316 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44379fd4-99a0-4c97-aa86-6d7a24b1974c service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:19.053316 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44379fd4-99a0-4c97-aa86-6d7a24b1974c service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:19.056261 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44379fd4-99a0-4c97-aa86-6d7a24b1974c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:19.058948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-44379fd4-99a0-4c97-aa86-6d7a24b1974c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:19.075222 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44379fd4-99a0-4c97-aa86-6d7a24b1974c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:19.077136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44379fd4-99a0-4c97-aa86-6d7a24b1974c service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:19.091034 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1370/2727] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:26.369444 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60f576-f2f6-411b-b048-d35e3a23928c admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:26.371152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-5f60f576-f2f6-411b-b048-d35e3a23928c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:26.437647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60f576-f2f6-411b-b048-d35e3a23928c admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:26.442805 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6da1d0-1fd5-4ec9-804e-22e7712d7254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:26.443679 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6da1d0-1fd5-4ec9-804e-22e7712d7254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:26.443841 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6da1d0-1fd5-4ec9-804e-22e7712d7254 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:26.444118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6da1d0-1fd5-4ec9-804e-22e7712d7254 admin admin] PATH_INFO: `/v3/users/88008f1bed02454e8b17303c77c7c2fa` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:26.445493 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6da1d0-1fd5-4ec9-804e-22e7712d7254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88008f1bed02454e8b17303c77c7c2fa)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:26.447924 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6da1d0-1fd5-4ec9-804e-22e7712d7254 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:26.497849 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4b6da1d0-1fd5-4ec9-804e-22e7712d7254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88008f1bed02454e8b17303c77c7c2fa'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:26.507696 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4b6da1d0-1fd5-4ec9-804e-22e7712d7254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88008f1bed02454e8b17303c77c7c2fa'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:26.516114 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4b6da1d0-1fd5-4ec9-804e-22e7712d7254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88008f1bed02454e8b17303c77c7c2fa'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:26.516817 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4b6da1d0-1fd5-4ec9-804e-22e7712d7254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88008f1bed02454e8b17303c77c7c2fa'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:26.517487 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-4b6da1d0-1fd5-4ec9-804e-22e7712d7254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88008f1bed02454e8b17303c77c7c2fa'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:26.538057 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1358/2728] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:26 2022] DELETE /identity/v3/users/88008f1bed02454e8b17303c77c7c2fa => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:26.544061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a2a1f-1fe7-4863-b32a-9ffc0c5bd5e0 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:26.544975 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a2a1f-1fe7-4863-b32a-9ffc0c5bd5e0 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:26.544975 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a2a1f-1fe7-4863-b32a-9ffc0c5bd5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:26.564542 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-f26a2a1f-1fe7-4863-b32a-9ffc0c5bd5e0 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:26.565821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-f26a2a1f-1fe7-4863-b32a-9ffc0c5bd5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:26.632460 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1371/2729] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:26.643683 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6da1d0-1fd5-4ec9-804e-22e7712d7254 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:26.645538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-4b6da1d0-1fd5-4ec9-804e-22e7712d7254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:26.710258 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6da1d0-1fd5-4ec9-804e-22e7712d7254 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:26.718450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46c178-9337-4ba2-9bdf-5031b84bbf70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:26.719285 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46c178-9337-4ba2-9bdf-5031b84bbf70 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:26.719582 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46c178-9337-4ba2-9bdf-5031b84bbf70 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:26.720022 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46c178-9337-4ba2-9bdf-5031b84bbf70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:26.732290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46c178-9337-4ba2-9bdf-5031b84bbf70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:26.733748 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46c178-9337-4ba2-9bdf-5031b84bbf70 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:26.743670 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1359/2730] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:27.036233 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a2a1f-1fe7-4863-b32a-9ffc0c5bd5e0 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:27.037807 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-f26a2a1f-1fe7-4863-b32a-9ffc0c5bd5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:27.088318 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a2a1f-1fe7-4863-b32a-9ffc0c5bd5e0 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:27.093098 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea027b95-ba9d-4ce4-879c-651c39470c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:27.093962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea027b95-ba9d-4ce4-879c-651c39470c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:27.094245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea027b95-ba9d-4ce4-879c-651c39470c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:27.094521 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea027b95-ba9d-4ce4-879c-651c39470c32 admin admin] PATH_INFO: `/v3/projects/cf7aab834f1f4f0abd321fd593e2a9b3` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:27.095794 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea027b95-ba9d-4ce4-879c-651c39470c32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf7aab834f1f4f0abd321fd593e2a9b3)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:27.097751 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea027b95-ba9d-4ce4-879c-651c39470c32 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:27.150213 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ea027b95-ba9d-4ce4-879c-651c39470c32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf7aab834f1f4f0abd321fd593e2a9b3', 'request_id': 'req-ea027b95-ba9d-4ce4-879c-651c39470c32'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:27.154660 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d63e0-57fc-4d2d-aba2-0a3ad981d684 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:27.155022 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d63e0-57fc-4d2d-aba2-0a3ad981d684 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:27.155385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d63e0-57fc-4d2d-aba2-0a3ad981d684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:27.163460 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ea027b95-ba9d-4ce4-879c-651c39470c32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf7aab834f1f4f0abd321fd593e2a9b3', 'request_id': 'req-ea027b95-ba9d-4ce4-879c-651c39470c32'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:27.170342 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ea027b95-ba9d-4ce4-879c-651c39470c32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf7aab834f1f4f0abd321fd593e2a9b3', 'request_id': 'req-ea027b95-ba9d-4ce4-879c-651c39470c32'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:27.174547 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-0f9d63e0-57fc-4d2d-aba2-0a3ad981d684 None None] MFA Rules not processed for user `fbacf68cef784ccca1d61e0034ee9915`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:27.175794 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-0f9d63e0-57fc-4d2d-aba2-0a3ad981d684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:27.181867 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ea027b95-ba9d-4ce4-879c-651c39470c32 admin admin] The token cache is being invalidate because project cf7aab834f1f4f0abd321fd593e2a9b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:27.182308 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ea027b95-ba9d-4ce4-879c-651c39470c32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:27.182936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ea027b95-ba9d-4ce4-879c-651c39470c32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:27.184743 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1372/2731] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:27 2022] DELETE /identity/v3/projects/cf7aab834f1f4f0abd321fd593e2a9b3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:27.189142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea027b95-ba9d-4ce4-879c-651c39470c32 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:27.190995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-ea027b95-ba9d-4ce4-879c-651c39470c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:27.234129 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1360/2732] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:27.254393 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea027b95-ba9d-4ce4-879c-651c39470c32 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:27.259619 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0609d39-21fe-4d1d-b7b2-8478bfbc970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:27.260552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0609d39-21fe-4d1d-b7b2-8478bfbc970e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:27.260813 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0609d39-21fe-4d1d-b7b2-8478bfbc970e admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:27.261149 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0609d39-21fe-4d1d-b7b2-8478bfbc970e admin admin] PATH_INFO: `/v3/users/8253e320d5e64b3e835787011528209c` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:27.262362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0609d39-21fe-4d1d-b7b2-8478bfbc970e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8253e320d5e64b3e835787011528209c)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:27.264346 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0609d39-21fe-4d1d-b7b2-8478bfbc970e admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:27.314227 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a0609d39-21fe-4d1d-b7b2-8478bfbc970e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8253e320d5e64b3e835787011528209c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:27.320914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a0609d39-21fe-4d1d-b7b2-8478bfbc970e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8253e320d5e64b3e835787011528209c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:27.321612 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a0609d39-21fe-4d1d-b7b2-8478bfbc970e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8253e320d5e64b3e835787011528209c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:27.333374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a0609d39-21fe-4d1d-b7b2-8478bfbc970e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8253e320d5e64b3e835787011528209c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:27.342138 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a0609d39-21fe-4d1d-b7b2-8478bfbc970e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8253e320d5e64b3e835787011528209c'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:27.348818 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1373/2733] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:27 2022] DELETE /identity/v3/users/8253e320d5e64b3e835787011528209c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:27.465012 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d63e0-57fc-4d2d-aba2-0a3ad981d684 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:27.466644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-0f9d63e0-57fc-4d2d-aba2-0a3ad981d684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:27.551299 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d63e0-57fc-4d2d-aba2-0a3ad981d684 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:27.605417 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97569e0a-cf82-4655-a070-5f267bd52da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:27.606072 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97569e0a-cf82-4655-a070-5f267bd52da6 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:27.606355 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97569e0a-cf82-4655-a070-5f267bd52da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:27.606631 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97569e0a-cf82-4655-a070-5f267bd52da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:27.609011 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-97569e0a-cf82-4655-a070-5f267bd52da6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:27.618940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97569e0a-cf82-4655-a070-5f267bd52da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:27.620595 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97569e0a-cf82-4655-a070-5f267bd52da6 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:27.625136 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0609d39-21fe-4d1d-b7b2-8478bfbc970e admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:27.626689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a0609d39-21fe-4d1d-b7b2-8478bfbc970e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:27.631223 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1361/2734] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:27.700102 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0609d39-21fe-4d1d-b7b2-8478bfbc970e admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:27.705233 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b080d9f-45b0-4670-99f0-e6839cfb0814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:27.706336 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b080d9f-45b0-4670-99f0-e6839cfb0814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:27.706625 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b080d9f-45b0-4670-99f0-e6839cfb0814 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:27.706904 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b080d9f-45b0-4670-99f0-e6839cfb0814 admin admin] PATH_INFO: `/v3/projects/7f4f132d963c40b2b67c4d15bfa0fc1a` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:27.708446 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b080d9f-45b0-4670-99f0-e6839cfb0814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4f132d963c40b2b67c4d15bfa0fc1a)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:27.710376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b080d9f-45b0-4670-99f0-e6839cfb0814 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:27.757396 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-6b080d9f-45b0-4670-99f0-e6839cfb0814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4f132d963c40b2b67c4d15bfa0fc1a', 'request_id': 'req-6b080d9f-45b0-4670-99f0-e6839cfb0814'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:27.765579 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-6b080d9f-45b0-4670-99f0-e6839cfb0814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4f132d963c40b2b67c4d15bfa0fc1a', 'request_id': 'req-6b080d9f-45b0-4670-99f0-e6839cfb0814'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:27.771900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-6b080d9f-45b0-4670-99f0-e6839cfb0814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4f132d963c40b2b67c4d15bfa0fc1a', 'request_id': 'req-6b080d9f-45b0-4670-99f0-e6839cfb0814'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:27.782021 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-6b080d9f-45b0-4670-99f0-e6839cfb0814 admin admin] The token cache is being invalidate because project 7f4f132d963c40b2b67c4d15bfa0fc1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:27.782309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-6b080d9f-45b0-4670-99f0-e6839cfb0814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:27.782967 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-6b080d9f-45b0-4670-99f0-e6839cfb0814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:27.784853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1374/2735] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:27 2022] DELETE /identity/v3/projects/7f4f132d963c40b2b67c4d15bfa0fc1a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:27.789610 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff183a09-5fc7-4ec8-a682-05670f052c54 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:27.789899 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff183a09-5fc7-4ec8-a682-05670f052c54 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:27.790178 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff183a09-5fc7-4ec8-a682-05670f052c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:27.807935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-ff183a09-5fc7-4ec8-a682-05670f052c54 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:27.809064 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ff183a09-5fc7-4ec8-a682-05670f052c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:27.870084 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1362/2736] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:27.878839 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eacb1e-89b2-493d-84e1-56b3ede01949 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:27.879283 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eacb1e-89b2-493d-84e1-56b3ede01949 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:27.879624 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eacb1e-89b2-493d-84e1-56b3ede01949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:27.899183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-88eacb1e-89b2-493d-84e1-56b3ede01949 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:27.900395 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-88eacb1e-89b2-493d-84e1-56b3ede01949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:27.909244 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1375/2737] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:27.913986 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff183a09-5fc7-4ec8-a682-05670f052c54 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:27.924149 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff183a09-5fc7-4ec8-a682-05670f052c54 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:27.929045 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb4894-a584-499e-9723-f2db1e708e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:27.929730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb4894-a584-499e-9723-f2db1e708e9d admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:27.930015 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb4894-a584-499e-9723-f2db1e708e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:27.930292 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb4894-a584-499e-9723-f2db1e708e9d admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:27.931024 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb4894-a584-499e-9723-f2db1e708e9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:22:27.931369 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb4894-a584-499e-9723-f2db1e708e9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:27.936852 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb4894-a584-499e-9723-f2db1e708e9d admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:27.948427 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1363/2738] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:22:27.949816 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eacb1e-89b2-493d-84e1-56b3ede01949 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:27.962438 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eacb1e-89b2-493d-84e1-56b3ede01949 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:27.968129 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1cfb7-01b3-430a-aa27-4acc0c1c28b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:27.968955 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1cfb7-01b3-430a-aa27-4acc0c1c28b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:27.969320 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1cfb7-01b3-430a-aa27-4acc0c1c28b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:27.969608 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1cfb7-01b3-430a-aa27-4acc0c1c28b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:27.970359 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1cfb7-01b3-430a-aa27-4acc0c1c28b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:27.972603 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1cfb7-01b3-430a-aa27-4acc0c1c28b0 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:28.006003 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1376/2739] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:22:27 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:28.015641 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb4894-a584-499e-9723-f2db1e708e9d admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:28.026065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb4894-a584-499e-9723-f2db1e708e9d admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:28.085466 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65870dde-f471-4a07-a941-b861bdc72e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:28.086155 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65870dde-f471-4a07-a941-b861bdc72e17 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:28.086471 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65870dde-f471-4a07-a941-b861bdc72e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:28.086711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65870dde-f471-4a07-a941-b861bdc72e17 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:28.087555 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65870dde-f471-4a07-a941-b861bdc72e17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:28.089692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65870dde-f471-4a07-a941-b861bdc72e17 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:28.111497 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1364/2740] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:22:28 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:22:28.115917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1cfb7-01b3-430a-aa27-4acc0c1c28b0 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:28.126524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1cfb7-01b3-430a-aa27-4acc0c1c28b0 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:28.131246 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bc9dc-2b3c-4529-ba21-e95e6e9a3454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:28.131907 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bc9dc-2b3c-4529-ba21-e95e6e9a3454 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:28.132196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bc9dc-2b3c-4529-ba21-e95e6e9a3454 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:28.132484 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bc9dc-2b3c-4529-ba21-e95e6e9a3454 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:28.133214 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bc9dc-2b3c-4529-ba21-e95e6e9a3454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:28.134832 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bc9dc-2b3c-4529-ba21-e95e6e9a3454 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:28.146640 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1377/2741] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 22:22:28.150542 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65870dde-f471-4a07-a941-b861bdc72e17 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:28.162507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65870dde-f471-4a07-a941-b861bdc72e17 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:28.168276 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce8870-da71-4a70-abd4-3633015264f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:28.169033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce8870-da71-4a70-abd4-3633015264f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:28.169436 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce8870-da71-4a70-abd4-3633015264f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:28.169883 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce8870-da71-4a70-abd4-3633015264f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:28.170692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce8870-da71-4a70-abd4-3633015264f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:28.172428 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce8870-da71-4a70-abd4-3633015264f5 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:28.188194 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1365/2742] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:28.189424 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bc9dc-2b3c-4529-ba21-e95e6e9a3454 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:28.202712 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bc9dc-2b3c-4529-ba21-e95e6e9a3454 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:28.208651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504a0ae-4bbb-417d-99a1-a0ad731e53c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:28.209655 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504a0ae-4bbb-417d-99a1-a0ad731e53c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:28.209929 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504a0ae-4bbb-417d-99a1-a0ad731e53c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:28.210203 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504a0ae-4bbb-417d-99a1-a0ad731e53c1 admin admin] PATH_INFO: `/v3/projects/a27d0b418eaf488587f1287b8a3048e4/users/148231f5d3174e839401a82c96996df4/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:28.227797 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504a0ae-4bbb-417d-99a1-a0ad731e53c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27d0b418eaf488587f1287b8a3048e4, user_id=148231f5d3174e839401a82c96996df4, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:28.230493 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504a0ae-4bbb-417d-99a1-a0ad731e53c1 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:28.246124 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1378/2743] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:28 2022] PUT /identity/v3/projects/a27d0b418eaf488587f1287b8a3048e4/users/148231f5d3174e839401a82c96996df4/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:28.257806 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21b6ba-0806-4df3-865f-b50ea20e3126 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:28.258156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21b6ba-0806-4df3-865f-b50ea20e3126 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:28.258414 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21b6ba-0806-4df3-865f-b50ea20e3126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:28.286844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-dd21b6ba-0806-4df3-865f-b50ea20e3126 None None] MFA Rules not processed for user `148231f5d3174e839401a82c96996df4`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:28.288115 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-dd21b6ba-0806-4df3-865f-b50ea20e3126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:28.355267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1366/2744] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:28.360056 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504a0ae-4bbb-417d-99a1-a0ad731e53c1 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:28.421919 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504a0ae-4bbb-417d-99a1-a0ad731e53c1 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:28.426681 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3f869-4921-4131-80d1-845111756869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:28.427386 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3f869-4921-4131-80d1-845111756869 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:28.427674 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3f869-4921-4131-80d1-845111756869 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:28.427955 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3f869-4921-4131-80d1-845111756869 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:28.428656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3f869-4921-4131-80d1-845111756869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:28.430587 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3f869-4921-4131-80d1-845111756869 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:28.461071 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1379/2745] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:22:28 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:28.462306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21b6ba-0806-4df3-865f-b50ea20e3126 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:28.473733 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21b6ba-0806-4df3-865f-b50ea20e3126 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:28.532896 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ff49d-2ee1-49ce-8124-a71e314d6d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:28.533594 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ff49d-2ee1-49ce-8124-a71e314d6d05 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:28.533874 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ff49d-2ee1-49ce-8124-a71e314d6d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:28.534152 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ff49d-2ee1-49ce-8124-a71e314d6d05 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:28.534841 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ff49d-2ee1-49ce-8124-a71e314d6d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:28.536905 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ff49d-2ee1-49ce-8124-a71e314d6d05 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:28.559189 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1367/2746] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:22:28 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:28.563577 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3f869-4921-4131-80d1-845111756869 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:28.573715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3f869-4921-4131-80d1-845111756869 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:28.578681 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c54d31-12b3-4c3b-b339-2304284bfe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:28.579773 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c54d31-12b3-4c3b-b339-2304284bfe6c admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:28.580053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c54d31-12b3-4c3b-b339-2304284bfe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:28.580333 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c54d31-12b3-4c3b-b339-2304284bfe6c admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:28.581067 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c54d31-12b3-4c3b-b339-2304284bfe6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:28.582701 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c54d31-12b3-4c3b-b339-2304284bfe6c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:28.593841 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1380/2747] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 22:22:28.598090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ff49d-2ee1-49ce-8124-a71e314d6d05 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:28.608668 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ff49d-2ee1-49ce-8124-a71e314d6d05 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:28.613634 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c7c43-e68c-4d27-827d-5a7b361d6e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:28.614298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c7c43-e68c-4d27-827d-5a7b361d6e63 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:28.614588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c7c43-e68c-4d27-827d-5a7b361d6e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:28.614864 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c7c43-e68c-4d27-827d-5a7b361d6e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:28.615638 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c7c43-e68c-4d27-827d-5a7b361d6e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:28.617248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c7c43-e68c-4d27-827d-5a7b361d6e63 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:28.627312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1368/2748] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:28.631382 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c54d31-12b3-4c3b-b339-2304284bfe6c admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:28.641722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c54d31-12b3-4c3b-b339-2304284bfe6c admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:28.646740 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89e715-2a59-45fa-9b5e-80474d3d3d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:28.647663 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89e715-2a59-45fa-9b5e-80474d3d3d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:28.647948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89e715-2a59-45fa-9b5e-80474d3d3d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:28.648254 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89e715-2a59-45fa-9b5e-80474d3d3d29 admin admin] PATH_INFO: `/v3/projects/3c8a3357b5b94a3d99f55eceebfd4937/users/0138c5dfc88f41cb8753602e03c6ad69/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:28.664297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89e715-2a59-45fa-9b5e-80474d3d3d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8a3357b5b94a3d99f55eceebfd4937, user_id=0138c5dfc88f41cb8753602e03c6ad69, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:28.666937 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89e715-2a59-45fa-9b5e-80474d3d3d29 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:28.682211 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1381/2749] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:28 2022] PUT /identity/v3/projects/3c8a3357b5b94a3d99f55eceebfd4937/users/0138c5dfc88f41cb8753602e03c6ad69/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:22:28.693192 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098dccd4-4acc-461b-954e-71c60009eb59 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:28.693488 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098dccd4-4acc-461b-954e-71c60009eb59 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:28.693758 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098dccd4-4acc-461b-954e-71c60009eb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:28.719878 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-098dccd4-4acc-461b-954e-71c60009eb59 None None] MFA Rules not processed for user `0138c5dfc88f41cb8753602e03c6ad69`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:28.721069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-098dccd4-4acc-461b-954e-71c60009eb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:28.785364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1369/2750] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 22:22:28.790019 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89e715-2a59-45fa-9b5e-80474d3d3d29 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:28.851224 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89e715-2a59-45fa-9b5e-80474d3d3d29 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:28.858362 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac148dda-a16e-45da-834c-7e20a3e87236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:28.859130 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac148dda-a16e-45da-834c-7e20a3e87236 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:28.859358 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac148dda-a16e-45da-834c-7e20a3e87236 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:28.859634 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac148dda-a16e-45da-834c-7e20a3e87236 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:28.860334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac148dda-a16e-45da-834c-7e20a3e87236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:28.862280 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac148dda-a16e-45da-834c-7e20a3e87236 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:28.892111 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1382/2751] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:22:28 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:22:28.896351 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098dccd4-4acc-461b-954e-71c60009eb59 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:28.907719 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098dccd4-4acc-461b-954e-71c60009eb59 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:28.964123 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76beaa90-8b0b-4928-9ae8-0ce9c238f464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:28.965222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76beaa90-8b0b-4928-9ae8-0ce9c238f464 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:28.965222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76beaa90-8b0b-4928-9ae8-0ce9c238f464 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:28.965456 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76beaa90-8b0b-4928-9ae8-0ce9c238f464 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:28.966043 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76beaa90-8b0b-4928-9ae8-0ce9c238f464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:28.968357 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76beaa90-8b0b-4928-9ae8-0ce9c238f464 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:28.994892 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1370/2752] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:22:28 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:28.996166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac148dda-a16e-45da-834c-7e20a3e87236 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:29.006281 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac148dda-a16e-45da-834c-7e20a3e87236 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:29.010836 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63826bf-a354-4bb0-ac78-17582c6f8ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:29.011992 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63826bf-a354-4bb0-ac78-17582c6f8ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:29.012274 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63826bf-a354-4bb0-ac78-17582c6f8ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:29.012547 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63826bf-a354-4bb0-ac78-17582c6f8ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:29.013371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63826bf-a354-4bb0-ac78-17582c6f8ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:29.014963 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63826bf-a354-4bb0-ac78-17582c6f8ea6 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:29.025974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1383/2753] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 22:22:29.030173 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76beaa90-8b0b-4928-9ae8-0ce9c238f464 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:29.042894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76beaa90-8b0b-4928-9ae8-0ce9c238f464 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:29.050623 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f02536-24fb-4e53-a037-869eeef6a557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:29.051855 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f02536-24fb-4e53-a037-869eeef6a557 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:29.052302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f02536-24fb-4e53-a037-869eeef6a557 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:29.052959 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f02536-24fb-4e53-a037-869eeef6a557 admin admin] PATH_INFO: `/v3/projects/8ef88fd28474450daf52168756241d4e/users/ea95458346844df18edcc4ff347c6126/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:29.071602 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f02536-24fb-4e53-a037-869eeef6a557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ef88fd28474450daf52168756241d4e, user_id=ea95458346844df18edcc4ff347c6126, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:29.074651 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f02536-24fb-4e53-a037-869eeef6a557 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:29.094203 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1371/2754] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:29 2022] PUT /identity/v3/projects/8ef88fd28474450daf52168756241d4e/users/ea95458346844df18edcc4ff347c6126/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:22:29.098170 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63826bf-a354-4bb0-ac78-17582c6f8ea6 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:29.112053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63826bf-a354-4bb0-ac78-17582c6f8ea6 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:29.177040 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ab661-034a-4fea-b954-909e402a3975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:29.177914 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ab661-034a-4fea-b954-909e402a3975 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:29.178205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ab661-034a-4fea-b954-909e402a3975 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:29.178459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ab661-034a-4fea-b954-909e402a3975 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:29.179278 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ab661-034a-4fea-b954-909e402a3975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:29.180873 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ab661-034a-4fea-b954-909e402a3975 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:29.191355 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1384/2755] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 22:22:29.196294 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f02536-24fb-4e53-a037-869eeef6a557 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:29.208213 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f02536-24fb-4e53-a037-869eeef6a557 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:29.213042 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cc93b-d0e5-4362-876a-67622bdf4e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:29.213944 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cc93b-d0e5-4362-876a-67622bdf4e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:29.214228 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cc93b-d0e5-4362-876a-67622bdf4e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:29.214502 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cc93b-d0e5-4362-876a-67622bdf4e6c admin admin] PATH_INFO: `/v3/projects/8ef88fd28474450daf52168756241d4e/users/ea95458346844df18edcc4ff347c6126/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:29.216664 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cc93b-d0e5-4362-876a-67622bdf4e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ef88fd28474450daf52168756241d4e, user_id=ea95458346844df18edcc4ff347c6126, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:29.219355 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cc93b-d0e5-4362-876a-67622bdf4e6c admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:29.230717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1372/2756] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:29 2022] PUT /identity/v3/projects/8ef88fd28474450daf52168756241d4e/users/ea95458346844df18edcc4ff347c6126/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:29.241355 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734b65d-e7bf-4f87-b365-ce9b37e78dbe None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:29.241678 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734b65d-e7bf-4f87-b365-ce9b37e78dbe None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:29.241960 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734b65d-e7bf-4f87-b365-ce9b37e78dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:29.269217 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-c734b65d-e7bf-4f87-b365-ce9b37e78dbe None None] MFA Rules not processed for user `ea95458346844df18edcc4ff347c6126`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:29.275435 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c734b65d-e7bf-4f87-b365-ce9b37e78dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:29.362126 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cc93b-d0e5-4362-876a-67622bdf4e6c admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:29.362126 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-4b8cc93b-d0e5-4362-876a-67622bdf4e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:29.362705 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1385/2757] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:29.369513 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734b65d-e7bf-4f87-b365-ce9b37e78dbe None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:29.370736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c734b65d-e7bf-4f87-b365-ce9b37e78dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:29.425539 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cc93b-d0e5-4362-876a-67622bdf4e6c admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:29.430104 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03774a7-f491-4fc9-801d-1dee55f4653d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:29.430793 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03774a7-f491-4fc9-801d-1dee55f4653d service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:29.431102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03774a7-f491-4fc9-801d-1dee55f4653d service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:29.431333 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734b65d-e7bf-4f87-b365-ce9b37e78dbe None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:29.431460 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03774a7-f491-4fc9-801d-1dee55f4653d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:29.433217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b03774a7-f491-4fc9-801d-1dee55f4653d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:29.436044 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d4c94-dcd0-4e67-8518-c1d8cec846c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:29.437048 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d4c94-dcd0-4e67-8518-c1d8cec846c1 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:29.437520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d4c94-dcd0-4e67-8518-c1d8cec846c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:29.438722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d4c94-dcd0-4e67-8518-c1d8cec846c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:29.460686 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d4c94-dcd0-4e67-8518-c1d8cec846c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:29.462691 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d4c94-dcd0-4e67-8518-c1d8cec846c1 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:29.474856 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1386/2758] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:22:29.497602 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03774a7-f491-4fc9-801d-1dee55f4653d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:29.499179 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03774a7-f491-4fc9-801d-1dee55f4653d service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:29.509536 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1373/2759] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:22:30.085089 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d4c94-dcd0-4e67-8518-c1d8cec846c1 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:30.086627 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-cf7d4c94-dcd0-4e67-8518-c1d8cec846c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:30.097753 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d4c94-dcd0-4e67-8518-c1d8cec846c1 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:30.101889 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7d0a0-f6f7-467b-a40e-e6e7b0b582a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:30.103068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7d0a0-f6f7-467b-a40e-e6e7b0b582a3 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:30.103349 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7d0a0-f6f7-467b-a40e-e6e7b0b582a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:30.103623 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7d0a0-f6f7-467b-a40e-e6e7b0b582a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:30.176153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7d0a0-f6f7-467b-a40e-e6e7b0b582a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:30.182848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7d0a0-f6f7-467b-a40e-e6e7b0b582a3 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:30.203233 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1387/2760] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:33.061349 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03774a7-f491-4fc9-801d-1dee55f4653d service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:33.063731 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b03774a7-f491-4fc9-801d-1dee55f4653d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:33.077405 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03774a7-f491-4fc9-801d-1dee55f4653d service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:33.082630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f7828-30a2-4096-80a6-0dc3cb49512b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:33.083647 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f7828-30a2-4096-80a6-0dc3cb49512b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:33.083929 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f7828-30a2-4096-80a6-0dc3cb49512b admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:33.084257 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f7828-30a2-4096-80a6-0dc3cb49512b admin admin] PATH_INFO: `/v3/users/0196716439d4473498c7c4b15a1e1d24` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:33.085558 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f7828-30a2-4096-80a6-0dc3cb49512b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0196716439d4473498c7c4b15a1e1d24)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:33.087535 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f7828-30a2-4096-80a6-0dc3cb49512b admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:33.141215 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-a07f7828-30a2-4096-80a6-0dc3cb49512b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0196716439d4473498c7c4b15a1e1d24'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:33.161208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-a07f7828-30a2-4096-80a6-0dc3cb49512b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0196716439d4473498c7c4b15a1e1d24'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:33.170253 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-a07f7828-30a2-4096-80a6-0dc3cb49512b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0196716439d4473498c7c4b15a1e1d24'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:33.170253 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-a07f7828-30a2-4096-80a6-0dc3cb49512b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0196716439d4473498c7c4b15a1e1d24'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:33.171285 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-a07f7828-30a2-4096-80a6-0dc3cb49512b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0196716439d4473498c7c4b15a1e1d24'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:33.189217 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1374/2761] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:33 2022] DELETE /identity/v3/users/0196716439d4473498c7c4b15a1e1d24 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:33.370401 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7d0a0-f6f7-467b-a40e-e6e7b0b582a3 service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:33.383032 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7d0a0-f6f7-467b-a40e-e6e7b0b582a3 service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:33.443893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc9a7e-0987-4a76-9f3e-082e5e584763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:33.444959 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc9a7e-0987-4a76-9f3e-082e5e584763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:33.445401 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc9a7e-0987-4a76-9f3e-082e5e584763 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:33.445761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc9a7e-0987-4a76-9f3e-082e5e584763 admin admin] PATH_INFO: `/v3/projects/5a76f68612f4461199c8ed4a718d2a8d` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:33.447554 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc9a7e-0987-4a76-9f3e-082e5e584763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a76f68612f4461199c8ed4a718d2a8d)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:33.449794 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc9a7e-0987-4a76-9f3e-082e5e584763 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:33.498319 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-fddc9a7e-0987-4a76-9f3e-082e5e584763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a76f68612f4461199c8ed4a718d2a8d', 'request_id': 'req-fddc9a7e-0987-4a76-9f3e-082e5e584763'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:33.506777 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-fddc9a7e-0987-4a76-9f3e-082e5e584763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a76f68612f4461199c8ed4a718d2a8d', 'request_id': 'req-fddc9a7e-0987-4a76-9f3e-082e5e584763'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:33.513065 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-fddc9a7e-0987-4a76-9f3e-082e5e584763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a76f68612f4461199c8ed4a718d2a8d', 'request_id': 'req-fddc9a7e-0987-4a76-9f3e-082e5e584763'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:33.522939 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-fddc9a7e-0987-4a76-9f3e-082e5e584763 admin admin] The token cache is being invalidate because project 5a76f68612f4461199c8ed4a718d2a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:33.523252 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-fddc9a7e-0987-4a76-9f3e-082e5e584763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:33.523886 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-fddc9a7e-0987-4a76-9f3e-082e5e584763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:33.525449 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1388/2762] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:33 2022] DELETE /identity/v3/projects/5a76f68612f4461199c8ed4a718d2a8d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:33.531529 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe289e-a3fa-4ac6-a631-0dc7d3e62846 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:33.531816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe289e-a3fa-4ac6-a631-0dc7d3e62846 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:33.532091 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe289e-a3fa-4ac6-a631-0dc7d3e62846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:33.550450 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-77fe289e-a3fa-4ac6-a631-0dc7d3e62846 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:33.551693 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-77fe289e-a3fa-4ac6-a631-0dc7d3e62846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:33.615366 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1375/2763] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:33.623528 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e20c03-6551-4c85-97d7-afb8912ac6d2 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:33.623817 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e20c03-6551-4c85-97d7-afb8912ac6d2 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:33.624095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e20c03-6551-4c85-97d7-afb8912ac6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:33.643476 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-21e20c03-6551-4c85-97d7-afb8912ac6d2 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:33.644674 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-21e20c03-6551-4c85-97d7-afb8912ac6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:33.654195 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1389/2764] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:33.658609 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe289e-a3fa-4ac6-a631-0dc7d3e62846 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:33.668902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe289e-a3fa-4ac6-a631-0dc7d3e62846 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:33.674823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6484a-ff5c-40e2-bd29-6bfbdf64303c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:33.675553 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6484a-ff5c-40e2-bd29-6bfbdf64303c admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:33.675837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6484a-ff5c-40e2-bd29-6bfbdf64303c admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:33.676109 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6484a-ff5c-40e2-bd29-6bfbdf64303c admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:33.676842 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6484a-ff5c-40e2-bd29-6bfbdf64303c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:22:33.677151 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6484a-ff5c-40e2-bd29-6bfbdf64303c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:33.678751 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6484a-ff5c-40e2-bd29-6bfbdf64303c admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:33.690518 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1376/2765] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:22:33.694873 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e20c03-6551-4c85-97d7-afb8912ac6d2 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:33.704921 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e20c03-6551-4c85-97d7-afb8912ac6d2 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:33.710812 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fb910-f53b-426d-8317-57c241799c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:33.711467 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fb910-f53b-426d-8317-57c241799c0c admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:33.711754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fb910-f53b-426d-8317-57c241799c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:33.712030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fb910-f53b-426d-8317-57c241799c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:33.712811 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156fb910-f53b-426d-8317-57c241799c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:33.714607 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156fb910-f53b-426d-8317-57c241799c0c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:33.742066 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1390/2766] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:22:33 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:33.746258 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6484a-ff5c-40e2-bd29-6bfbdf64303c admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:33.756247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6484a-ff5c-40e2-bd29-6bfbdf64303c admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:33.813569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ae686-f899-4478-a81f-2c213e5ba59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:33.814254 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ae686-f899-4478-a81f-2c213e5ba59a admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:33.814538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ae686-f899-4478-a81f-2c213e5ba59a admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:33.814816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ae686-f899-4478-a81f-2c213e5ba59a admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:33.815539 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ae686-f899-4478-a81f-2c213e5ba59a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:33.817470 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ae686-f899-4478-a81f-2c213e5ba59a admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:33.841125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1377/2767] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:22:33 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:33.845383 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fb910-f53b-426d-8317-57c241799c0c admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:33.855912 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fb910-f53b-426d-8317-57c241799c0c admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:33.861434 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7e851-f3d5-4585-adc7-3de585f5bff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:33.862096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7e851-f3d5-4585-adc7-3de585f5bff1 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:33.862382 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7e851-f3d5-4585-adc7-3de585f5bff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:33.862656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7e851-f3d5-4585-adc7-3de585f5bff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:33.863417 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7e851-f3d5-4585-adc7-3de585f5bff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:33.865045 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7e851-f3d5-4585-adc7-3de585f5bff1 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:33.875760 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1391/2768] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:33.879625 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ae686-f899-4478-a81f-2c213e5ba59a admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:33.890391 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ae686-f899-4478-a81f-2c213e5ba59a admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:33.896358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46db8e9-5577-4f5b-9103-15597dc44cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:33.897155 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46db8e9-5577-4f5b-9103-15597dc44cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:33.897498 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46db8e9-5577-4f5b-9103-15597dc44cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:33.897778 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46db8e9-5577-4f5b-9103-15597dc44cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:33.898509 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46db8e9-5577-4f5b-9103-15597dc44cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:33.900147 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46db8e9-5577-4f5b-9103-15597dc44cd4 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:33.910994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1378/2769] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:33.915302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7e851-f3d5-4585-adc7-3de585f5bff1 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:33.925434 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7e851-f3d5-4585-adc7-3de585f5bff1 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:33.929907 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85f9ae-817f-4d03-9d95-6a385fbaee20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:33.930797 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85f9ae-817f-4d03-9d95-6a385fbaee20 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:33.931086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85f9ae-817f-4d03-9d95-6a385fbaee20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:33.931374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85f9ae-817f-4d03-9d95-6a385fbaee20 admin admin] PATH_INFO: `/v3/projects/bba2c07c73304cfc9df80f95154efaa6/users/dd3b07f64c314be4b48b53b2ee937f52/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:33.947422 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85f9ae-817f-4d03-9d95-6a385fbaee20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba2c07c73304cfc9df80f95154efaa6, user_id=dd3b07f64c314be4b48b53b2ee937f52, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:33.950183 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85f9ae-817f-4d03-9d95-6a385fbaee20 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:33.965542 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1392/2770] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:33 2022] PUT /identity/v3/projects/bba2c07c73304cfc9df80f95154efaa6/users/dd3b07f64c314be4b48b53b2ee937f52/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:33.976052 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829449a-ab47-411c-ad3f-2a233c5b0a6f None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:33.976399 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829449a-ab47-411c-ad3f-2a233c5b0a6f None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:33.976681 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829449a-ab47-411c-ad3f-2a233c5b0a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:34.004890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-e829449a-ab47-411c-ad3f-2a233c5b0a6f None None] MFA Rules not processed for user `dd3b07f64c314be4b48b53b2ee937f52`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:34.006092 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e829449a-ab47-411c-ad3f-2a233c5b0a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:34.069037 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1379/2771] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:34.080666 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85f9ae-817f-4d03-9d95-6a385fbaee20 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:34.082505 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-6a85f9ae-817f-4d03-9d95-6a385fbaee20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:34.155429 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85f9ae-817f-4d03-9d95-6a385fbaee20 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:34.161272 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39534ccd-b38b-44d9-9947-13f5a0552181 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:34.161870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39534ccd-b38b-44d9-9947-13f5a0552181 service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:34.162151 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39534ccd-b38b-44d9-9947-13f5a0552181 service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:34.162428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39534ccd-b38b-44d9-9947-13f5a0552181 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:34.170376 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39534ccd-b38b-44d9-9947-13f5a0552181 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:34.172065 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39534ccd-b38b-44d9-9947-13f5a0552181 service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:34.181212 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1393/2772] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:34.389990 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829449a-ab47-411c-ad3f-2a233c5b0a6f None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:34.391609 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e829449a-ab47-411c-ad3f-2a233c5b0a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:34.458517 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829449a-ab47-411c-ad3f-2a233c5b0a6f None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:34.462307 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0a622-e413-451f-8829-b7afeacbdd1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:34.462991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0a622-e413-451f-8829-b7afeacbdd1f service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:34.463331 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0a622-e413-451f-8829-b7afeacbdd1f service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:34.463606 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0a622-e413-451f-8829-b7afeacbdd1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:34.465382 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-37a0a622-e413-451f-8829-b7afeacbdd1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:34.529111 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0a622-e413-451f-8829-b7afeacbdd1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:34.530544 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0a622-e413-451f-8829-b7afeacbdd1f service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:34.539691 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1380/2773] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:36.712812 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39534ccd-b38b-44d9-9947-13f5a0552181 service nova] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:36.714584 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-39534ccd-b38b-44d9-9947-13f5a0552181 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:36.780097 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39534ccd-b38b-44d9-9947-13f5a0552181 service nova] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:36.786099 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15dc15-5b1e-4a96-a864-25d85ee95690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:36.786973 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15dc15-5b1e-4a96-a864-25d85ee95690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:36.787286 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15dc15-5b1e-4a96-a864-25d85ee95690 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:36.787558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15dc15-5b1e-4a96-a864-25d85ee95690 admin admin] PATH_INFO: `/v3/users/148231f5d3174e839401a82c96996df4` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:36.788972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15dc15-5b1e-4a96-a864-25d85ee95690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=148231f5d3174e839401a82c96996df4)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:36.790913 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15dc15-5b1e-4a96-a864-25d85ee95690 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:36.845927 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-da15dc15-5b1e-4a96-a864-25d85ee95690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '148231f5d3174e839401a82c96996df4'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:36.853418 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-da15dc15-5b1e-4a96-a864-25d85ee95690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '148231f5d3174e839401a82c96996df4'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:36.854173 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-da15dc15-5b1e-4a96-a864-25d85ee95690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '148231f5d3174e839401a82c96996df4'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:36.866913 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-da15dc15-5b1e-4a96-a864-25d85ee95690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '148231f5d3174e839401a82c96996df4'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:36.876700 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-da15dc15-5b1e-4a96-a864-25d85ee95690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '148231f5d3174e839401a82c96996df4'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:36.882706 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1394/2774] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:36 2022] DELETE /identity/v3/users/148231f5d3174e839401a82c96996df4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:36.887388 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f4500-198e-4102-a72f-28bb39d37fa0 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:36.887892 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f4500-198e-4102-a72f-28bb39d37fa0 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:36.888193 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f4500-198e-4102-a72f-28bb39d37fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:36.906962 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-972f4500-198e-4102-a72f-28bb39d37fa0 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:36.908273 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-972f4500-198e-4102-a72f-28bb39d37fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:36.969564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1381/2775] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:36.979688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15dc15-5b1e-4a96-a864-25d85ee95690 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:36.981379 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-da15dc15-5b1e-4a96-a864-25d85ee95690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:37.039413 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15dc15-5b1e-4a96-a864-25d85ee95690 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:37.043754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89162ae1-d83e-4d62-b319-90a3eed00832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:37.044402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89162ae1-d83e-4d62-b319-90a3eed00832 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:37.044683 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89162ae1-d83e-4d62-b319-90a3eed00832 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:37.044970 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89162ae1-d83e-4d62-b319-90a3eed00832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:37.055202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89162ae1-d83e-4d62-b319-90a3eed00832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:37.056636 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89162ae1-d83e-4d62-b319-90a3eed00832 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:37.066692 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1395/2776] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:37.341894 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f4500-198e-4102-a72f-28bb39d37fa0 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:37.343476 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-972f4500-198e-4102-a72f-28bb39d37fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:37.357248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f4500-198e-4102-a72f-28bb39d37fa0 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:37.363530 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521e5b3-bd3a-400c-8107-1e258da2bee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:37.364709 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521e5b3-bd3a-400c-8107-1e258da2bee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:37.364903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521e5b3-bd3a-400c-8107-1e258da2bee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:37.365196 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521e5b3-bd3a-400c-8107-1e258da2bee1 admin admin] PATH_INFO: `/v3/projects/a27d0b418eaf488587f1287b8a3048e4` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:37.366501 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521e5b3-bd3a-400c-8107-1e258da2bee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a27d0b418eaf488587f1287b8a3048e4)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:37.369018 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521e5b3-bd3a-400c-8107-1e258da2bee1 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:37.425962 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b521e5b3-bd3a-400c-8107-1e258da2bee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a27d0b418eaf488587f1287b8a3048e4', 'request_id': 'req-b521e5b3-bd3a-400c-8107-1e258da2bee1'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:37.432118 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b521e5b3-bd3a-400c-8107-1e258da2bee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a27d0b418eaf488587f1287b8a3048e4', 'request_id': 'req-b521e5b3-bd3a-400c-8107-1e258da2bee1'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:37.442381 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b521e5b3-bd3a-400c-8107-1e258da2bee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a27d0b418eaf488587f1287b8a3048e4', 'request_id': 'req-b521e5b3-bd3a-400c-8107-1e258da2bee1'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:37.454700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b521e5b3-bd3a-400c-8107-1e258da2bee1 admin admin] The token cache is being invalidate because project a27d0b418eaf488587f1287b8a3048e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:37.454985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b521e5b3-bd3a-400c-8107-1e258da2bee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:37.455668 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-b521e5b3-bd3a-400c-8107-1e258da2bee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:37.457271 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1382/2777] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:37 2022] DELETE /identity/v3/projects/a27d0b418eaf488587f1287b8a3048e4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:37.461536 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89162ae1-d83e-4d62-b319-90a3eed00832 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:37.471773 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89162ae1-d83e-4d62-b319-90a3eed00832 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:37.530011 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd4c88-d7d0-45c3-b0a4-115e5bc76df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:37.530964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd4c88-d7d0-45c3-b0a4-115e5bc76df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:37.531301 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd4c88-d7d0-45c3-b0a4-115e5bc76df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:37.531582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd4c88-d7d0-45c3-b0a4-115e5bc76df5 admin admin] PATH_INFO: `/v3/users/0138c5dfc88f41cb8753602e03c6ad69` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:37.532803 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd4c88-d7d0-45c3-b0a4-115e5bc76df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0138c5dfc88f41cb8753602e03c6ad69)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:37.534751 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd4c88-d7d0-45c3-b0a4-115e5bc76df5 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:37.588853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-dbfd4c88-d7d0-45c3-b0a4-115e5bc76df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0138c5dfc88f41cb8753602e03c6ad69'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:37.597474 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-dbfd4c88-d7d0-45c3-b0a4-115e5bc76df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0138c5dfc88f41cb8753602e03c6ad69'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:37.598174 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-dbfd4c88-d7d0-45c3-b0a4-115e5bc76df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0138c5dfc88f41cb8753602e03c6ad69'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:37.610139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-dbfd4c88-d7d0-45c3-b0a4-115e5bc76df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0138c5dfc88f41cb8753602e03c6ad69'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:37.618408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-dbfd4c88-d7d0-45c3-b0a4-115e5bc76df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0138c5dfc88f41cb8753602e03c6ad69'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:37.624948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1396/2778] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:37 2022] DELETE /identity/v3/users/0138c5dfc88f41cb8753602e03c6ad69 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:37.912440 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521e5b3-bd3a-400c-8107-1e258da2bee1 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:37.914014 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b521e5b3-bd3a-400c-8107-1e258da2bee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:37.928371 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521e5b3-bd3a-400c-8107-1e258da2bee1 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:37.985043 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309a2bb-2c50-46ed-af3b-e6966f0c4770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:37.985925 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309a2bb-2c50-46ed-af3b-e6966f0c4770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:37.986219 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309a2bb-2c50-46ed-af3b-e6966f0c4770 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:37.986498 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309a2bb-2c50-46ed-af3b-e6966f0c4770 admin admin] PATH_INFO: `/v3/projects/3c8a3357b5b94a3d99f55eceebfd4937` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:37.987695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309a2bb-2c50-46ed-af3b-e6966f0c4770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8a3357b5b94a3d99f55eceebfd4937)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:37.989648 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309a2bb-2c50-46ed-af3b-e6966f0c4770 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:38.037356 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5309a2bb-2c50-46ed-af3b-e6966f0c4770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8a3357b5b94a3d99f55eceebfd4937', 'request_id': 'req-5309a2bb-2c50-46ed-af3b-e6966f0c4770'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:38.043230 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5309a2bb-2c50-46ed-af3b-e6966f0c4770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8a3357b5b94a3d99f55eceebfd4937', 'request_id': 'req-5309a2bb-2c50-46ed-af3b-e6966f0c4770'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:38.052312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5309a2bb-2c50-46ed-af3b-e6966f0c4770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8a3357b5b94a3d99f55eceebfd4937', 'request_id': 'req-5309a2bb-2c50-46ed-af3b-e6966f0c4770'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:38.062065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5309a2bb-2c50-46ed-af3b-e6966f0c4770 admin admin] The token cache is being invalidate because project 3c8a3357b5b94a3d99f55eceebfd4937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:38.062353 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5309a2bb-2c50-46ed-af3b-e6966f0c4770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:38.062965 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-5309a2bb-2c50-46ed-af3b-e6966f0c4770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:38.064551 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1383/2779] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:37 2022] DELETE /identity/v3/projects/3c8a3357b5b94a3d99f55eceebfd4937 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:38.068698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd4c88-d7d0-45c3-b0a4-115e5bc76df5 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:38.070131 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-dbfd4c88-d7d0-45c3-b0a4-115e5bc76df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:38.083540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd4c88-d7d0-45c3-b0a4-115e5bc76df5 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:38.151951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0c156-b76f-4a3b-acb0-bb52388ac13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:38.152761 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0c156-b76f-4a3b-acb0-bb52388ac13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:38.153052 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0c156-b76f-4a3b-acb0-bb52388ac13f admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:38.153328 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0c156-b76f-4a3b-acb0-bb52388ac13f admin admin] PATH_INFO: `/v3/users/ea95458346844df18edcc4ff347c6126` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:38.154665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0c156-b76f-4a3b-acb0-bb52388ac13f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea95458346844df18edcc4ff347c6126)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:38.156918 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0c156-b76f-4a3b-acb0-bb52388ac13f admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:38.211853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c4b0c156-b76f-4a3b-acb0-bb52388ac13f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea95458346844df18edcc4ff347c6126'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:38.218773 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c4b0c156-b76f-4a3b-acb0-bb52388ac13f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea95458346844df18edcc4ff347c6126'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:38.219534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c4b0c156-b76f-4a3b-acb0-bb52388ac13f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea95458346844df18edcc4ff347c6126'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:38.231755 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c4b0c156-b76f-4a3b-acb0-bb52388ac13f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea95458346844df18edcc4ff347c6126'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:38.240816 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c4b0c156-b76f-4a3b-acb0-bb52388ac13f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea95458346844df18edcc4ff347c6126'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:38.247234 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1397/2780] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:38 2022] DELETE /identity/v3/users/ea95458346844df18edcc4ff347c6126 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:38.523214 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309a2bb-2c50-46ed-af3b-e6966f0c4770 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:38.524703 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-5309a2bb-2c50-46ed-af3b-e6966f0c4770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:38.537955 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309a2bb-2c50-46ed-af3b-e6966f0c4770 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:38.600117 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca09723-393b-4cd2-b129-e916453b291d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:38.600989 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca09723-393b-4cd2-b129-e916453b291d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:38.601271 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca09723-393b-4cd2-b129-e916453b291d admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:38.602154 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca09723-393b-4cd2-b129-e916453b291d admin admin] PATH_INFO: `/v3/projects/8ef88fd28474450daf52168756241d4e` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:38.603460 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca09723-393b-4cd2-b129-e916453b291d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ef88fd28474450daf52168756241d4e)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:38.605415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca09723-393b-4cd2-b129-e916453b291d admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:38.657208 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-9ca09723-393b-4cd2-b129-e916453b291d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ef88fd28474450daf52168756241d4e', 'request_id': 'req-9ca09723-393b-4cd2-b129-e916453b291d'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:38.663350 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-9ca09723-393b-4cd2-b129-e916453b291d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ef88fd28474450daf52168756241d4e', 'request_id': 'req-9ca09723-393b-4cd2-b129-e916453b291d'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:38.674837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-9ca09723-393b-4cd2-b129-e916453b291d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ef88fd28474450daf52168756241d4e', 'request_id': 'req-9ca09723-393b-4cd2-b129-e916453b291d'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:38.684764 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-9ca09723-393b-4cd2-b129-e916453b291d admin admin] The token cache is being invalidate because project 8ef88fd28474450daf52168756241d4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:38.685051 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-9ca09723-393b-4cd2-b129-e916453b291d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:38.685655 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-9ca09723-393b-4cd2-b129-e916453b291d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:38.687253 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1384/2781] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:38 2022] DELETE /identity/v3/projects/8ef88fd28474450daf52168756241d4e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:38.693266 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573c0fc-4854-4846-a1d9-b71943e4727e None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:38.693462 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573c0fc-4854-4846-a1d9-b71943e4727e None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:38.693756 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573c0fc-4854-4846-a1d9-b71943e4727e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:38.712083 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-2573c0fc-4854-4846-a1d9-b71943e4727e None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:38.713273 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-2573c0fc-4854-4846-a1d9-b71943e4727e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:38.772912 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1398/2782] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:38.783078 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38fda6-4c20-4570-b7de-941b7d519238 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:38.783404 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38fda6-4c20-4570-b7de-941b7d519238 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:38.783682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38fda6-4c20-4570-b7de-941b7d519238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:38.803319 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-df38fda6-4c20-4570-b7de-941b7d519238 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:38.804558 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-df38fda6-4c20-4570-b7de-941b7d519238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:38.814097 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1385/2783] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:38.818527 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573c0fc-4854-4846-a1d9-b71943e4727e None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:38.830045 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573c0fc-4854-4846-a1d9-b71943e4727e None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:38.835526 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f120e5-85e8-496b-bc62-432586426732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:38.836198 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f120e5-85e8-496b-bc62-432586426732 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:38.836492 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f120e5-85e8-496b-bc62-432586426732 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:38.836779 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f120e5-85e8-496b-bc62-432586426732 admin admin] PATH_INFO: `/v3/domains` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:38.837504 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f120e5-85e8-496b-bc62-432586426732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:22:38.837820 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f120e5-85e8-496b-bc62-432586426732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:38.839474 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f120e5-85e8-496b-bc62-432586426732 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:38.852698 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1399/2784] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:22:38.857162 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38fda6-4c20-4570-b7de-941b7d519238 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:38.874241 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38fda6-4c20-4570-b7de-941b7d519238 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:38.877844 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18210c88-579a-414a-bd4e-3f910cdc6170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:38.878520 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18210c88-579a-414a-bd4e-3f910cdc6170 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:38.878801 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18210c88-579a-414a-bd4e-3f910cdc6170 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:38.879098 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18210c88-579a-414a-bd4e-3f910cdc6170 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:38.879802 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18210c88-579a-414a-bd4e-3f910cdc6170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:38.881720 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18210c88-579a-414a-bd4e-3f910cdc6170 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:38.911558 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1386/2785] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:22:38 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:22:38.915649 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f120e5-85e8-496b-bc62-432586426732 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:38.926340 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f120e5-85e8-496b-bc62-432586426732 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:38.984718 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b0c6d-e5e5-430c-9e4e-ab42014c3c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:38.985610 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b0c6d-e5e5-430c-9e4e-ab42014c3c4b admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:38.985977 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b0c6d-e5e5-430c-9e4e-ab42014c3c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:38.986345 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b0c6d-e5e5-430c-9e4e-ab42014c3c4b admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:38.987257 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b0c6d-e5e5-430c-9e4e-ab42014c3c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:38.992310 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b0c6d-e5e5-430c-9e4e-ab42014c3c4b admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:39.015896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1400/2786] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:22:38 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:22:39.019992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18210c88-579a-414a-bd4e-3f910cdc6170 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:39.033690 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18210c88-579a-414a-bd4e-3f910cdc6170 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:39.038519 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193aa9f-397d-48e8-ba69-7070fc07d4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:39.039235 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193aa9f-397d-48e8-ba69-7070fc07d4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:39.039539 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193aa9f-397d-48e8-ba69-7070fc07d4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:39.039782 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193aa9f-397d-48e8-ba69-7070fc07d4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:39.040511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193aa9f-397d-48e8-ba69-7070fc07d4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:39.042106 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193aa9f-397d-48e8-ba69-7070fc07d4b3 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:39.059381 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1387/2787] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 22:22:39.061169 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b0c6d-e5e5-430c-9e4e-ab42014c3c4b admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:39.071565 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b0c6d-e5e5-430c-9e4e-ab42014c3c4b admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:39.076216 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f118bb-6d42-48d1-8c36-b28e7d296d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:39.076893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f118bb-6d42-48d1-8c36-b28e7d296d5f admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:39.077307 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f118bb-6d42-48d1-8c36-b28e7d296d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:39.077714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f118bb-6d42-48d1-8c36-b28e7d296d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:39.078470 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f118bb-6d42-48d1-8c36-b28e7d296d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:39.080519 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f118bb-6d42-48d1-8c36-b28e7d296d5f admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:39.093072 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1401/2788] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:39.097368 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193aa9f-397d-48e8-ba69-7070fc07d4b3 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:39.108520 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193aa9f-397d-48e8-ba69-7070fc07d4b3 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:39.114333 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040a8d0-65dc-47b4-829d-ac96c26472fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:39.115264 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040a8d0-65dc-47b4-829d-ac96c26472fd admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:39.115548 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040a8d0-65dc-47b4-829d-ac96c26472fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:39.115826 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040a8d0-65dc-47b4-829d-ac96c26472fd admin admin] PATH_INFO: `/v3/projects/ef3374a6467a47a48a884d2747334d54/users/e1c06dab6ba4448385e995eec6721a17/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:39.131725 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040a8d0-65dc-47b4-829d-ac96c26472fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef3374a6467a47a48a884d2747334d54, user_id=e1c06dab6ba4448385e995eec6721a17, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:39.134428 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040a8d0-65dc-47b4-829d-ac96c26472fd admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:39.149338 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1388/2789] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:39 2022] PUT /identity/v3/projects/ef3374a6467a47a48a884d2747334d54/users/e1c06dab6ba4448385e995eec6721a17/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:39.154414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f577877-5799-45f3-a022-a0cbf148229f None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:39.154704 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f577877-5799-45f3-a022-a0cbf148229f None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:39.155034 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f577877-5799-45f3-a022-a0cbf148229f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:39.172860 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-0f577877-5799-45f3-a022-a0cbf148229f None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:39.174050 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-0f577877-5799-45f3-a022-a0cbf148229f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:39.241771 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1402/2790] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:39.255396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040a8d0-65dc-47b4-829d-ac96c26472fd admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:39.257409 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-1040a8d0-65dc-47b4-829d-ac96c26472fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:39.318354 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040a8d0-65dc-47b4-829d-ac96c26472fd admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:39.322509 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d5f54-beac-487b-b58a-0a24bd000f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:39.323204 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d5f54-beac-487b-b58a-0a24bd000f95 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:39.323488 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d5f54-beac-487b-b58a-0a24bd000f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:39.323758 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d5f54-beac-487b-b58a-0a24bd000f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:39.334425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d5f54-beac-487b-b58a-0a24bd000f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:39.335899 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d5f54-beac-487b-b58a-0a24bd000f95 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:39.345892 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1389/2791] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:22:39.974172 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bf3f0-848a-4f83-862f-9407090304ec None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:39.974466 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bf3f0-848a-4f83-862f-9407090304ec None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:39.974742 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bf3f0-848a-4f83-862f-9407090304ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:40.004894 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-6b8bf3f0-848a-4f83-862f-9407090304ec None None] MFA Rules not processed for user `e1c06dab6ba4448385e995eec6721a17`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:40.006115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-6b8bf3f0-848a-4f83-862f-9407090304ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:40.073073 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1403/2792] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:40.077538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d5f54-beac-487b-b58a-0a24bd000f95 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:40.088313 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d5f54-beac-487b-b58a-0a24bd000f95 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:40.104194 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2b577-e983-4df0-b0ae-1a774be069e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:40.105012 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2b577-e983-4df0-b0ae-1a774be069e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:40.105396 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2b577-e983-4df0-b0ae-1a774be069e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:40.105741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2b577-e983-4df0-b0ae-1a774be069e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:40.106910 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2b577-e983-4df0-b0ae-1a774be069e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:40.109127 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2b577-e983-4df0-b0ae-1a774be069e9 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:40.141486 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1390/2793] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:22:40 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:22:40.142968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bf3f0-848a-4f83-862f-9407090304ec None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:40.156453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bf3f0-848a-4f83-862f-9407090304ec None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:40.238826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0437fb0-33f3-423f-b3f8-6ddd5db7f93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:40.239580 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0437fb0-33f3-423f-b3f8-6ddd5db7f93e admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:40.239869 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0437fb0-33f3-423f-b3f8-6ddd5db7f93e admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:40.240145 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0437fb0-33f3-423f-b3f8-6ddd5db7f93e admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:40.241028 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0437fb0-33f3-423f-b3f8-6ddd5db7f93e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:40.243184 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0437fb0-33f3-423f-b3f8-6ddd5db7f93e admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:40.282499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1404/2794] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:22:40 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:40.286650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2b577-e983-4df0-b0ae-1a774be069e9 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:40.309902 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2b577-e983-4df0-b0ae-1a774be069e9 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:40.318722 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448986f-4367-45e2-82af-08d05ba87b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:40.319845 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448986f-4367-45e2-82af-08d05ba87b96 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:40.320373 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448986f-4367-45e2-82af-08d05ba87b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:40.320999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448986f-4367-45e2-82af-08d05ba87b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:40.322834 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448986f-4367-45e2-82af-08d05ba87b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:40.324992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448986f-4367-45e2-82af-08d05ba87b96 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:40.343176 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1391/2795] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:40.346249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0437fb0-33f3-423f-b3f8-6ddd5db7f93e admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:40.358226 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0437fb0-33f3-423f-b3f8-6ddd5db7f93e admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:40.363613 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6baf1-0b72-41a1-9f20-3e405d7d32e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:40.364651 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6baf1-0b72-41a1-9f20-3e405d7d32e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:40.364960 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6baf1-0b72-41a1-9f20-3e405d7d32e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:40.365346 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6baf1-0b72-41a1-9f20-3e405d7d32e5 admin admin] PATH_INFO: `/v3/projects/b17af3091a9c4012abcdc57ad037831f/users/ddd7d11fe31540dca339f3f020b60540/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:40.381812 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6baf1-0b72-41a1-9f20-3e405d7d32e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b17af3091a9c4012abcdc57ad037831f, user_id=ddd7d11fe31540dca339f3f020b60540, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:40.388074 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6baf1-0b72-41a1-9f20-3e405d7d32e5 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:40.403093 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1405/2796] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:40 2022] PUT /identity/v3/projects/b17af3091a9c4012abcdc57ad037831f/users/ddd7d11fe31540dca339f3f020b60540/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:40.407823 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448986f-4367-45e2-82af-08d05ba87b96 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:40.417936 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448986f-4367-45e2-82af-08d05ba87b96 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:40.477110 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3c862-ba30-4dfb-8779-1394c25a2937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:40.477796 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3c862-ba30-4dfb-8779-1394c25a2937 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:40.478085 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3c862-ba30-4dfb-8779-1394c25a2937 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:40.478428 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3c862-ba30-4dfb-8779-1394c25a2937 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:40.479202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3c862-ba30-4dfb-8779-1394c25a2937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:40.480875 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3c862-ba30-4dfb-8779-1394c25a2937 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:40.492526 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1392/2797] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 22:22:40.496762 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6baf1-0b72-41a1-9f20-3e405d7d32e5 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:40.508641 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6baf1-0b72-41a1-9f20-3e405d7d32e5 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:40.513480 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fde5f5-792e-481a-b682-45effa6ec36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:40.514538 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fde5f5-792e-481a-b682-45effa6ec36e admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:40.514826 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fde5f5-792e-481a-b682-45effa6ec36e admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:40.515166 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fde5f5-792e-481a-b682-45effa6ec36e admin admin] PATH_INFO: `/v3/projects/b17af3091a9c4012abcdc57ad037831f/users/ddd7d11fe31540dca339f3f020b60540/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:40.517510 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fde5f5-792e-481a-b682-45effa6ec36e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b17af3091a9c4012abcdc57ad037831f, user_id=ddd7d11fe31540dca339f3f020b60540, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:40.520522 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fde5f5-792e-481a-b682-45effa6ec36e admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:40.531692 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1406/2798] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:40 2022] PUT /identity/v3/projects/b17af3091a9c4012abcdc57ad037831f/users/ddd7d11fe31540dca339f3f020b60540/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:41.185704 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ad032-6c13-47f0-88e9-897768080a12 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:41.186279 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ad032-6c13-47f0-88e9-897768080a12 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:41.186279 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ad032-6c13-47f0-88e9-897768080a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:41.213733 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-559ad032-6c13-47f0-88e9-897768080a12 None None] MFA Rules not processed for user `ddd7d11fe31540dca339f3f020b60540`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:41.214956 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-559ad032-6c13-47f0-88e9-897768080a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:41.282269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1393/2799] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:41.294077 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fde5f5-792e-481a-b682-45effa6ec36e admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:41.295858 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-54fde5f5-792e-481a-b682-45effa6ec36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:41.354493 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fde5f5-792e-481a-b682-45effa6ec36e admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:41.358434 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28c7f6-f49c-4e13-976e-6047c065ddf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:41.359132 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28c7f6-f49c-4e13-976e-6047c065ddf0 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:41.359415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28c7f6-f49c-4e13-976e-6047c065ddf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:41.359693 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28c7f6-f49c-4e13-976e-6047c065ddf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:41.418331 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28c7f6-f49c-4e13-976e-6047c065ddf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:41.419820 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28c7f6-f49c-4e13-976e-6047c065ddf0 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:41.429244 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1407/2800] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:41.515362 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ad032-6c13-47f0-88e9-897768080a12 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:41.516887 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-559ad032-6c13-47f0-88e9-897768080a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:41.580803 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ad032-6c13-47f0-88e9-897768080a12 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:41.585569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1ecd0-7ed8-42be-8c57-db9324cc53b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:41.586529 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1ecd0-7ed8-42be-8c57-db9324cc53b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:41.587022 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1ecd0-7ed8-42be-8c57-db9324cc53b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:41.587346 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1ecd0-7ed8-42be-8c57-db9324cc53b2 admin admin] PATH_INFO: `/v3/users/dd3b07f64c314be4b48b53b2ee937f52` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:41.588960 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1ecd0-7ed8-42be-8c57-db9324cc53b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd3b07f64c314be4b48b53b2ee937f52)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:41.590928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1ecd0-7ed8-42be-8c57-db9324cc53b2 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:41.641950 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1de1ecd0-7ed8-42be-8c57-db9324cc53b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd3b07f64c314be4b48b53b2ee937f52'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:41.650480 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1de1ecd0-7ed8-42be-8c57-db9324cc53b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd3b07f64c314be4b48b53b2ee937f52'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:41.657756 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1de1ecd0-7ed8-42be-8c57-db9324cc53b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd3b07f64c314be4b48b53b2ee937f52'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:41.658520 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1de1ecd0-7ed8-42be-8c57-db9324cc53b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd3b07f64c314be4b48b53b2ee937f52'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:41.659243 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1de1ecd0-7ed8-42be-8c57-db9324cc53b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd3b07f64c314be4b48b53b2ee937f52'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:41.683538 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1394/2801] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:41 2022] DELETE /identity/v3/users/dd3b07f64c314be4b48b53b2ee937f52 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:41.683675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecf46b-2590-4c2a-8a7e-ea93283c8948 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:41.683675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecf46b-2590-4c2a-8a7e-ea93283c8948 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:41.683675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecf46b-2590-4c2a-8a7e-ea93283c8948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:41.701468 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-78ecf46b-2590-4c2a-8a7e-ea93283c8948 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:41.703062 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-78ecf46b-2590-4c2a-8a7e-ea93283c8948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:41.767360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1408/2802] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:41.780402 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1ecd0-7ed8-42be-8c57-db9324cc53b2 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:41.782495 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-1de1ecd0-7ed8-42be-8c57-db9324cc53b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:41.842723 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1ecd0-7ed8-42be-8c57-db9324cc53b2 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:41.847388 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0894f2-acd1-43dc-8280-40f331e3912f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:41.848043 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0894f2-acd1-43dc-8280-40f331e3912f service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:41.848331 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0894f2-acd1-43dc-8280-40f331e3912f service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:41.848608 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0894f2-acd1-43dc-8280-40f331e3912f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:41.858712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0894f2-acd1-43dc-8280-40f331e3912f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:41.860236 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0894f2-acd1-43dc-8280-40f331e3912f service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:41.870103 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1395/2803] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:22:42.199801 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecf46b-2590-4c2a-8a7e-ea93283c8948 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:42.201435 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-78ecf46b-2590-4c2a-8a7e-ea93283c8948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:42.214036 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecf46b-2590-4c2a-8a7e-ea93283c8948 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:42.219584 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333bdb0-f902-49d4-8b4f-46642793e7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:42.220436 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333bdb0-f902-49d4-8b4f-46642793e7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:42.221353 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333bdb0-f902-49d4-8b4f-46642793e7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:42.221647 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333bdb0-f902-49d4-8b4f-46642793e7b6 admin admin] PATH_INFO: `/v3/projects/bba2c07c73304cfc9df80f95154efaa6` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:42.222943 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333bdb0-f902-49d4-8b4f-46642793e7b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba2c07c73304cfc9df80f95154efaa6)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:42.224915 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333bdb0-f902-49d4-8b4f-46642793e7b6 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:42.284946 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e333bdb0-f902-49d4-8b4f-46642793e7b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba2c07c73304cfc9df80f95154efaa6', 'request_id': 'req-e333bdb0-f902-49d4-8b4f-46642793e7b6'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:42.293080 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e333bdb0-f902-49d4-8b4f-46642793e7b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba2c07c73304cfc9df80f95154efaa6', 'request_id': 'req-e333bdb0-f902-49d4-8b4f-46642793e7b6'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:42.300135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e333bdb0-f902-49d4-8b4f-46642793e7b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba2c07c73304cfc9df80f95154efaa6', 'request_id': 'req-e333bdb0-f902-49d4-8b4f-46642793e7b6'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:42.310604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e333bdb0-f902-49d4-8b4f-46642793e7b6 admin admin] The token cache is being invalidate because project bba2c07c73304cfc9df80f95154efaa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:42.310889 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e333bdb0-f902-49d4-8b4f-46642793e7b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:42.311557 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-e333bdb0-f902-49d4-8b4f-46642793e7b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:42.313400 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1409/2804] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:42 2022] DELETE /identity/v3/projects/bba2c07c73304cfc9df80f95154efaa6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:42.318501 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601b36a-5d87-4521-8862-20eca36d57e2 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:42.319012 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601b36a-5d87-4521-8862-20eca36d57e2 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:42.319140 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601b36a-5d87-4521-8862-20eca36d57e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:42.338501 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-6601b36a-5d87-4521-8862-20eca36d57e2 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:42.340080 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-6601b36a-5d87-4521-8862-20eca36d57e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:42.399458 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1396/2805] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:42.408825 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d7991-4fdb-46be-bc7b-58b1138ff3aa None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:42.409211 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d7991-4fdb-46be-bc7b-58b1138ff3aa None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:42.409548 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d7991-4fdb-46be-bc7b-58b1138ff3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:42.428456 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-830d7991-4fdb-46be-bc7b-58b1138ff3aa None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:42.429789 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-830d7991-4fdb-46be-bc7b-58b1138ff3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:42.437791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1410/2806] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:42.442712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601b36a-5d87-4521-8862-20eca36d57e2 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:42.453659 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601b36a-5d87-4521-8862-20eca36d57e2 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:42.459658 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddb302-b38a-4ec0-a2b8-6e6ae8d40351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:42.460323 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddb302-b38a-4ec0-a2b8-6e6ae8d40351 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:42.460765 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddb302-b38a-4ec0-a2b8-6e6ae8d40351 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:42.461052 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddb302-b38a-4ec0-a2b8-6e6ae8d40351 admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:42.461788 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddb302-b38a-4ec0-a2b8-6e6ae8d40351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:22:42.462102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddb302-b38a-4ec0-a2b8-6e6ae8d40351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:42.463760 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddb302-b38a-4ec0-a2b8-6e6ae8d40351 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:42.475985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1397/2807] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:22:42.480517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d7991-4fdb-46be-bc7b-58b1138ff3aa None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:42.490095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d7991-4fdb-46be-bc7b-58b1138ff3aa None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:42.494958 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b2561-bb59-4e23-8778-ed0117a80736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:42.495656 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b2561-bb59-4e23-8778-ed0117a80736 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:42.495937 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b2561-bb59-4e23-8778-ed0117a80736 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:42.496210 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b2561-bb59-4e23-8778-ed0117a80736 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:42.496940 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b2561-bb59-4e23-8778-ed0117a80736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:42.498845 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b2561-bb59-4e23-8778-ed0117a80736 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:42.525904 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1411/2808] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:22:42 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:42.530126 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddb302-b38a-4ec0-a2b8-6e6ae8d40351 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:42.540418 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddb302-b38a-4ec0-a2b8-6e6ae8d40351 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:42.598877 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13433d33-7283-4f1f-8e0e-737e7bee852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:42.599614 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13433d33-7283-4f1f-8e0e-737e7bee852c admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:42.599992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13433d33-7283-4f1f-8e0e-737e7bee852c admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:42.600283 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13433d33-7283-4f1f-8e0e-737e7bee852c admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:42.600982 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13433d33-7283-4f1f-8e0e-737e7bee852c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:42.602965 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13433d33-7283-4f1f-8e0e-737e7bee852c admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:42.625671 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1398/2809] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:22:42 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:42.630179 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b2561-bb59-4e23-8778-ed0117a80736 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:42.641577 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b2561-bb59-4e23-8778-ed0117a80736 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:42.646501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ba15d-30a6-4e30-85f3-d244b6824b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:42.647260 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ba15d-30a6-4e30-85f3-d244b6824b10 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:42.647583 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ba15d-30a6-4e30-85f3-d244b6824b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:42.647828 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ba15d-30a6-4e30-85f3-d244b6824b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:42.648788 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ba15d-30a6-4e30-85f3-d244b6824b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:42.650529 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ba15d-30a6-4e30-85f3-d244b6824b10 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:42.664164 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1412/2810] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:42.668385 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13433d33-7283-4f1f-8e0e-737e7bee852c admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:42.678505 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13433d33-7283-4f1f-8e0e-737e7bee852c admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:42.683276 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a359ff3-d1c0-486f-a958-867d9204f158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:42.683957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a359ff3-d1c0-486f-a958-867d9204f158 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:42.684244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a359ff3-d1c0-486f-a958-867d9204f158 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:42.684551 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a359ff3-d1c0-486f-a958-867d9204f158 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:42.685277 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a359ff3-d1c0-486f-a958-867d9204f158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:42.686926 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a359ff3-d1c0-486f-a958-867d9204f158 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:42.697553 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1399/2811] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:42.701899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ba15d-30a6-4e30-85f3-d244b6824b10 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:42.712505 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ba15d-30a6-4e30-85f3-d244b6824b10 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:42.717441 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2beb37-de07-4548-a78c-a946017e5dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:42.718395 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2beb37-de07-4548-a78c-a946017e5dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:42.718687 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2beb37-de07-4548-a78c-a946017e5dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:42.718972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2beb37-de07-4548-a78c-a946017e5dbe admin admin] PATH_INFO: `/v3/projects/224c2f4fe5e848c4b25160cd0131822b/users/3f211db48c6f499d8997fa60dca573c0/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:42.749295 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2beb37-de07-4548-a78c-a946017e5dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=224c2f4fe5e848c4b25160cd0131822b, user_id=3f211db48c6f499d8997fa60dca573c0, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:42.753085 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2beb37-de07-4548-a78c-a946017e5dbe admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:42.777616 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1413/2812] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:42 2022] PUT /identity/v3/projects/224c2f4fe5e848c4b25160cd0131822b/users/3f211db48c6f499d8997fa60dca573c0/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:42.789508 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed604c3c-bcd2-4102-aa2d-a2dda6df550f None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:42.790155 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed604c3c-bcd2-4102-aa2d-a2dda6df550f None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:42.790980 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed604c3c-bcd2-4102-aa2d-a2dda6df550f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:42.808438 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2beb37-de07-4548-a78c-a946017e5dbe admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:42.810181 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-fb2beb37-de07-4548-a78c-a946017e5dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:42.820242 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-ed604c3c-bcd2-4102-aa2d-a2dda6df550f None None] MFA Rules not processed for user `3f211db48c6f499d8997fa60dca573c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:42.821470 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-ed604c3c-bcd2-4102-aa2d-a2dda6df550f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:42.870369 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2beb37-de07-4548-a78c-a946017e5dbe admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:42.874322 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76934e-c85b-4b9b-8e7c-de260eceb8df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:42.874993 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76934e-c85b-4b9b-8e7c-de260eceb8df service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:42.875344 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76934e-c85b-4b9b-8e7c-de260eceb8df service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:42.875626 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76934e-c85b-4b9b-8e7c-de260eceb8df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:42.877678 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-0c76934e-c85b-4b9b-8e7c-de260eceb8df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:42.890431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1400/2813] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:42.895474 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed604c3c-bcd2-4102-aa2d-a2dda6df550f None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:42.944410 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76934e-c85b-4b9b-8e7c-de260eceb8df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:42.945861 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76934e-c85b-4b9b-8e7c-de260eceb8df service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:42.955870 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1414/2814] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:22:42.959241 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed604c3c-bcd2-4102-aa2d-a2dda6df550f None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:42.963829 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245d6e8-dacb-45f0-b600-a836e1a37a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:42.964494 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245d6e8-dacb-45f0-b600-a836e1a37a3d admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:42.964776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245d6e8-dacb-45f0-b600-a836e1a37a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:42.965053 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245d6e8-dacb-45f0-b600-a836e1a37a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:42.965739 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245d6e8-dacb-45f0-b600-a836e1a37a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:42.967710 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245d6e8-dacb-45f0-b600-a836e1a37a3d admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:42.994159 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1401/2815] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:22:42 2022] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:22:42.998732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76934e-c85b-4b9b-8e7c-de260eceb8df service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:43.009461 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76934e-c85b-4b9b-8e7c-de260eceb8df service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:43.072211 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffc6f1-6ab2-4055-88d4-8032b397c797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:43.072917 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffc6f1-6ab2-4055-88d4-8032b397c797 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:43.073205 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffc6f1-6ab2-4055-88d4-8032b397c797 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:43.073490 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffc6f1-6ab2-4055-88d4-8032b397c797 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:43.074222 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffc6f1-6ab2-4055-88d4-8032b397c797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:43.076273 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffc6f1-6ab2-4055-88d4-8032b397c797 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:43.108357 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1415/2816] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:22:42 2022] POST /identity/v3/users => generated 307 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:22:43.116524 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245d6e8-dacb-45f0-b600-a836e1a37a3d admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:43.127999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245d6e8-dacb-45f0-b600-a836e1a37a3d admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:43.133746 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d06ee1-c530-40d4-ba93-afd5c07a3b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:43.134460 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d06ee1-c530-40d4-ba93-afd5c07a3b3c admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:43.136136 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d06ee1-c530-40d4-ba93-afd5c07a3b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:43.136136 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d06ee1-c530-40d4-ba93-afd5c07a3b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:43.136136 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d06ee1-c530-40d4-ba93-afd5c07a3b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:43.137536 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d06ee1-c530-40d4-ba93-afd5c07a3b3c admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:43.150650 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1402/2817] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:43.154932 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffc6f1-6ab2-4055-88d4-8032b397c797 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:43.166689 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffc6f1-6ab2-4055-88d4-8032b397c797 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:43.173414 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a3ab4-9b28-4f13-a028-0118406bc5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:43.174357 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a3ab4-9b28-4f13-a028-0118406bc5ad admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:43.174680 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a3ab4-9b28-4f13-a028-0118406bc5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:43.174986 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a3ab4-9b28-4f13-a028-0118406bc5ad admin admin] PATH_INFO: `/v3/projects/4a9c615f79b641aa8b8cce8976ed9038/users/d950211b20284ae2851e94c286af8000/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:43.198036 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a3ab4-9b28-4f13-a028-0118406bc5ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a9c615f79b641aa8b8cce8976ed9038, user_id=d950211b20284ae2851e94c286af8000, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:43.199762 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a3ab4-9b28-4f13-a028-0118406bc5ad admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:43.217601 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1416/2818] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:43 2022] PUT /identity/v3/projects/4a9c615f79b641aa8b8cce8976ed9038/users/d950211b20284ae2851e94c286af8000/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:43.222222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d06ee1-c530-40d4-ba93-afd5c07a3b3c admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:43.233888 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d06ee1-c530-40d4-ba93-afd5c07a3b3c admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:43.304412 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b82e69-a6b9-46d3-a055-2e42cb9fc87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:43.305090 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b82e69-a6b9-46d3-a055-2e42cb9fc87f admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:43.305373 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b82e69-a6b9-46d3-a055-2e42cb9fc87f admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:43.305670 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b82e69-a6b9-46d3-a055-2e42cb9fc87f admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:43.306359 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b82e69-a6b9-46d3-a055-2e42cb9fc87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:43.307994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b82e69-a6b9-46d3-a055-2e42cb9fc87f admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:43.321311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1403/2819] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:43.322711 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a3ab4-9b28-4f13-a028-0118406bc5ad admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:43.333716 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a3ab4-9b28-4f13-a028-0118406bc5ad admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:43.338722 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b3a0b-6eab-4e8f-81b1-808819c42d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:43.339668 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b3a0b-6eab-4e8f-81b1-808819c42d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:43.339958 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b3a0b-6eab-4e8f-81b1-808819c42d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:43.340238 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b3a0b-6eab-4e8f-81b1-808819c42d3f admin admin] PATH_INFO: `/v3/projects/4a9c615f79b641aa8b8cce8976ed9038/users/d950211b20284ae2851e94c286af8000/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:43.342195 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b3a0b-6eab-4e8f-81b1-808819c42d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a9c615f79b641aa8b8cce8976ed9038, user_id=d950211b20284ae2851e94c286af8000, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:43.345171 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b3a0b-6eab-4e8f-81b1-808819c42d3f admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:43.356033 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1417/2820] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:43 2022] PUT /identity/v3/projects/4a9c615f79b641aa8b8cce8976ed9038/users/d950211b20284ae2851e94c286af8000/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:43.367348 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4403d7e-64e6-4a54-83b7-392162a626aa None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:43.367706 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4403d7e-64e6-4a54-83b7-392162a626aa None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:43.367998 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4403d7e-64e6-4a54-83b7-392162a626aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:43.398337 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-c4403d7e-64e6-4a54-83b7-392162a626aa None None] MFA Rules not processed for user `d950211b20284ae2851e94c286af8000`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:43.399512 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c4403d7e-64e6-4a54-83b7-392162a626aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:43.473964 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1404/2821] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:43 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:43.484928 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b3a0b-6eab-4e8f-81b1-808819c42d3f admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:43.541001 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b3a0b-6eab-4e8f-81b1-808819c42d3f admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:43.544612 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee08ed-f201-4338-832e-433bedbbe193 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:43.545258 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee08ed-f201-4338-832e-433bedbbe193 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:43.545539 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee08ed-f201-4338-832e-433bedbbe193 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:43.545823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee08ed-f201-4338-832e-433bedbbe193 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:43.554750 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee08ed-f201-4338-832e-433bedbbe193 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:43.556215 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee08ed-f201-4338-832e-433bedbbe193 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:43.565948 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1418/2822] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:43 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:43.701113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4403d7e-64e6-4a54-83b7-392162a626aa None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:43.769912 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4403d7e-64e6-4a54-83b7-392162a626aa None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:43.774439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ddec6-93e7-4e71-a9c5-e84cd8f6c49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:43.775567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ddec6-93e7-4e71-a9c5-e84cd8f6c49b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:43.775670 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ddec6-93e7-4e71-a9c5-e84cd8f6c49b admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:43.775896 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ddec6-93e7-4e71-a9c5-e84cd8f6c49b admin admin] PATH_INFO: `/v3/users/3f211db48c6f499d8997fa60dca573c0` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:43.777203 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ddec6-93e7-4e71-a9c5-e84cd8f6c49b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f211db48c6f499d8997fa60dca573c0)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:43.779192 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ddec6-93e7-4e71-a9c5-e84cd8f6c49b admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:43.830970 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-853ddec6-93e7-4e71-a9c5-e84cd8f6c49b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f211db48c6f499d8997fa60dca573c0'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:43.839755 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-853ddec6-93e7-4e71-a9c5-e84cd8f6c49b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f211db48c6f499d8997fa60dca573c0'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:43.846866 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-853ddec6-93e7-4e71-a9c5-e84cd8f6c49b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f211db48c6f499d8997fa60dca573c0'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:43.847753 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-853ddec6-93e7-4e71-a9c5-e84cd8f6c49b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f211db48c6f499d8997fa60dca573c0'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:43.848430 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-853ddec6-93e7-4e71-a9c5-e84cd8f6c49b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f211db48c6f499d8997fa60dca573c0'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:43.865291 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1405/2823] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:43 2022] DELETE /identity/v3/users/3f211db48c6f499d8997fa60dca573c0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:43.869900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338822fe-d460-41ff-bfde-f7367b63bde2 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:43.870293 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338822fe-d460-41ff-bfde-f7367b63bde2 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:43.870475 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338822fe-d460-41ff-bfde-f7367b63bde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:43.888781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-338822fe-d460-41ff-bfde-f7367b63bde2 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:43.890154 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-338822fe-d460-41ff-bfde-f7367b63bde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:43.949748 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1419/2824] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:43.960429 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ddec6-93e7-4e71-a9c5-e84cd8f6c49b admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:43.961935 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-853ddec6-93e7-4e71-a9c5-e84cd8f6c49b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:44.022577 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ddec6-93e7-4e71-a9c5-e84cd8f6c49b admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:44.026232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482849d-7f55-408c-926e-04deb7c5c721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:44.026889 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482849d-7f55-408c-926e-04deb7c5c721 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:44.027258 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482849d-7f55-408c-926e-04deb7c5c721 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:44.027629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482849d-7f55-408c-926e-04deb7c5c721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:44.037502 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482849d-7f55-408c-926e-04deb7c5c721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:44.038957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482849d-7f55-408c-926e-04deb7c5c721 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:44.049556 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1406/2825] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:44.330555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338822fe-d460-41ff-bfde-f7367b63bde2 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:44.333207 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-338822fe-d460-41ff-bfde-f7367b63bde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:44.367526 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338822fe-d460-41ff-bfde-f7367b63bde2 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:44.376780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e6ec7-84c4-498e-9203-965b9eb6e9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:44.377665 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e6ec7-84c4-498e-9203-965b9eb6e9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:44.377951 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e6ec7-84c4-498e-9203-965b9eb6e9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:44.378230 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e6ec7-84c4-498e-9203-965b9eb6e9d0 admin admin] PATH_INFO: `/v3/projects/224c2f4fe5e848c4b25160cd0131822b` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:44.379473 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e6ec7-84c4-498e-9203-965b9eb6e9d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=224c2f4fe5e848c4b25160cd0131822b)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:44.381407 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e6ec7-84c4-498e-9203-965b9eb6e9d0 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:44.430519 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a67e6ec7-84c4-498e-9203-965b9eb6e9d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '224c2f4fe5e848c4b25160cd0131822b', 'request_id': 'req-a67e6ec7-84c4-498e-9203-965b9eb6e9d0'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:44.439373 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a67e6ec7-84c4-498e-9203-965b9eb6e9d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '224c2f4fe5e848c4b25160cd0131822b', 'request_id': 'req-a67e6ec7-84c4-498e-9203-965b9eb6e9d0'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:44.446577 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a67e6ec7-84c4-498e-9203-965b9eb6e9d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '224c2f4fe5e848c4b25160cd0131822b', 'request_id': 'req-a67e6ec7-84c4-498e-9203-965b9eb6e9d0'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:44.458728 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a67e6ec7-84c4-498e-9203-965b9eb6e9d0 admin admin] The token cache is being invalidate because project 224c2f4fe5e848c4b25160cd0131822b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:44.459012 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a67e6ec7-84c4-498e-9203-965b9eb6e9d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:44.459742 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-a67e6ec7-84c4-498e-9203-965b9eb6e9d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:44.461288 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1420/2826] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:44 2022] DELETE /identity/v3/projects/224c2f4fe5e848c4b25160cd0131822b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:22:44.465375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482849d-7f55-408c-926e-04deb7c5c721 service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:44.475460 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482849d-7f55-408c-926e-04deb7c5c721 service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:44.537991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7f50e-2c49-4989-b7fc-ba5af806a6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:44.537991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7f50e-2c49-4989-b7fc-ba5af806a6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:44.537991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7f50e-2c49-4989-b7fc-ba5af806a6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:44.537991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7f50e-2c49-4989-b7fc-ba5af806a6d2 admin admin] PATH_INFO: `/v3/users/d950211b20284ae2851e94c286af8000` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:44.539210 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7f50e-2c49-4989-b7fc-ba5af806a6d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d950211b20284ae2851e94c286af8000)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:44.541435 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7f50e-2c49-4989-b7fc-ba5af806a6d2 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:44.596588 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e8f7f50e-2c49-4989-b7fc-ba5af806a6d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd950211b20284ae2851e94c286af8000'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:44.606342 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e8f7f50e-2c49-4989-b7fc-ba5af806a6d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd950211b20284ae2851e94c286af8000'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:44.613810 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e8f7f50e-2c49-4989-b7fc-ba5af806a6d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd950211b20284ae2851e94c286af8000'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:44.614507 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e8f7f50e-2c49-4989-b7fc-ba5af806a6d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd950211b20284ae2851e94c286af8000'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:44.615254 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-e8f7f50e-2c49-4989-b7fc-ba5af806a6d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd950211b20284ae2851e94c286af8000'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:44.632719 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1407/2827] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:44 2022] DELETE /identity/v3/users/d950211b20284ae2851e94c286af8000 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:22:44.910399 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e6ec7-84c4-498e-9203-965b9eb6e9d0 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:44.911945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-a67e6ec7-84c4-498e-9203-965b9eb6e9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:44.925480 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e6ec7-84c4-498e-9203-965b9eb6e9d0 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:44.992408 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf04818-a823-4754-a659-9d86fe966051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:44.993277 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf04818-a823-4754-a659-9d86fe966051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:44.993562 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf04818-a823-4754-a659-9d86fe966051 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:44.993836 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf04818-a823-4754-a659-9d86fe966051 admin admin] PATH_INFO: `/v3/projects/4a9c615f79b641aa8b8cce8976ed9038` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:44.995030 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf04818-a823-4754-a659-9d86fe966051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a9c615f79b641aa8b8cce8976ed9038)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:44.996968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf04818-a823-4754-a659-9d86fe966051 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:45.044697 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ecf04818-a823-4754-a659-9d86fe966051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a9c615f79b641aa8b8cce8976ed9038', 'request_id': 'req-ecf04818-a823-4754-a659-9d86fe966051'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:45.054388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ecf04818-a823-4754-a659-9d86fe966051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a9c615f79b641aa8b8cce8976ed9038', 'request_id': 'req-ecf04818-a823-4754-a659-9d86fe966051'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:45.061061 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ecf04818-a823-4754-a659-9d86fe966051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a9c615f79b641aa8b8cce8976ed9038', 'request_id': 'req-ecf04818-a823-4754-a659-9d86fe966051'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:45.071193 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ecf04818-a823-4754-a659-9d86fe966051 admin admin] The token cache is being invalidate because project 4a9c615f79b641aa8b8cce8976ed9038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:45.071471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ecf04818-a823-4754-a659-9d86fe966051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:45.072090 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-ecf04818-a823-4754-a659-9d86fe966051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:45.073630 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1421/2828] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:44 2022] DELETE /identity/v3/projects/4a9c615f79b641aa8b8cce8976ed9038 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:45.079945 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ef3d1-5ebe-4892-81bc-d4e4d51f0779 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:45.080263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ef3d1-5ebe-4892-81bc-d4e4d51f0779 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:45.080567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ef3d1-5ebe-4892-81bc-d4e4d51f0779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:45.099956 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-a88ef3d1-5ebe-4892-81bc-d4e4d51f0779 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:45.101158 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a88ef3d1-5ebe-4892-81bc-d4e4d51f0779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:45.174447 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1408/2829] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:45.184410 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe4c6d-82af-43fc-97f6-1256ddcf3832 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:45.184697 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe4c6d-82af-43fc-97f6-1256ddcf3832 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:45.184972 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe4c6d-82af-43fc-97f6-1256ddcf3832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:45.204781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-2abe4c6d-82af-43fc-97f6-1256ddcf3832 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:45.206000 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-2abe4c6d-82af-43fc-97f6-1256ddcf3832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:45.214420 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1422/2830] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:45.218893 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ef3d1-5ebe-4892-81bc-d4e4d51f0779 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:45.229130 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ef3d1-5ebe-4892-81bc-d4e4d51f0779 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:45.233903 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15de7db-aeca-4bdb-b80e-b45b472f6468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:45.234564 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15de7db-aeca-4bdb-b80e-b45b472f6468 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:45.234849 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15de7db-aeca-4bdb-b80e-b45b472f6468 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:45.235184 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15de7db-aeca-4bdb-b80e-b45b472f6468 admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:45.235973 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15de7db-aeca-4bdb-b80e-b45b472f6468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:22:45.236285 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15de7db-aeca-4bdb-b80e-b45b472f6468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:45.237985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15de7db-aeca-4bdb-b80e-b45b472f6468 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:45.250077 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1409/2831] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:22:45.254916 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe4c6d-82af-43fc-97f6-1256ddcf3832 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:45.266294 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe4c6d-82af-43fc-97f6-1256ddcf3832 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:45.272249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152a94e-666a-4b5d-af67-377d29bb23d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:45.272892 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152a94e-666a-4b5d-af67-377d29bb23d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:45.273193 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152a94e-666a-4b5d-af67-377d29bb23d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:45.273488 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152a94e-666a-4b5d-af67-377d29bb23d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:45.274188 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152a94e-666a-4b5d-af67-377d29bb23d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:45.276177 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152a94e-666a-4b5d-af67-377d29bb23d3 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:45.304735 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1423/2832] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:22:45 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:22:45.308987 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15de7db-aeca-4bdb-b80e-b45b472f6468 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:45.319570 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15de7db-aeca-4bdb-b80e-b45b472f6468 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:45.377642 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfeca5a-3122-4f11-82ca-680edcc35259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:45.378310 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfeca5a-3122-4f11-82ca-680edcc35259 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:45.378678 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfeca5a-3122-4f11-82ca-680edcc35259 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:45.378959 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfeca5a-3122-4f11-82ca-680edcc35259 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:45.379682 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfeca5a-3122-4f11-82ca-680edcc35259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:45.381569 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfeca5a-3122-4f11-82ca-680edcc35259 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:45.407425 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1410/2833] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:22:45 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:45.412678 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152a94e-666a-4b5d-af67-377d29bb23d3 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:45.424556 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152a94e-666a-4b5d-af67-377d29bb23d3 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:45.429809 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46b6b8-f5d9-4e49-bce2-7c44e08f068f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:45.430474 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46b6b8-f5d9-4e49-bce2-7c44e08f068f admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:45.430764 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46b6b8-f5d9-4e49-bce2-7c44e08f068f admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:45.431068 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46b6b8-f5d9-4e49-bce2-7c44e08f068f admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:45.431821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46b6b8-f5d9-4e49-bce2-7c44e08f068f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:45.433443 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46b6b8-f5d9-4e49-bce2-7c44e08f068f admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:45.445544 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1424/2834] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:45.450321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfeca5a-3122-4f11-82ca-680edcc35259 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:45.461314 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfeca5a-3122-4f11-82ca-680edcc35259 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:45.466816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806a555-e645-4be7-9d5a-0512b79ae0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:45.467527 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806a555-e645-4be7-9d5a-0512b79ae0aa admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:45.467782 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806a555-e645-4be7-9d5a-0512b79ae0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:45.468069 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806a555-e645-4be7-9d5a-0512b79ae0aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:45.468788 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806a555-e645-4be7-9d5a-0512b79ae0aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:45.470485 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806a555-e645-4be7-9d5a-0512b79ae0aa admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:45.480709 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1411/2835] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:45.485145 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46b6b8-f5d9-4e49-bce2-7c44e08f068f admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:45.501315 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46b6b8-f5d9-4e49-bce2-7c44e08f068f admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:45.510371 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e741b25-e722-48db-8101-0d86439f9567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:45.511302 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e741b25-e722-48db-8101-0d86439f9567 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:45.511581 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e741b25-e722-48db-8101-0d86439f9567 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:45.511859 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e741b25-e722-48db-8101-0d86439f9567 admin admin] PATH_INFO: `/v3/projects/c5e909353ee541a2bd6d49227e670f60/users/2ea78dc470264f77a69e95d33c043f23/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:45.527439 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e741b25-e722-48db-8101-0d86439f9567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e909353ee541a2bd6d49227e670f60, user_id=2ea78dc470264f77a69e95d33c043f23, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:45.530118 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e741b25-e722-48db-8101-0d86439f9567 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:45.547143 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1425/2836] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:45 2022] PUT /identity/v3/projects/c5e909353ee541a2bd6d49227e670f60/users/2ea78dc470264f77a69e95d33c043f23/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:22:45.557827 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5de34-8807-4a78-b530-fe8315fe34ff None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:45.558156 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5de34-8807-4a78-b530-fe8315fe34ff None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:45.558531 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5de34-8807-4a78-b530-fe8315fe34ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:45.586713 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-34f5de34-8807-4a78-b530-fe8315fe34ff None None] MFA Rules not processed for user `2ea78dc470264f77a69e95d33c043f23`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:45.587954 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-34f5de34-8807-4a78-b530-fe8315fe34ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:45.652544 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1412/2837] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:45.658878 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e741b25-e722-48db-8101-0d86439f9567 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:45.723446 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e741b25-e722-48db-8101-0d86439f9567 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:45.728568 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103bcbb-22d3-45b2-af18-b0ee5cc389f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:45.729240 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103bcbb-22d3-45b2-af18-b0ee5cc389f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:45.729527 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103bcbb-22d3-45b2-af18-b0ee5cc389f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:45.729819 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103bcbb-22d3-45b2-af18-b0ee5cc389f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:45.730508 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103bcbb-22d3-45b2-af18-b0ee5cc389f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:45.732486 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103bcbb-22d3-45b2-af18-b0ee5cc389f3 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:45.760406 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1426/2838] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:22:45 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:45.764636 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5de34-8807-4a78-b530-fe8315fe34ff None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:45.775260 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5de34-8807-4a78-b530-fe8315fe34ff None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:45.836042 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b25d8-2613-4e48-bbcd-7f3bcec2bec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:45.836633 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b25d8-2613-4e48-bbcd-7f3bcec2bec9 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:45.836931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b25d8-2613-4e48-bbcd-7f3bcec2bec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:45.837188 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b25d8-2613-4e48-bbcd-7f3bcec2bec9 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:45.837931 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b25d8-2613-4e48-bbcd-7f3bcec2bec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:45.839831 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b25d8-2613-4e48-bbcd-7f3bcec2bec9 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:45.877053 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1413/2839] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:22:45 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:45.881234 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103bcbb-22d3-45b2-af18-b0ee5cc389f3 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:45.892430 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103bcbb-22d3-45b2-af18-b0ee5cc389f3 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:45.898320 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83d58f-9414-4e4d-a5b2-c741e2ccaea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:45.899209 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83d58f-9414-4e4d-a5b2-c741e2ccaea9 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:45.899499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83d58f-9414-4e4d-a5b2-c741e2ccaea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:45.899780 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83d58f-9414-4e4d-a5b2-c741e2ccaea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:45.900515 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83d58f-9414-4e4d-a5b2-c741e2ccaea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:45.902139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83d58f-9414-4e4d-a5b2-c741e2ccaea9 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:45.912906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1427/2840] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:45.917300 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b25d8-2613-4e48-bbcd-7f3bcec2bec9 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:45.927865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b25d8-2613-4e48-bbcd-7f3bcec2bec9 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:45.933503 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c0bd0-360a-4dc0-9358-d5a538720438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:45.934404 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c0bd0-360a-4dc0-9358-d5a538720438 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:45.934687 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c0bd0-360a-4dc0-9358-d5a538720438 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:45.934959 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c0bd0-360a-4dc0-9358-d5a538720438 admin admin] PATH_INFO: `/v3/projects/8e6283493af94c828dd1bf00d60f0639/users/8ec4a68e9749446aae6185990f5b1d84/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:45.950190 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c0bd0-360a-4dc0-9358-d5a538720438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6283493af94c828dd1bf00d60f0639, user_id=8ec4a68e9749446aae6185990f5b1d84, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:45.952914 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c0bd0-360a-4dc0-9358-d5a538720438 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:45.968832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1414/2841] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:45 2022] PUT /identity/v3/projects/8e6283493af94c828dd1bf00d60f0639/users/8ec4a68e9749446aae6185990f5b1d84/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:22:45.973245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83d58f-9414-4e4d-a5b2-c741e2ccaea9 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:45.983582 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83d58f-9414-4e4d-a5b2-c741e2ccaea9 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:46.046104 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f205687-a391-45c1-97a8-cd51981203ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:46.047001 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f205687-a391-45c1-97a8-cd51981203ac admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:46.047409 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f205687-a391-45c1-97a8-cd51981203ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:46.047740 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f205687-a391-45c1-97a8-cd51981203ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:46.048755 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f205687-a391-45c1-97a8-cd51981203ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:46.051163 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f205687-a391-45c1-97a8-cd51981203ac admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:46.061481 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1428/2842] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:46.065991 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c0bd0-360a-4dc0-9358-d5a538720438 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:46.076889 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c0bd0-360a-4dc0-9358-d5a538720438 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:46.082446 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfa2b2-26e5-44b0-9814-4a64ade00a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:46.083374 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfa2b2-26e5-44b0-9814-4a64ade00a1e admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:46.083658 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfa2b2-26e5-44b0-9814-4a64ade00a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:46.083937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfa2b2-26e5-44b0-9814-4a64ade00a1e admin admin] PATH_INFO: `/v3/projects/8e6283493af94c828dd1bf00d60f0639/users/8ec4a68e9749446aae6185990f5b1d84/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:46.085934 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfa2b2-26e5-44b0-9814-4a64ade00a1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6283493af94c828dd1bf00d60f0639, user_id=8ec4a68e9749446aae6185990f5b1d84, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:46.088665 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfa2b2-26e5-44b0-9814-4a64ade00a1e admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:46.099224 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1415/2843] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:46 2022] PUT /identity/v3/projects/8e6283493af94c828dd1bf00d60f0639/users/8ec4a68e9749446aae6185990f5b1d84/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:46.111335 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b0e61-a5a0-46fb-83cd-51df3102779e None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:46.111630 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b0e61-a5a0-46fb-83cd-51df3102779e None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:46.111907 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b0e61-a5a0-46fb-83cd-51df3102779e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:46.141558 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-6e6b0e61-a5a0-46fb-83cd-51df3102779e None None] MFA Rules not processed for user `8ec4a68e9749446aae6185990f5b1d84`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:46.142775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-6e6b0e61-a5a0-46fb-83cd-51df3102779e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:46.207764 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1429/2844] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:46.219437 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfa2b2-26e5-44b0-9814-4a64ade00a1e admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:46.221660 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-dcbfa2b2-26e5-44b0-9814-4a64ade00a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:46.282711 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfa2b2-26e5-44b0-9814-4a64ade00a1e admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:46.286943 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b3582-d834-4f22-b663-f8c1d5fdd9ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:46.287626 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b3582-d834-4f22-b663-f8c1d5fdd9ef service cinder] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:46.287917 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b3582-d834-4f22-b663-f8c1d5fdd9ef service cinder] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:46.288192 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b3582-d834-4f22-b663-f8c1d5fdd9ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:46.298269 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b3582-d834-4f22-b663-f8c1d5fdd9ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:46.299905 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b3582-d834-4f22-b663-f8c1d5fdd9ef service cinder] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:46.309465 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1416/2845] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:46.373217 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b0e61-a5a0-46fb-83cd-51df3102779e None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:46.443222 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b0e61-a5a0-46fb-83cd-51df3102779e None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:46.448523 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf00ba6-8ed6-4f39-a5a1-2baf9049af8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:46.449568 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf00ba6-8ed6-4f39-a5a1-2baf9049af8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:46.449806 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf00ba6-8ed6-4f39-a5a1-2baf9049af8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:46.450109 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf00ba6-8ed6-4f39-a5a1-2baf9049af8b admin admin] PATH_INFO: `/v3/users/2ea78dc470264f77a69e95d33c043f23` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:46.451778 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf00ba6-8ed6-4f39-a5a1-2baf9049af8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea78dc470264f77a69e95d33c043f23)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:46.453863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf00ba6-8ed6-4f39-a5a1-2baf9049af8b admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:46.508431 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-cdf00ba6-8ed6-4f39-a5a1-2baf9049af8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea78dc470264f77a69e95d33c043f23'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:46.515867 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-cdf00ba6-8ed6-4f39-a5a1-2baf9049af8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea78dc470264f77a69e95d33c043f23'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:46.516545 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-cdf00ba6-8ed6-4f39-a5a1-2baf9049af8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea78dc470264f77a69e95d33c043f23'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:46.527933 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-cdf00ba6-8ed6-4f39-a5a1-2baf9049af8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea78dc470264f77a69e95d33c043f23'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:46.537529 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-cdf00ba6-8ed6-4f39-a5a1-2baf9049af8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea78dc470264f77a69e95d33c043f23'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:46.543647 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1430/2846] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:46 2022] DELETE /identity/v3/users/2ea78dc470264f77a69e95d33c043f23 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:46.548492 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45235bcb-64b3-4a61-a1e6-fd932b310170 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:46.549028 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45235bcb-64b3-4a61-a1e6-fd932b310170 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:46.549028 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45235bcb-64b3-4a61-a1e6-fd932b310170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:46.566317 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-45235bcb-64b3-4a61-a1e6-fd932b310170 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:46.567566 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-45235bcb-64b3-4a61-a1e6-fd932b310170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:46.637294 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1417/2847] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:46.647316 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf00ba6-8ed6-4f39-a5a1-2baf9049af8b admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:46.648798 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-cdf00ba6-8ed6-4f39-a5a1-2baf9049af8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:46.705354 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf00ba6-8ed6-4f39-a5a1-2baf9049af8b admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:46.709139 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff003f-c386-4d38-98aa-b472f1cc57f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:46.709786 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff003f-c386-4d38-98aa-b472f1cc57f7 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:46.710070 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff003f-c386-4d38-98aa-b472f1cc57f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:46.710350 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff003f-c386-4d38-98aa-b472f1cc57f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:46.719297 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff003f-c386-4d38-98aa-b472f1cc57f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:46.720863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff003f-c386-4d38-98aa-b472f1cc57f7 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:46.730238 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1431/2848] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:47.025195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45235bcb-64b3-4a61-a1e6-fd932b310170 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:47.026859 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-45235bcb-64b3-4a61-a1e6-fd932b310170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:47.039140 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45235bcb-64b3-4a61-a1e6-fd932b310170 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:47.044287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a696f-fc6a-42e1-98b7-65a72859731a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:47.045248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a696f-fc6a-42e1-98b7-65a72859731a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:47.045400 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a696f-fc6a-42e1-98b7-65a72859731a admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:47.045692 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a696f-fc6a-42e1-98b7-65a72859731a admin admin] PATH_INFO: `/v3/projects/c5e909353ee541a2bd6d49227e670f60` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:47.046956 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a696f-fc6a-42e1-98b7-65a72859731a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e909353ee541a2bd6d49227e670f60)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:47.049001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a696f-fc6a-42e1-98b7-65a72859731a admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:47.098728 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c75a696f-fc6a-42e1-98b7-65a72859731a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e909353ee541a2bd6d49227e670f60', 'request_id': 'req-c75a696f-fc6a-42e1-98b7-65a72859731a'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:47.105040 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c75a696f-fc6a-42e1-98b7-65a72859731a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e909353ee541a2bd6d49227e670f60', 'request_id': 'req-c75a696f-fc6a-42e1-98b7-65a72859731a'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:47.115009 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c75a696f-fc6a-42e1-98b7-65a72859731a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e909353ee541a2bd6d49227e670f60', 'request_id': 'req-c75a696f-fc6a-42e1-98b7-65a72859731a'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:47.124730 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c75a696f-fc6a-42e1-98b7-65a72859731a admin admin] The token cache is being invalidate because project c5e909353ee541a2bd6d49227e670f60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:47.125046 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c75a696f-fc6a-42e1-98b7-65a72859731a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:47.125695 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-c75a696f-fc6a-42e1-98b7-65a72859731a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:47.127324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1418/2849] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:47 2022] DELETE /identity/v3/projects/c5e909353ee541a2bd6d49227e670f60 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:47.131407 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff003f-c386-4d38-98aa-b472f1cc57f7 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:47.141195 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff003f-c386-4d38-98aa-b472f1cc57f7 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:47.208913 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831755f9-6ab5-49c9-8656-c4bed99c8dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:47.209899 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831755f9-6ab5-49c9-8656-c4bed99c8dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:47.210184 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831755f9-6ab5-49c9-8656-c4bed99c8dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:47.210464 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831755f9-6ab5-49c9-8656-c4bed99c8dd5 admin admin] PATH_INFO: `/v3/users/8ec4a68e9749446aae6185990f5b1d84` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:47.211810 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831755f9-6ab5-49c9-8656-c4bed99c8dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec4a68e9749446aae6185990f5b1d84)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:47.213806 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831755f9-6ab5-49c9-8656-c4bed99c8dd5 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:47.266632 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-831755f9-6ab5-49c9-8656-c4bed99c8dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec4a68e9749446aae6185990f5b1d84'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:47.273517 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-831755f9-6ab5-49c9-8656-c4bed99c8dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec4a68e9749446aae6185990f5b1d84'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:47.274267 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-831755f9-6ab5-49c9-8656-c4bed99c8dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec4a68e9749446aae6185990f5b1d84'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:47.285896 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-831755f9-6ab5-49c9-8656-c4bed99c8dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec4a68e9749446aae6185990f5b1d84'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:47.295732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-831755f9-6ab5-49c9-8656-c4bed99c8dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec4a68e9749446aae6185990f5b1d84'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:47.302142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1432/2850] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:47 2022] DELETE /identity/v3/users/8ec4a68e9749446aae6185990f5b1d84 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:47.583644 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a696f-fc6a-42e1-98b7-65a72859731a admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:47.586056 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c75a696f-fc6a-42e1-98b7-65a72859731a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:47.600464 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a696f-fc6a-42e1-98b7-65a72859731a admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:47.657663 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192214ee-8a01-4d2a-b18a-6d747e5e91a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:47.658521 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192214ee-8a01-4d2a-b18a-6d747e5e91a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:47.658810 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192214ee-8a01-4d2a-b18a-6d747e5e91a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:47.659080 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192214ee-8a01-4d2a-b18a-6d747e5e91a0 admin admin] PATH_INFO: `/v3/projects/8e6283493af94c828dd1bf00d60f0639` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:47.660331 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192214ee-8a01-4d2a-b18a-6d747e5e91a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6283493af94c828dd1bf00d60f0639)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:47.662263 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192214ee-8a01-4d2a-b18a-6d747e5e91a0 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:47.711956 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-192214ee-8a01-4d2a-b18a-6d747e5e91a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6283493af94c828dd1bf00d60f0639', 'request_id': 'req-192214ee-8a01-4d2a-b18a-6d747e5e91a0'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:47.720313 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-192214ee-8a01-4d2a-b18a-6d747e5e91a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6283493af94c828dd1bf00d60f0639', 'request_id': 'req-192214ee-8a01-4d2a-b18a-6d747e5e91a0'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:47.729954 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-192214ee-8a01-4d2a-b18a-6d747e5e91a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6283493af94c828dd1bf00d60f0639', 'request_id': 'req-192214ee-8a01-4d2a-b18a-6d747e5e91a0'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:47.740690 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-192214ee-8a01-4d2a-b18a-6d747e5e91a0 admin admin] The token cache is being invalidate because project 8e6283493af94c828dd1bf00d60f0639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:47.740975 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-192214ee-8a01-4d2a-b18a-6d747e5e91a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:47.741808 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-192214ee-8a01-4d2a-b18a-6d747e5e91a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:47.743439 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1419/2851] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:47 2022] DELETE /identity/v3/projects/8e6283493af94c828dd1bf00d60f0639 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:47.748622 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959804f5-c267-454a-bcf4-0963f8dd0794 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:47.749122 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959804f5-c267-454a-bcf4-0963f8dd0794 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:47.749271 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959804f5-c267-454a-bcf4-0963f8dd0794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:47.768353 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-959804f5-c267-454a-bcf4-0963f8dd0794 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:47.769553 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-959804f5-c267-454a-bcf4-0963f8dd0794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:47.851680 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1433/2852] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:47.897424 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e9ad5-0e2c-462d-a480-3500477d17af None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:47.897847 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e9ad5-0e2c-462d-a480-3500477d17af None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:47.897988 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e9ad5-0e2c-462d-a480-3500477d17af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:47.919857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904190d-a3e2-458f-a512-d9c87be0c35a None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:47.920132 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904190d-a3e2-458f-a512-d9c87be0c35a None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:47.920453 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904190d-a3e2-458f-a512-d9c87be0c35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:47.922456 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-c77e9ad5-0e2c-462d-a480-3500477d17af None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:47.924247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c77e9ad5-0e2c-462d-a480-3500477d17af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:47.932971 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1420/2853] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:47.938702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e9ad5-0e2c-462d-a480-3500477d17af None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:47.944447 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-2904190d-a3e2-458f-a512-d9c87be0c35a None None] MFA Rules not processed for user `82b2e79995f94ab880f5d798ddd649b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:47.945799 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-2904190d-a3e2-458f-a512-d9c87be0c35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:47.948617 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e9ad5-0e2c-462d-a480-3500477d17af None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:47.953406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b7b86-0667-4b55-871c-fa35c29dc2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:47.954493 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b7b86-0667-4b55-871c-fa35c29dc2bd admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:47.955473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b7b86-0667-4b55-871c-fa35c29dc2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:47.955904 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b7b86-0667-4b55-871c-fa35c29dc2bd admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:47.956643 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b7b86-0667-4b55-871c-fa35c29dc2bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:22:47.956958 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b7b86-0667-4b55-871c-fa35c29dc2bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:47.958567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b7b86-0667-4b55-871c-fa35c29dc2bd admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:47.972605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1421/2854] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:22:47.977763 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b7b86-0667-4b55-871c-fa35c29dc2bd admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:47.987818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b7b86-0667-4b55-871c-fa35c29dc2bd admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:47.992976 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a8675-08ad-4fc2-ae6f-e227baa3020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:47.993775 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a8675-08ad-4fc2-ae6f-e227baa3020d admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:47.994125 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a8675-08ad-4fc2-ae6f-e227baa3020d admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:47.994471 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a8675-08ad-4fc2-ae6f-e227baa3020d admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:47.995297 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a8675-08ad-4fc2-ae6f-e227baa3020d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:47.997225 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a8675-08ad-4fc2-ae6f-e227baa3020d admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:48.000791 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1434/2855] 10.222.0.11 () {58 vars in 1009 bytes} [Wed May 4 22:22:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:48.025433 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1422/2856] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:22:47 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:22:48.030115 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904190d-a3e2-458f-a512-d9c87be0c35a None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:48.041821 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904190d-a3e2-458f-a512-d9c87be0c35a None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:48.056977 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a8675-08ad-4fc2-ae6f-e227baa3020d admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:48.058822 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c73a8675-08ad-4fc2-ae6f-e227baa3020d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:48.103583 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd885a17-231f-4108-a7b1-ade0acd584f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:48.104411 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885a17-231f-4108-a7b1-ade0acd584f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:48.104872 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885a17-231f-4108-a7b1-ade0acd584f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:48.105912 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885a17-231f-4108-a7b1-ade0acd584f7 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:48.106952 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd885a17-231f-4108-a7b1-ade0acd584f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:48.108964 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd885a17-231f-4108-a7b1-ade0acd584f7 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:48.131829 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1435/2857] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:22:48 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:48.135838 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd885a17-231f-4108-a7b1-ade0acd584f7 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:48.139014 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a8675-08ad-4fc2-ae6f-e227baa3020d admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:48.145429 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e11d97-017b-4737-a73b-5320f10affc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8358da535a104873ad9f5676989a9e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:48.146102 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e11d97-017b-4737-a73b-5320f10affc6 service swift] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:48.146392 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e11d97-017b-4737-a73b-5320f10affc6 service swift] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:48.146675 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e11d97-017b-4737-a73b-5320f10affc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:48.151664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd885a17-231f-4108-a7b1-ade0acd584f7 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:48.158309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a42166-a1d7-411f-8226-f4a72069ffc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:48.159467 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a42166-a1d7-411f-8226-f4a72069ffc0 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:48.160036 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a42166-a1d7-411f-8226-f4a72069ffc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:48.160499 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a42166-a1d7-411f-8226-f4a72069ffc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:48.161339 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a42166-a1d7-411f-8226-f4a72069ffc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:48.162898 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a42166-a1d7-411f-8226-f4a72069ffc0 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:48.173399 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1436/2858] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 22:22:48.177865 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a42166-a1d7-411f-8226-f4a72069ffc0 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:48.187709 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a42166-a1d7-411f-8226-f4a72069ffc0 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:48.193386 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3e366-7418-416b-b9a1-de2db70d97bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:48.194062 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3e366-7418-416b-b9a1-de2db70d97bc admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:48.194343 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3e366-7418-416b-b9a1-de2db70d97bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:48.194682 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3e366-7418-416b-b9a1-de2db70d97bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:48.195480 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3e366-7418-416b-b9a1-de2db70d97bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:48.197151 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3e366-7418-416b-b9a1-de2db70d97bc admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:48.201704 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e11d97-017b-4737-a73b-5320f10affc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:48.203375 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e11d97-017b-4737-a73b-5320f10affc6 service swift] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:48.208646 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1437/2859] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:48.212516 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1423/2860] 10.222.0.11 () {60 vars in 1384 bytes} [Wed May 4 22:22:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 22:22:48.212863 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3e366-7418-416b-b9a1-de2db70d97bc admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:48.222860 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3e366-7418-416b-b9a1-de2db70d97bc admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:48.227981 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee31853-39a6-4e42-8f13-b98603fb5151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:48.228853 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31853-39a6-4e42-8f13-b98603fb5151 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:48.229216 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31853-39a6-4e42-8f13-b98603fb5151 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:48.229441 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31853-39a6-4e42-8f13-b98603fb5151 admin admin] PATH_INFO: `/v3/projects/d78abe713e124542b9ac7011099a8001/users/68b53acd217d4d7a88c22c08865e9cd8/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:48.256938 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee31853-39a6-4e42-8f13-b98603fb5151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d78abe713e124542b9ac7011099a8001, user_id=68b53acd217d4d7a88c22c08865e9cd8, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:48.260847 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee31853-39a6-4e42-8f13-b98603fb5151 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:48.284044 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1438/2861] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:48 2022] PUT /identity/v3/projects/d78abe713e124542b9ac7011099a8001/users/68b53acd217d4d7a88c22c08865e9cd8/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:22:48.296202 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72b206-615f-41bd-b7d9-f4b1b5261765 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:48.296489 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72b206-615f-41bd-b7d9-f4b1b5261765 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:48.296769 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72b206-615f-41bd-b7d9-f4b1b5261765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:48.341429 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-9d72b206-615f-41bd-b7d9-f4b1b5261765 None None] MFA Rules not processed for user `68b53acd217d4d7a88c22c08865e9cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:48.344023 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-9d72b206-615f-41bd-b7d9-f4b1b5261765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:48.439984 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1424/2862] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:48.459422 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee31853-39a6-4e42-8f13-b98603fb5151 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:48.461561 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5ee31853-39a6-4e42-8f13-b98603fb5151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:48.524818 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee31853-39a6-4e42-8f13-b98603fb5151 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:48.528672 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d205be6-e13e-4468-8f6a-fe1d7033fdf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:48.529328 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d205be6-e13e-4468-8f6a-fe1d7033fdf0 service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:48.529611 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d205be6-e13e-4468-8f6a-fe1d7033fdf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:48.529886 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d205be6-e13e-4468-8f6a-fe1d7033fdf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:48.541027 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d205be6-e13e-4468-8f6a-fe1d7033fdf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:48.542471 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d205be6-e13e-4468-8f6a-fe1d7033fdf0 service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:48.552314 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1439/2863] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:22:48.573477 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72b206-615f-41bd-b7d9-f4b1b5261765 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:48.644772 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72b206-615f-41bd-b7d9-f4b1b5261765 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:48.651091 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde1f4f-6dfe-4962-a1ac-fe44a8c9df95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:48.652097 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde1f4f-6dfe-4962-a1ac-fe44a8c9df95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:48.652484 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde1f4f-6dfe-4962-a1ac-fe44a8c9df95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:48.652864 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde1f4f-6dfe-4962-a1ac-fe44a8c9df95 admin admin] PATH_INFO: `/v3/users/68b53acd217d4d7a88c22c08865e9cd8` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:48.654185 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde1f4f-6dfe-4962-a1ac-fe44a8c9df95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68b53acd217d4d7a88c22c08865e9cd8)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:48.657576 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde1f4f-6dfe-4962-a1ac-fe44a8c9df95 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:48.709977 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-9bde1f4f-6dfe-4962-a1ac-fe44a8c9df95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68b53acd217d4d7a88c22c08865e9cd8'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:48.720801 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-9bde1f4f-6dfe-4962-a1ac-fe44a8c9df95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68b53acd217d4d7a88c22c08865e9cd8'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:48.728541 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-9bde1f4f-6dfe-4962-a1ac-fe44a8c9df95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68b53acd217d4d7a88c22c08865e9cd8'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:48.729258 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-9bde1f4f-6dfe-4962-a1ac-fe44a8c9df95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68b53acd217d4d7a88c22c08865e9cd8'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:48.729865 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-9bde1f4f-6dfe-4962-a1ac-fe44a8c9df95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68b53acd217d4d7a88c22c08865e9cd8'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:48.748016 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1425/2864] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:22:48 2022] DELETE /identity/v3/users/68b53acd217d4d7a88c22c08865e9cd8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:48.752673 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c78cc-b3ea-43d8-9427-7cf119adcf3c None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:48.753215 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c78cc-b3ea-43d8-9427-7cf119adcf3c None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:48.753215 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c78cc-b3ea-43d8-9427-7cf119adcf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:48.771363 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-8d5c78cc-b3ea-43d8-9427-7cf119adcf3c None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:48.772568 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-8d5c78cc-b3ea-43d8-9427-7cf119adcf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:48.843495 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1440/2865] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:48.854851 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde1f4f-6dfe-4962-a1ac-fe44a8c9df95 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:48.856321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-9bde1f4f-6dfe-4962-a1ac-fe44a8c9df95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:48.923334 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde1f4f-6dfe-4962-a1ac-fe44a8c9df95 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:48.928626 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d3f49-fed5-4f64-9060-b67de05aa51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:48.929321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d3f49-fed5-4f64-9060-b67de05aa51b service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:48.929623 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d3f49-fed5-4f64-9060-b67de05aa51b service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:48.929913 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d3f49-fed5-4f64-9060-b67de05aa51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:48.940717 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d3f49-fed5-4f64-9060-b67de05aa51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:48.942212 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d3f49-fed5-4f64-9060-b67de05aa51b service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:48.955706 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1426/2866] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:22:49.314934 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c78cc-b3ea-43d8-9427-7cf119adcf3c None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:49.316678 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-8d5c78cc-b3ea-43d8-9427-7cf119adcf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:49.336163 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c78cc-b3ea-43d8-9427-7cf119adcf3c None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:49.341783 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48eba1-c7bf-4563-8f24-c9f314955434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:49.343006 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48eba1-c7bf-4563-8f24-c9f314955434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:49.343619 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48eba1-c7bf-4563-8f24-c9f314955434 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:49.343898 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48eba1-c7bf-4563-8f24-c9f314955434 admin admin] PATH_INFO: `/v3/projects/d78abe713e124542b9ac7011099a8001` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:49.357590 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48eba1-c7bf-4563-8f24-c9f314955434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d78abe713e124542b9ac7011099a8001)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:49.361638 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48eba1-c7bf-4563-8f24-c9f314955434 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:49.432510 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-da48eba1-c7bf-4563-8f24-c9f314955434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd78abe713e124542b9ac7011099a8001', 'request_id': 'req-da48eba1-c7bf-4563-8f24-c9f314955434'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:49.443460 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-da48eba1-c7bf-4563-8f24-c9f314955434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd78abe713e124542b9ac7011099a8001', 'request_id': 'req-da48eba1-c7bf-4563-8f24-c9f314955434'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:49.451675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-da48eba1-c7bf-4563-8f24-c9f314955434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd78abe713e124542b9ac7011099a8001', 'request_id': 'req-da48eba1-c7bf-4563-8f24-c9f314955434'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:49.465888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-da48eba1-c7bf-4563-8f24-c9f314955434 admin admin] The token cache is being invalidate because project d78abe713e124542b9ac7011099a8001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:22:49.466287 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-da48eba1-c7bf-4563-8f24-c9f314955434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:49.467002 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-da48eba1-c7bf-4563-8f24-c9f314955434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:22:49.468741 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1441/2867] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:22:49 2022] DELETE /identity/v3/projects/d78abe713e124542b9ac7011099a8001 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:49.475248 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748025c8-b59a-4e7d-82ab-5052b3e74836 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:49.475806 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748025c8-b59a-4e7d-82ab-5052b3e74836 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:49.476286 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748025c8-b59a-4e7d-82ab-5052b3e74836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:49.497065 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-748025c8-b59a-4e7d-82ab-5052b3e74836 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:49.498256 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-748025c8-b59a-4e7d-82ab-5052b3e74836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:49.558857 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1427/2868] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 22:22:49.567584 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9b9c3-de97-4637-af16-2414d92d6540 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:49.567900 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9b9c3-de97-4637-af16-2414d92d6540 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:49.568293 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9b9c3-de97-4637-af16-2414d92d6540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:49.590301 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-65c9b9c3-de97-4637-af16-2414d92d6540 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:49.591714 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-65c9b9c3-de97-4637-af16-2414d92d6540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:49.602208 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1442/2869] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:49.606629 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748025c8-b59a-4e7d-82ab-5052b3e74836 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:49.618603 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748025c8-b59a-4e7d-82ab-5052b3e74836 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:49.624036 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f559d40-9e68-4609-a5ec-df3dfebd26ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:49.624812 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f559d40-9e68-4609-a5ec-df3dfebd26ec admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:49.625321 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f559d40-9e68-4609-a5ec-df3dfebd26ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:49.625670 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f559d40-9e68-4609-a5ec-df3dfebd26ec admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:49.626900 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f559d40-9e68-4609-a5ec-df3dfebd26ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:22:49.627360 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f559d40-9e68-4609-a5ec-df3dfebd26ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:49.629231 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f559d40-9e68-4609-a5ec-df3dfebd26ec admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:49.642451 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1428/2870] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:22:49.647843 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9b9c3-de97-4637-af16-2414d92d6540 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:49.657939 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9b9c3-de97-4637-af16-2414d92d6540 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:49.662834 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb3ae9-07d3-419b-9d01-36865efdbc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:49.663571 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb3ae9-07d3-419b-9d01-36865efdbc55 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:49.663873 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb3ae9-07d3-419b-9d01-36865efdbc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:49.664153 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb3ae9-07d3-419b-9d01-36865efdbc55 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:49.665065 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb3ae9-07d3-419b-9d01-36865efdbc55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:49.667552 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb3ae9-07d3-419b-9d01-36865efdbc55 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:49.702299 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1443/2871] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:22:49 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:49.707024 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f559d40-9e68-4609-a5ec-df3dfebd26ec admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:49.722179 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f559d40-9e68-4609-a5ec-df3dfebd26ec admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:49.787739 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851bff5-9b0b-4ce5-98aa-e8a7c834fda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:49.788724 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851bff5-9b0b-4ce5-98aa-e8a7c834fda4 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:49.789187 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851bff5-9b0b-4ce5-98aa-e8a7c834fda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:49.789635 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851bff5-9b0b-4ce5-98aa-e8a7c834fda4 admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:49.790492 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851bff5-9b0b-4ce5-98aa-e8a7c834fda4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:49.792627 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851bff5-9b0b-4ce5-98aa-e8a7c834fda4 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:49.819266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1429/2872] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:22:49 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:22:49.820580 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb3ae9-07d3-419b-9d01-36865efdbc55 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:49.836794 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb3ae9-07d3-419b-9d01-36865efdbc55 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:49.842145 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7042253-c54c-4bb8-9aad-d4ea483147c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:49.843094 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7042253-c54c-4bb8-9aad-d4ea483147c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:49.843647 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7042253-c54c-4bb8-9aad-d4ea483147c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:49.844196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7042253-c54c-4bb8-9aad-d4ea483147c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:49.845118 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7042253-c54c-4bb8-9aad-d4ea483147c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:49.847003 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7042253-c54c-4bb8-9aad-d4ea483147c4 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:49.866933 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1444/2873] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:49.871192 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851bff5-9b0b-4ce5-98aa-e8a7c834fda4 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:49.884270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851bff5-9b0b-4ce5-98aa-e8a7c834fda4 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:49.891398 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cb504-75fc-4a1a-8fc0-e7432a580013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:49.892022 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cb504-75fc-4a1a-8fc0-e7432a580013 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:49.892319 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cb504-75fc-4a1a-8fc0-e7432a580013 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:49.892646 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cb504-75fc-4a1a-8fc0-e7432a580013 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:49.893403 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2cb504-75fc-4a1a-8fc0-e7432a580013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:49.895273 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2cb504-75fc-4a1a-8fc0-e7432a580013 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:49.907086 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1430/2874] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:22:49.912196 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7042253-c54c-4bb8-9aad-d4ea483147c4 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:49.925797 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7042253-c54c-4bb8-9aad-d4ea483147c4 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:49.932333 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49ac7b-cf87-4124-bd17-bf17bac00b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:49.933364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49ac7b-cf87-4124-bd17-bf17bac00b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:49.933754 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49ac7b-cf87-4124-bd17-bf17bac00b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:49.934119 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49ac7b-cf87-4124-bd17-bf17bac00b37 admin admin] PATH_INFO: `/v3/projects/5296b77792a44f6490899f0c27c079f5/users/fe26acfac874404d9bb69a0c2c3103b8/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:49.955723 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49ac7b-cf87-4124-bd17-bf17bac00b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5296b77792a44f6490899f0c27c079f5, user_id=fe26acfac874404d9bb69a0c2c3103b8, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:49.959732 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49ac7b-cf87-4124-bd17-bf17bac00b37 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:49.977757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1445/2875] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:22:49 2022] PUT /identity/v3/projects/5296b77792a44f6490899f0c27c079f5/users/fe26acfac874404d9bb69a0c2c3103b8/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:22:49.990672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff9e07-bdb1-41ea-94a7-e8020517b25d None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:49.991519 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff9e07-bdb1-41ea-94a7-e8020517b25d None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:49.991816 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff9e07-bdb1-41ea-94a7-e8020517b25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:50.030220 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-eaff9e07-bdb1-41ea-94a7-e8020517b25d None None] MFA Rules not processed for user `fe26acfac874404d9bb69a0c2c3103b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:22:50.032332 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-eaff9e07-bdb1-41ea-94a7-e8020517b25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:50.113927 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1431/2876] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:22:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:22:50.121781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49ac7b-cf87-4124-bd17-bf17bac00b37 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:22:50.123616 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-be49ac7b-cf87-4124-bd17-bf17bac00b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:22:50.220593 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49ac7b-cf87-4124-bd17-bf17bac00b37 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:22:50.225234 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e2bf0-fd07-4cfa-a562-cb206c19ea2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:22:50.225928 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e2bf0-fd07-4cfa-a562-cb206c19ea2a service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:22:50.226402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e2bf0-fd07-4cfa-a562-cb206c19ea2a service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:22:50.226949 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e2bf0-fd07-4cfa-a562-cb206c19ea2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:22:50.241026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e2bf0-fd07-4cfa-a562-cb206c19ea2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:22:50.242852 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e2bf0-fd07-4cfa-a562-cb206c19ea2a service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:22:50.257629 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1446/2877] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:22:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:23:04.591776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff9e07-bdb1-41ea-94a7-e8020517b25d None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:04.593415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-eaff9e07-bdb1-41ea-94a7-e8020517b25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:04.684936 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff9e07-bdb1-41ea-94a7-e8020517b25d None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:04.690448 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51800a2e-73b8-4865-ad64-4f8c709623de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:04.691384 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51800a2e-73b8-4865-ad64-4f8c709623de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:04.691661 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51800a2e-73b8-4865-ad64-4f8c709623de admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:04.691963 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51800a2e-73b8-4865-ad64-4f8c709623de admin admin] PATH_INFO: `/v3/users/e1c06dab6ba4448385e995eec6721a17` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:04.693161 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51800a2e-73b8-4865-ad64-4f8c709623de admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1c06dab6ba4448385e995eec6721a17)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:04.695155 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51800a2e-73b8-4865-ad64-4f8c709623de admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:04.748259 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-51800a2e-73b8-4865-ad64-4f8c709623de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1c06dab6ba4448385e995eec6721a17'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:04.757054 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-51800a2e-73b8-4865-ad64-4f8c709623de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1c06dab6ba4448385e995eec6721a17'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:04.764708 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-51800a2e-73b8-4865-ad64-4f8c709623de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1c06dab6ba4448385e995eec6721a17'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:04.765460 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-51800a2e-73b8-4865-ad64-4f8c709623de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1c06dab6ba4448385e995eec6721a17'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:04.766266 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-51800a2e-73b8-4865-ad64-4f8c709623de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1c06dab6ba4448385e995eec6721a17'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:04.785247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1432/2878] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:23:04 2022] DELETE /identity/v3/users/e1c06dab6ba4448385e995eec6721a17 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:23:04.973327 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e2bf0-fd07-4cfa-a562-cb206c19ea2a service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:04.985346 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e2bf0-fd07-4cfa-a562-cb206c19ea2a service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:05.048604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f35b73-68d0-436e-83fb-ba967be7b05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:05.048885 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f35b73-68d0-436e-83fb-ba967be7b05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:05.049095 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f35b73-68d0-436e-83fb-ba967be7b05b admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:05.049375 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f35b73-68d0-436e-83fb-ba967be7b05b admin admin] PATH_INFO: `/v3/projects/ef3374a6467a47a48a884d2747334d54` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:05.051017 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f35b73-68d0-436e-83fb-ba967be7b05b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef3374a6467a47a48a884d2747334d54)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:05.052986 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f35b73-68d0-436e-83fb-ba967be7b05b admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:05.106206 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-62f35b73-68d0-436e-83fb-ba967be7b05b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef3374a6467a47a48a884d2747334d54', 'request_id': 'req-62f35b73-68d0-436e-83fb-ba967be7b05b'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:05.116352 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-62f35b73-68d0-436e-83fb-ba967be7b05b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef3374a6467a47a48a884d2747334d54', 'request_id': 'req-62f35b73-68d0-436e-83fb-ba967be7b05b'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:05.127683 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-62f35b73-68d0-436e-83fb-ba967be7b05b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef3374a6467a47a48a884d2747334d54', 'request_id': 'req-62f35b73-68d0-436e-83fb-ba967be7b05b'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:05.139271 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-62f35b73-68d0-436e-83fb-ba967be7b05b admin admin] The token cache is being invalidate because project ef3374a6467a47a48a884d2747334d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:23:05.139562 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-62f35b73-68d0-436e-83fb-ba967be7b05b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:05.141717 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-62f35b73-68d0-436e-83fb-ba967be7b05b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:05.144386 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1447/2879] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:23:04 2022] DELETE /identity/v3/projects/ef3374a6467a47a48a884d2747334d54 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:23:05.152006 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51800a2e-73b8-4865-ad64-4f8c709623de admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:05.153640 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-51800a2e-73b8-4865-ad64-4f8c709623de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:05.168783 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51800a2e-73b8-4865-ad64-4f8c709623de admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:05.229807 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59074308-f36c-4047-a1fc-2d51f77187db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:05.230710 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59074308-f36c-4047-a1fc-2d51f77187db admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:05.231027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59074308-f36c-4047-a1fc-2d51f77187db admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:05.231306 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59074308-f36c-4047-a1fc-2d51f77187db admin admin] PATH_INFO: `/v3/users/ddd7d11fe31540dca339f3f020b60540` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:05.232770 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59074308-f36c-4047-a1fc-2d51f77187db admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddd7d11fe31540dca339f3f020b60540)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:05.234750 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59074308-f36c-4047-a1fc-2d51f77187db admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:05.288491 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-59074308-f36c-4047-a1fc-2d51f77187db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddd7d11fe31540dca339f3f020b60540'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:05.297994 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-59074308-f36c-4047-a1fc-2d51f77187db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddd7d11fe31540dca339f3f020b60540'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:05.305567 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-59074308-f36c-4047-a1fc-2d51f77187db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddd7d11fe31540dca339f3f020b60540'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:05.306313 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-59074308-f36c-4047-a1fc-2d51f77187db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddd7d11fe31540dca339f3f020b60540'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:05.306985 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-59074308-f36c-4047-a1fc-2d51f77187db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddd7d11fe31540dca339f3f020b60540'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:05.327999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1433/2880] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:23:05 2022] DELETE /identity/v3/users/ddd7d11fe31540dca339f3f020b60540 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:23:05.517789 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f35b73-68d0-436e-83fb-ba967be7b05b admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:05.532193 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-62f35b73-68d0-436e-83fb-ba967be7b05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:05.559111 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f35b73-68d0-436e-83fb-ba967be7b05b admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:05.641178 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3bef0-b048-4bea-a372-6b494c0fd64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:05.642023 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3bef0-b048-4bea-a372-6b494c0fd64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:05.642309 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3bef0-b048-4bea-a372-6b494c0fd64b admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:05.642586 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3bef0-b048-4bea-a372-6b494c0fd64b admin admin] PATH_INFO: `/v3/projects/b17af3091a9c4012abcdc57ad037831f` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:05.644027 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3bef0-b048-4bea-a372-6b494c0fd64b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b17af3091a9c4012abcdc57ad037831f)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:05.645984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3bef0-b048-4bea-a372-6b494c0fd64b admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:05.718268 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-86a3bef0-b048-4bea-a372-6b494c0fd64b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b17af3091a9c4012abcdc57ad037831f', 'request_id': 'req-86a3bef0-b048-4bea-a372-6b494c0fd64b'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:05.727086 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-86a3bef0-b048-4bea-a372-6b494c0fd64b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b17af3091a9c4012abcdc57ad037831f', 'request_id': 'req-86a3bef0-b048-4bea-a372-6b494c0fd64b'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:05.734132 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-86a3bef0-b048-4bea-a372-6b494c0fd64b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b17af3091a9c4012abcdc57ad037831f', 'request_id': 'req-86a3bef0-b048-4bea-a372-6b494c0fd64b'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:05.745206 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-86a3bef0-b048-4bea-a372-6b494c0fd64b admin admin] The token cache is being invalidate because project b17af3091a9c4012abcdc57ad037831f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:23:05.745501 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-86a3bef0-b048-4bea-a372-6b494c0fd64b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:05.746165 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-86a3bef0-b048-4bea-a372-6b494c0fd64b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:05.747977 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1448/2881] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:23:05 2022] DELETE /identity/v3/projects/b17af3091a9c4012abcdc57ad037831f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:23:05.753214 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc72e70-afc3-4b25-80e6-690aeba4ea21 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:05.754082 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc72e70-afc3-4b25-80e6-690aeba4ea21 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:05.754437 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc72e70-afc3-4b25-80e6-690aeba4ea21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:05.775381 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-9fc72e70-afc3-4b25-80e6-690aeba4ea21 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:23:05.776700 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-9fc72e70-afc3-4b25-80e6-690aeba4ea21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:05.839456 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1434/2882] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:23:05.847708 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff49bbf-a7f9-4531-825f-38e5448374b8 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:05.849060 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff49bbf-a7f9-4531-825f-38e5448374b8 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:05.849060 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff49bbf-a7f9-4531-825f-38e5448374b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:05.869132 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-bff49bbf-a7f9-4531-825f-38e5448374b8 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:23:05.870364 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-bff49bbf-a7f9-4531-825f-38e5448374b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:05.878926 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1449/2883] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:23:05.883242 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc72e70-afc3-4b25-80e6-690aeba4ea21 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:05.893314 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc72e70-afc3-4b25-80e6-690aeba4ea21 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:05.898246 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f238d-c9e9-44b5-8ebd-05ec3c4630d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:05.898925 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f238d-c9e9-44b5-8ebd-05ec3c4630d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:05.899247 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f238d-c9e9-44b5-8ebd-05ec3c4630d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:05.899532 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f238d-c9e9-44b5-8ebd-05ec3c4630d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:05.900272 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f238d-c9e9-44b5-8ebd-05ec3c4630d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:23:05.900652 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f238d-c9e9-44b5-8ebd-05ec3c4630d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:05.902222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f238d-c9e9-44b5-8ebd-05ec3c4630d2 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:05.916840 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1435/2884] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:23:05.921390 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff49bbf-a7f9-4531-825f-38e5448374b8 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:05.933191 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff49bbf-a7f9-4531-825f-38e5448374b8 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:05.937984 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d27f92-b6f3-4ee9-9359-bc03eee1d223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:05.938704 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d27f92-b6f3-4ee9-9359-bc03eee1d223 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:05.939067 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d27f92-b6f3-4ee9-9359-bc03eee1d223 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:05.939276 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d27f92-b6f3-4ee9-9359-bc03eee1d223 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:05.940487 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d27f92-b6f3-4ee9-9359-bc03eee1d223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:05.942567 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d27f92-b6f3-4ee9-9359-bc03eee1d223 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:05.974775 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1450/2885] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:23:05 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:23:05.980055 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f238d-c9e9-44b5-8ebd-05ec3c4630d2 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:05.994575 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f238d-c9e9-44b5-8ebd-05ec3c4630d2 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:06.064180 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6f4f1-5ae4-413b-b4f9-df714dd0d93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:06.064999 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6f4f1-5ae4-413b-b4f9-df714dd0d93b admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:06.065605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6f4f1-5ae4-413b-b4f9-df714dd0d93b admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:06.066100 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6f4f1-5ae4-413b-b4f9-df714dd0d93b admin admin] PATH_INFO: `/v3/users` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:06.066998 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6f4f1-5ae4-413b-b4f9-df714dd0d93b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:06.069173 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6f4f1-5ae4-413b-b4f9-df714dd0d93b admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:06.102124 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1436/2886] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:23:05 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:23:06.103621 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d27f92-b6f3-4ee9-9359-bc03eee1d223 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:06.118107 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d27f92-b6f3-4ee9-9359-bc03eee1d223 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:06.124857 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8a21d-cb33-4a47-941b-84aa754b6207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:06.125738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8a21d-cb33-4a47-941b-84aa754b6207 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:06.126000 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8a21d-cb33-4a47-941b-84aa754b6207 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:06.126464 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8a21d-cb33-4a47-941b-84aa754b6207 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:06.127925 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8a21d-cb33-4a47-941b-84aa754b6207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:06.130346 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8a21d-cb33-4a47-941b-84aa754b6207 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:06.145240 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1451/2887] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:23:06.149023 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6f4f1-5ae4-413b-b4f9-df714dd0d93b admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:06.159325 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6f4f1-5ae4-413b-b4f9-df714dd0d93b admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:06.167667 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b7530-93a1-4fd6-8c45-4c4c6eaef863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:06.168473 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b7530-93a1-4fd6-8c45-4c4c6eaef863 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:06.168773 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b7530-93a1-4fd6-8c45-4c4c6eaef863 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:06.169060 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b7530-93a1-4fd6-8c45-4c4c6eaef863 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:06.169808 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b7530-93a1-4fd6-8c45-4c4c6eaef863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:06.171776 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b7530-93a1-4fd6-8c45-4c4c6eaef863 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:06.186182 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1437/2888] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:23:06.191673 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8a21d-cb33-4a47-941b-84aa754b6207 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:06.205163 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8a21d-cb33-4a47-941b-84aa754b6207 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:06.210415 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8177a9-1011-4c78-9919-ef1330d1f45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:06.211632 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8177a9-1011-4c78-9919-ef1330d1f45c admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:06.211906 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8177a9-1011-4c78-9919-ef1330d1f45c admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:06.212206 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8177a9-1011-4c78-9919-ef1330d1f45c admin admin] PATH_INFO: `/v3/projects/a5d8bfa824e84678841145bf217233db/users/82f26301de3b4ef6be183f7be8df90cc/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:06.228388 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8177a9-1011-4c78-9919-ef1330d1f45c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5d8bfa824e84678841145bf217233db, user_id=82f26301de3b4ef6be183f7be8df90cc, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:06.231125 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8177a9-1011-4c78-9919-ef1330d1f45c admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:06.246876 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1452/2889] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:23:06 2022] PUT /identity/v3/projects/a5d8bfa824e84678841145bf217233db/users/82f26301de3b4ef6be183f7be8df90cc/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:23:06.257808 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d2c3f-90c9-4c6a-8666-aedd10b41df2 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:06.258100 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d2c3f-90c9-4c6a-8666-aedd10b41df2 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:06.258383 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d2c3f-90c9-4c6a-8666-aedd10b41df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:06.287483 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-987d2c3f-90c9-4c6a-8666-aedd10b41df2 None None] MFA Rules not processed for user `82f26301de3b4ef6be183f7be8df90cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:23:06.288970 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-987d2c3f-90c9-4c6a-8666-aedd10b41df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:06.366322 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1438/2890] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:23:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:23:06.377950 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8177a9-1011-4c78-9919-ef1330d1f45c admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:06.379688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-2e8177a9-1011-4c78-9919-ef1330d1f45c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:06.435445 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8177a9-1011-4c78-9919-ef1330d1f45c admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:06.438994 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84251e-3ca1-4b2a-9039-7c66d29a20fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a86016cde040e7b8a9eeaf34cf0715', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:06.439674 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84251e-3ca1-4b2a-9039-7c66d29a20fc service cinder] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:06.439958 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84251e-3ca1-4b2a-9039-7c66d29a20fc service cinder] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:06.440324 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84251e-3ca1-4b2a-9039-7c66d29a20fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:06.449216 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84251e-3ca1-4b2a-9039-7c66d29a20fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:06.450675 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84251e-3ca1-4b2a-9039-7c66d29a20fc service cinder] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:06.461287 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1453/2891] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:23:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:23:07.773936 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f9574-4678-4a45-8581-e4e07d477b07 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:07.774448 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f9574-4678-4a45-8581-e4e07d477b07 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:07.774566 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f9574-4678-4a45-8581-e4e07d477b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:07.793180 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-022f9574-4678-4a45-8581-e4e07d477b07 None None] MFA Rules not processed for user `82b2e79995f94ab880f5d798ddd649b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:23:07.794449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-022f9574-4678-4a45-8581-e4e07d477b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:07.862813 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1439/2892] 10.222.0.11 () {58 vars in 967 bytes} [Wed May 4 22:23:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:23:07.877553 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84251e-3ca1-4b2a-9039-7c66d29a20fc service cinder] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:07.879730 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-df84251e-3ca1-4b2a-9039-7c66d29a20fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:07.962823 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84251e-3ca1-4b2a-9039-7c66d29a20fc service cinder] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:07.968969 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23acc6-3a9b-49c2-a393-b410d1222e34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8358da535a104873ad9f5676989a9e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:07.969639 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23acc6-3a9b-49c2-a393-b410d1222e34 service swift] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:07.969929 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23acc6-3a9b-49c2-a393-b410d1222e34 service swift] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:07.970241 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23acc6-3a9b-49c2-a393-b410d1222e34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:07.980934 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23acc6-3a9b-49c2-a393-b410d1222e34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:07.982773 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23acc6-3a9b-49c2-a393-b410d1222e34 service swift] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:07.993576 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1454/2893] 10.222.0.11 () {60 vars in 1384 bytes} [Wed May 4 22:23:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 22:23:09.036663 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f9574-4678-4a45-8581-e4e07d477b07 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:09.099274 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f9574-4678-4a45-8581-e4e07d477b07 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:09.103712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff0114-f23f-4dd3-98a2-8574303a001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:09.104595 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff0114-f23f-4dd3-98a2-8574303a001d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:09.104901 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff0114-f23f-4dd3-98a2-8574303a001d admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:09.105175 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff0114-f23f-4dd3-98a2-8574303a001d admin admin] PATH_INFO: `/v3/users/82f26301de3b4ef6be183f7be8df90cc` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:09.106369 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff0114-f23f-4dd3-98a2-8574303a001d admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f26301de3b4ef6be183f7be8df90cc)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:09.108319 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff0114-f23f-4dd3-98a2-8574303a001d admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:09.157623 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1dff0114-f23f-4dd3-98a2-8574303a001d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f26301de3b4ef6be183f7be8df90cc'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:09.168862 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1dff0114-f23f-4dd3-98a2-8574303a001d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f26301de3b4ef6be183f7be8df90cc'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:09.175668 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1dff0114-f23f-4dd3-98a2-8574303a001d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f26301de3b4ef6be183f7be8df90cc'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:09.176302 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1dff0114-f23f-4dd3-98a2-8574303a001d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f26301de3b4ef6be183f7be8df90cc'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:09.176891 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-1dff0114-f23f-4dd3-98a2-8574303a001d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f26301de3b4ef6be183f7be8df90cc'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:09.195789 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1440/2894] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:23:09 2022] DELETE /identity/v3/users/82f26301de3b4ef6be183f7be8df90cc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:23:09.200346 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeca467-e65c-40e1-a5b7-4b8bbed28bbc None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:09.200860 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeca467-e65c-40e1-a5b7-4b8bbed28bbc None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:09.200968 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeca467-e65c-40e1-a5b7-4b8bbed28bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:09.219783 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-daeca467-e65c-40e1-a5b7-4b8bbed28bbc None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:23:09.220995 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-daeca467-e65c-40e1-a5b7-4b8bbed28bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:09.284707 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1455/2895] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:23:09.295073 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff0114-f23f-4dd3-98a2-8574303a001d admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:09.296716 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-1dff0114-f23f-4dd3-98a2-8574303a001d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:09.354792 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff0114-f23f-4dd3-98a2-8574303a001d admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:09.358364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c372dbc-b18d-478a-9989-e83e91ac74b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:09.359014 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c372dbc-b18d-478a-9989-e83e91ac74b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:09.359324 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c372dbc-b18d-478a-9989-e83e91ac74b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:09.359600 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c372dbc-b18d-478a-9989-e83e91ac74b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:09.368959 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c372dbc-b18d-478a-9989-e83e91ac74b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:09.370386 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c372dbc-b18d-478a-9989-e83e91ac74b8 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:09.380311 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1441/2896] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:23:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:23:09.666664 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeca467-e65c-40e1-a5b7-4b8bbed28bbc None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:09.668193 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-daeca467-e65c-40e1-a5b7-4b8bbed28bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:09.680412 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeca467-e65c-40e1-a5b7-4b8bbed28bbc None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:09.684980 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2090de-2959-4a3c-b753-b242d23c1ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:09.685854 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2090de-2959-4a3c-b753-b242d23c1ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:09.686142 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2090de-2959-4a3c-b753-b242d23c1ded admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:09.686429 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2090de-2959-4a3c-b753-b242d23c1ded admin admin] PATH_INFO: `/v3/projects/a5d8bfa824e84678841145bf217233db` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:09.687713 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2090de-2959-4a3c-b753-b242d23c1ded admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5d8bfa824e84678841145bf217233db)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:09.689657 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2090de-2959-4a3c-b753-b242d23c1ded admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:09.750902 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-6c2090de-2959-4a3c-b753-b242d23c1ded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5d8bfa824e84678841145bf217233db', 'request_id': 'req-6c2090de-2959-4a3c-b753-b242d23c1ded'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:09.760512 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-6c2090de-2959-4a3c-b753-b242d23c1ded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5d8bfa824e84678841145bf217233db', 'request_id': 'req-6c2090de-2959-4a3c-b753-b242d23c1ded'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:09.767339 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-6c2090de-2959-4a3c-b753-b242d23c1ded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5d8bfa824e84678841145bf217233db', 'request_id': 'req-6c2090de-2959-4a3c-b753-b242d23c1ded'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:09.777721 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-6c2090de-2959-4a3c-b753-b242d23c1ded admin admin] The token cache is being invalidate because project a5d8bfa824e84678841145bf217233db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:23:09.778004 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-6c2090de-2959-4a3c-b753-b242d23c1ded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:09.778736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-6c2090de-2959-4a3c-b753-b242d23c1ded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:09.780794 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1456/2897] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:23:09 2022] DELETE /identity/v3/projects/a5d8bfa824e84678841145bf217233db => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:23:09.785858 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b954345-df12-498d-86fe-47cbf95664ac None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:09.786188 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b954345-df12-498d-86fe-47cbf95664ac None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:09.786469 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b954345-df12-498d-86fe-47cbf95664ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:09.804234 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-1b954345-df12-498d-86fe-47cbf95664ac None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:23:09.805456 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-1b954345-df12-498d-86fe-47cbf95664ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:09.863198 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1442/2898] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 22:23:09.872608 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1808c1-25a8-476e-9fb2-ff483fce2071 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:09.873069 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1808c1-25a8-476e-9fb2-ff483fce2071 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:09.873417 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1808c1-25a8-476e-9fb2-ff483fce2071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:09.893447 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-4d1808c1-25a8-476e-9fb2-ff483fce2071 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:23:09.896423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-4d1808c1-25a8-476e-9fb2-ff483fce2071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:09.902736 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1457/2899] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:23:09.907189 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b954345-df12-498d-86fe-47cbf95664ac None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:09.916937 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b954345-df12-498d-86fe-47cbf95664ac None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:09.921893 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6712050-b248-4557-a3e6-d75223de879a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:09.922637 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6712050-b248-4557-a3e6-d75223de879a admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:09.922989 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6712050-b248-4557-a3e6-d75223de879a admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:09.923344 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6712050-b248-4557-a3e6-d75223de879a admin admin] PATH_INFO: `/v3/domains` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:09.924140 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6712050-b248-4557-a3e6-d75223de879a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 22:23:09.924541 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6712050-b248-4557-a3e6-d75223de879a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:09.926232 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6712050-b248-4557-a3e6-d75223de879a admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:09.938146 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1443/2900] 10.222.0.11 () {58 vars in 1152 bytes} [Wed May 4 22:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 22:23:09.942726 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1808c1-25a8-476e-9fb2-ff483fce2071 None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:09.952993 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1808c1-25a8-476e-9fb2-ff483fce2071 None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:09.959374 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea746d36-320a-4240-9f1b-cb75513a1725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:09.960184 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea746d36-320a-4240-9f1b-cb75513a1725 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:09.960478 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea746d36-320a-4240-9f1b-cb75513a1725 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:09.960757 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea746d36-320a-4240-9f1b-cb75513a1725 admin admin] PATH_INFO: `/v3/projects` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:09.961959 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea746d36-320a-4240-9f1b-cb75513a1725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:09.962873 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6712050-b248-4557-a3e6-d75223de879a admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:09.963960 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea746d36-320a-4240-9f1b-cb75513a1725 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:09.965195 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-a6712050-b248-4557-a3e6-d75223de879a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:09.980657 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6712050-b248-4557-a3e6-d75223de879a admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:09.985806 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f585fe3-b159-4021-86a9-e15511547328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:09.986716 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f585fe3-b159-4021-86a9-e15511547328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:09.987001 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f585fe3-b159-4021-86a9-e15511547328 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:09.987378 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f585fe3-b159-4021-86a9-e15511547328 admin admin] PATH_INFO: `/v3/users/fbacf68cef784ccca1d61e0034ee9915` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:09.988955 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f585fe3-b159-4021-86a9-e15511547328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbacf68cef784ccca1d61e0034ee9915)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:09.990911 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f585fe3-b159-4021-86a9-e15511547328 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:09.991871 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1458/2901] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:23:09 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:23:09.995755 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea746d36-320a-4240-9f1b-cb75513a1725 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:10.040163 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0f585fe3-b159-4021-86a9-e15511547328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbacf68cef784ccca1d61e0034ee9915'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:10.052820 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0f585fe3-b159-4021-86a9-e15511547328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbacf68cef784ccca1d61e0034ee9915'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:10.060126 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0f585fe3-b159-4021-86a9-e15511547328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbacf68cef784ccca1d61e0034ee9915'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:10.060731 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea746d36-320a-4240-9f1b-cb75513a1725 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:10.065516 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0f585fe3-b159-4021-86a9-e15511547328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbacf68cef784ccca1d61e0034ee9915'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:10.066142 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-0f585fe3-b159-4021-86a9-e15511547328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbacf68cef784ccca1d61e0034ee9915'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:10.069492 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef67ba6-ac32-4cd1-bdff-3ab8633e6ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:10.070216 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef67ba6-ac32-4cd1-bdff-3ab8633e6ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:10.070502 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef67ba6-ac32-4cd1-bdff-3ab8633e6ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:10.070781 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef67ba6-ac32-4cd1-bdff-3ab8633e6ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:10.071523 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef67ba6-ac32-4cd1-bdff-3ab8633e6ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:10.073462 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef67ba6-ac32-4cd1-bdff-3ab8633e6ab1 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:10.083754 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1444/2902] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:23:09 2022] DELETE /identity/v3/users/fbacf68cef784ccca1d61e0034ee9915 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:23:10.099100 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1459/2903] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:23:09 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 22:23:10.101005 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f585fe3-b159-4021-86a9-e15511547328 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:10.102449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-0f585fe3-b159-4021-86a9-e15511547328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:10.167856 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f585fe3-b159-4021-86a9-e15511547328 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:10.174487 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb407fb-5adf-44e6-a201-8e99c2c7b6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:10.175267 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb407fb-5adf-44e6-a201-8e99c2c7b6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:10.175561 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb407fb-5adf-44e6-a201-8e99c2c7b6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:10.175893 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb407fb-5adf-44e6-a201-8e99c2c7b6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:10.176640 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb407fb-5adf-44e6-a201-8e99c2c7b6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:10.178361 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb407fb-5adf-44e6-a201-8e99c2c7b6e7 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:10.192148 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1445/2904] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:23:10.197600 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef67ba6-ac32-4cd1-bdff-3ab8633e6ab1 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:10.211828 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef67ba6-ac32-4cd1-bdff-3ab8633e6ab1 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:10.217526 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb74d45-272a-4484-af30-10e8e47fd476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:10.218460 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb74d45-272a-4484-af30-10e8e47fd476 admin admin] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:10.218938 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb74d45-272a-4484-af30-10e8e47fd476 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:10.219441 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb74d45-272a-4484-af30-10e8e47fd476 admin admin] PATH_INFO: `/v3/roles` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:10.220402 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb74d45-272a-4484-af30-10e8e47fd476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:10.222450 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb74d45-272a-4484-af30-10e8e47fd476 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:10.234163 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1460/2905] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:23:10.238799 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb407fb-5adf-44e6-a201-8e99c2c7b6e7 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:10.253597 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb407fb-5adf-44e6-a201-8e99c2c7b6e7 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:10.259442 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36f9c3-2131-46b7-abc4-dd70ae2c8017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:10.260549 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36f9c3-2131-46b7-abc4-dd70ae2c8017 admin admin] REQUEST_METHOD: `PUT` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:10.261040 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36f9c3-2131-46b7-abc4-dd70ae2c8017 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:10.261169 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36f9c3-2131-46b7-abc4-dd70ae2c8017 admin admin] PATH_INFO: `/v3/projects/1547efc676354a919b6fddfb7d649fd2/users/c6b4d16d7af4479eb46dd25e6d0a1ed3/roles/b03b07e63e164e6a8858592b025c8103` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:10.272666 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb74d45-272a-4484-af30-10e8e47fd476 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:10.274427 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-2cb74d45-272a-4484-af30-10e8e47fd476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:10.279759 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36f9c3-2131-46b7-abc4-dd70ae2c8017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1547efc676354a919b6fddfb7d649fd2, user_id=c6b4d16d7af4479eb46dd25e6d0a1ed3, role_id=b03b07e63e164e6a8858592b025c8103)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:10.282928 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36f9c3-2131-46b7-abc4-dd70ae2c8017 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:10.295860 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb74d45-272a-4484-af30-10e8e47fd476 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:10.303276 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c5608-58a8-4283-b479-8481d702c6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:10.304973 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c5608-58a8-4283-b479-8481d702c6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:10.305715 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c5608-58a8-4283-b479-8481d702c6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:10.306583 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c5608-58a8-4283-b479-8481d702c6ac admin admin] PATH_INFO: `/v3/projects/184c66d037ca4108bc2a0546ffd89a4d` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:10.310683 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1446/2906] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:23:10 2022] PUT /identity/v3/projects/1547efc676354a919b6fddfb7d649fd2/users/c6b4d16d7af4479eb46dd25e6d0a1ed3/roles/b03b07e63e164e6a8858592b025c8103 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:23:10.311985 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c5608-58a8-4283-b479-8481d702c6ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=184c66d037ca4108bc2a0546ffd89a4d)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:10.312258 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0948e-4b4a-4d66-848b-f88124903d1d None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:10.312549 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0948e-4b4a-4d66-848b-f88124903d1d None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:10.312833 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0948e-4b4a-4d66-848b-f88124903d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:10.314272 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c5608-58a8-4283-b479-8481d702c6ac admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:10.330400 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-6bc0948e-4b4a-4d66-848b-f88124903d1d None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:23:10.331760 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-6bc0948e-4b4a-4d66-848b-f88124903d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:10.369852 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c41c5608-58a8-4283-b479-8481d702c6ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '184c66d037ca4108bc2a0546ffd89a4d', 'request_id': 'req-c41c5608-58a8-4283-b479-8481d702c6ac'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:10.379802 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c41c5608-58a8-4283-b479-8481d702c6ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '184c66d037ca4108bc2a0546ffd89a4d', 'request_id': 'req-c41c5608-58a8-4283-b479-8481d702c6ac'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:10.387187 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c41c5608-58a8-4283-b479-8481d702c6ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '184c66d037ca4108bc2a0546ffd89a4d', 'request_id': 'req-c41c5608-58a8-4283-b479-8481d702c6ac'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:10.398838 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c41c5608-58a8-4283-b479-8481d702c6ac admin admin] The token cache is being invalidate because project 184c66d037ca4108bc2a0546ffd89a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:23:10.399168 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c41c5608-58a8-4283-b479-8481d702c6ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:10.400140 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-c41c5608-58a8-4283-b479-8481d702c6ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:10.400576 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1447/2907] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:23:10.405077 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1461/2908] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:23:10 2022] DELETE /identity/v3/projects/184c66d037ca4108bc2a0546ffd89a4d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:23:10.411234 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0948e-4b4a-4d66-848b-f88124903d1d None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:10.415113 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-6bc0948e-4b4a-4d66-848b-f88124903d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:10.481133 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0948e-4b4a-4d66-848b-f88124903d1d None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:10.540032 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494d8cf-3c7f-42e3-968d-7da154a49db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:10.540626 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494d8cf-3c7f-42e3-968d-7da154a49db3 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:10.540905 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494d8cf-3c7f-42e3-968d-7da154a49db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:10.541238 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494d8cf-3c7f-42e3-968d-7da154a49db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:10.543364 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-b494d8cf-3c7f-42e3-968d-7da154a49db3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:10.623934 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494d8cf-3c7f-42e3-968d-7da154a49db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:10.625818 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494d8cf-3c7f-42e3-968d-7da154a49db3 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:10.636734 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1448/2909] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:23:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:23:11.552265 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c5608-58a8-4283-b479-8481d702c6ac admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:11.554429 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-c41c5608-58a8-4283-b479-8481d702c6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:11.567891 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c5608-58a8-4283-b479-8481d702c6ac admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:11.575423 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29251375-ed5b-4491-ad86-51e064a66da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:11.576575 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29251375-ed5b-4491-ad86-51e064a66da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:11.577063 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29251375-ed5b-4491-ad86-51e064a66da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:11.577561 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29251375-ed5b-4491-ad86-51e064a66da5 admin admin] PATH_INFO: `/v3/users/fe26acfac874404d9bb69a0c2c3103b8` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:11.579434 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29251375-ed5b-4491-ad86-51e064a66da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe26acfac874404d9bb69a0c2c3103b8)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:11.582053 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29251375-ed5b-4491-ad86-51e064a66da5 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:11.637016 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-29251375-ed5b-4491-ad86-51e064a66da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe26acfac874404d9bb69a0c2c3103b8'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:11.645288 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-29251375-ed5b-4491-ad86-51e064a66da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe26acfac874404d9bb69a0c2c3103b8'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:11.646032 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-29251375-ed5b-4491-ad86-51e064a66da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe26acfac874404d9bb69a0c2c3103b8'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:11.659895 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-29251375-ed5b-4491-ad86-51e064a66da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe26acfac874404d9bb69a0c2c3103b8'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:11.671399 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-29251375-ed5b-4491-ad86-51e064a66da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe26acfac874404d9bb69a0c2c3103b8'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:11.681202 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1462/2910] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:23:11 2022] DELETE /identity/v3/users/fe26acfac874404d9bb69a0c2c3103b8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:23:11.684121 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6152ecf-7aea-4e3f-8dfb-b399011cecb1 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:11.684946 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6152ecf-7aea-4e3f-8dfb-b399011cecb1 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:11.685244 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6152ecf-7aea-4e3f-8dfb-b399011cecb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:11.705741 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-e6152ecf-7aea-4e3f-8dfb-b399011cecb1 None None] MFA Rules not processed for user `8799b046633442a48a4bc8f6f80a2cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:23:11.707529 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e6152ecf-7aea-4e3f-8dfb-b399011cecb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:11.785571 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1449/2911] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 22:23:11.796477 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29251375-ed5b-4491-ad86-51e064a66da5 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:11.798550 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-29251375-ed5b-4491-ad86-51e064a66da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:11.864548 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29251375-ed5b-4491-ad86-51e064a66da5 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:11.869604 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ff716-9cd6-4200-b54c-844a1722018f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:11.870595 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ff716-9cd6-4200-b54c-844a1722018f service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:11.871454 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ff716-9cd6-4200-b54c-844a1722018f service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:11.871738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ff716-9cd6-4200-b54c-844a1722018f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:11.883443 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ff716-9cd6-4200-b54c-844a1722018f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:11.885525 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ff716-9cd6-4200-b54c-844a1722018f service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:11.895547 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1463/2912] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:23:12.241229 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6152ecf-7aea-4e3f-8dfb-b399011cecb1 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:12.243449 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e6152ecf-7aea-4e3f-8dfb-b399011cecb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:12.262392 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6152ecf-7aea-4e3f-8dfb-b399011cecb1 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:12.267121 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d079c3a-f026-4dfb-b774-c829f8dc9c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:12.268222 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d079c3a-f026-4dfb-b774-c829f8dc9c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:12.268544 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d079c3a-f026-4dfb-b774-c829f8dc9c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:12.268825 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d079c3a-f026-4dfb-b774-c829f8dc9c68 admin admin] PATH_INFO: `/v3/projects/5296b77792a44f6490899f0c27c079f5` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:12.270108 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d079c3a-f026-4dfb-b774-c829f8dc9c68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5296b77792a44f6490899f0c27c079f5)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:12.272183 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d079c3a-f026-4dfb-b774-c829f8dc9c68 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:12.321107 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8d079c3a-f026-4dfb-b774-c829f8dc9c68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5296b77792a44f6490899f0c27c079f5', 'request_id': 'req-8d079c3a-f026-4dfb-b774-c829f8dc9c68'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:12.327447 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8d079c3a-f026-4dfb-b774-c829f8dc9c68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5296b77792a44f6490899f0c27c079f5', 'request_id': 'req-8d079c3a-f026-4dfb-b774-c829f8dc9c68'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:12.336486 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8d079c3a-f026-4dfb-b774-c829f8dc9c68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5296b77792a44f6490899f0c27c079f5', 'request_id': 'req-8d079c3a-f026-4dfb-b774-c829f8dc9c68'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:12.346835 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8d079c3a-f026-4dfb-b774-c829f8dc9c68 admin admin] The token cache is being invalidate because project 5296b77792a44f6490899f0c27c079f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:23:12.347849 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8d079c3a-f026-4dfb-b774-c829f8dc9c68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:12.348022 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8d079c3a-f026-4dfb-b774-c829f8dc9c68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:23:12.349676 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1450/2913] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:23:12 2022] DELETE /identity/v3/projects/5296b77792a44f6490899f0c27c079f5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:23:14.489825 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e2c90-260a-4d4b-9b56-b4fe2b99deab None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:14.490334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e2c90-260a-4d4b-9b56-b4fe2b99deab None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:14.490429 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e2c90-260a-4d4b-9b56-b4fe2b99deab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:14.517159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-942e2c90-260a-4d4b-9b56-b4fe2b99deab None None] MFA Rules not processed for user `c6b4d16d7af4479eb46dd25e6d0a1ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:23:14.518524 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-942e2c90-260a-4d4b-9b56-b4fe2b99deab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:14.586360 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1464/2914] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:23:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:23:14.591160 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d079c3a-f026-4dfb-b774-c829f8dc9c68 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:14.592938 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-8d079c3a-f026-4dfb-b774-c829f8dc9c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:14.657764 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d079c3a-f026-4dfb-b774-c829f8dc9c68 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:14.663339 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175518ab-9ced-4f26-a550-7565e129daf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:14.664023 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175518ab-9ced-4f26-a550-7565e129daf4 admin admin] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:14.664312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175518ab-9ced-4f26-a550-7565e129daf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:14.664594 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175518ab-9ced-4f26-a550-7565e129daf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:14.665299 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175518ab-9ced-4f26-a550-7565e129daf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:14.667255 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175518ab-9ced-4f26-a550-7565e129daf4 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:14.698068 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1451/2915] 10.222.0.11 () {60 vars in 1152 bytes} [Wed May 4 22:23:14 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:23:14.702287 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e2c90-260a-4d4b-9b56-b4fe2b99deab None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:14.714336 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e2c90-260a-4d4b-9b56-b4fe2b99deab None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:14.770540 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd848e8-b001-4d34-9af7-ce7aba426f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:14.771315 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd848e8-b001-4d34-9af7-ce7aba426f77 admin admin] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:14.771602 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd848e8-b001-4d34-9af7-ce7aba426f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:14.771879 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd848e8-b001-4d34-9af7-ce7aba426f77 admin admin] PATH_INFO: `/v3/users` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:14.772615 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd848e8-b001-4d34-9af7-ce7aba426f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:14.774560 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd848e8-b001-4d34-9af7-ce7aba426f77 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:14.798118 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1465/2916] 10.222.0.11 () {60 vars in 1143 bytes} [Wed May 4 22:23:14 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 22:23:14.799431 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175518ab-9ced-4f26-a550-7565e129daf4 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:14.810729 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175518ab-9ced-4f26-a550-7565e129daf4 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:14.815798 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23a121-9933-4b2c-8c7e-33d889e74a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:14.816491 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23a121-9933-4b2c-8c7e-33d889e74a0f admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:14.816756 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23a121-9933-4b2c-8c7e-33d889e74a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:14.817033 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23a121-9933-4b2c-8c7e-33d889e74a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:14.817771 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23a121-9933-4b2c-8c7e-33d889e74a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:14.819443 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23a121-9933-4b2c-8c7e-33d889e74a0f admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:14.831237 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1452/2917] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:23:14.836135 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd848e8-b001-4d34-9af7-ce7aba426f77 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:14.856252 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd848e8-b001-4d34-9af7-ce7aba426f77 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:14.856252 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a026afd-905e-4988-b21f-7c6b931482fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:14.858864 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a026afd-905e-4988-b21f-7c6b931482fe admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:14.860619 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a026afd-905e-4988-b21f-7c6b931482fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:14.860619 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a026afd-905e-4988-b21f-7c6b931482fe admin admin] PATH_INFO: `/v3/projects/2847d64080ae4eda8dc5774f4bed4eab/users/95bed94414c946e2b7ac938691fae16f/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:14.881469 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a026afd-905e-4988-b21f-7c6b931482fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2847d64080ae4eda8dc5774f4bed4eab, user_id=95bed94414c946e2b7ac938691fae16f, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:14.884245 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a026afd-905e-4988-b21f-7c6b931482fe admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:14.899440 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1466/2918] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:23:14 2022] PUT /identity/v3/projects/2847d64080ae4eda8dc5774f4bed4eab/users/95bed94414c946e2b7ac938691fae16f/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:23:14.905536 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23a121-9933-4b2c-8c7e-33d889e74a0f admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:14.916703 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23a121-9933-4b2c-8c7e-33d889e74a0f admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:14.976361 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475d1f7-5b87-481d-b71c-1fb82538cf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:14.977061 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475d1f7-5b87-481d-b71c-1fb82538cf37 admin admin] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:14.977347 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475d1f7-5b87-481d-b71c-1fb82538cf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:14.977630 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475d1f7-5b87-481d-b71c-1fb82538cf37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:14.978376 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475d1f7-5b87-481d-b71c-1fb82538cf37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:14.980044 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475d1f7-5b87-481d-b71c-1fb82538cf37 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:14.993922 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1453/2919] 10.222.0.11 () {58 vars in 1121 bytes} [Wed May 4 22:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 22:23:14.995167 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a026afd-905e-4988-b21f-7c6b931482fe admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:15.006557 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a026afd-905e-4988-b21f-7c6b931482fe admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:15.011404 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010afe5-7b7b-4a44-9c91-7fb6f2b6eac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:15.012316 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010afe5-7b7b-4a44-9c91-7fb6f2b6eac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:15.012602 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010afe5-7b7b-4a44-9c91-7fb6f2b6eac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:15.012888 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010afe5-7b7b-4a44-9c91-7fb6f2b6eac2 admin admin] PATH_INFO: `/v3/projects/2847d64080ae4eda8dc5774f4bed4eab/users/95bed94414c946e2b7ac938691fae16f/roles/59778f07f0504e90a60212f460e8c774` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:15.014876 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010afe5-7b7b-4a44-9c91-7fb6f2b6eac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2847d64080ae4eda8dc5774f4bed4eab, user_id=95bed94414c946e2b7ac938691fae16f, role_id=59778f07f0504e90a60212f460e8c774)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:15.017713 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010afe5-7b7b-4a44-9c91-7fb6f2b6eac2 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:15.028945 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1467/2920] 10.222.0.11 () {60 vars in 1482 bytes} [Wed May 4 22:23:14 2022] PUT /identity/v3/projects/2847d64080ae4eda8dc5774f4bed4eab/users/95bed94414c946e2b7ac938691fae16f/roles/59778f07f0504e90a60212f460e8c774 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 22:23:19.612790 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a68c8b-180b-4b21-a842-728abb7d5338 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:19.613345 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a68c8b-180b-4b21-a842-728abb7d5338 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:19.613345 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a68c8b-180b-4b21-a842-728abb7d5338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:19.639712 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-c3a68c8b-180b-4b21-a842-728abb7d5338 None None] MFA Rules not processed for user `95bed94414c946e2b7ac938691fae16f`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:23:19.640830 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-c3a68c8b-180b-4b21-a842-728abb7d5338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:19.709761 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1454/2921] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:23:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:23:19.721858 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010afe5-7b7b-4a44-9c91-7fb6f2b6eac2 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:19.723762 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-b010afe5-7b7b-4a44-9c91-7fb6f2b6eac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:19.825655 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010afe5-7b7b-4a44-9c91-7fb6f2b6eac2 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:19.832013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee7112-76d0-41c2-bd2f-a7046a771b2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:19.832456 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee7112-76d0-41c2-bd2f-a7046a771b2b service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:19.832740 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee7112-76d0-41c2-bd2f-a7046a771b2b service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:19.833013 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee7112-76d0-41c2-bd2f-a7046a771b2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:19.900479 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee7112-76d0-41c2-bd2f-a7046a771b2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:19.902447 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee7112-76d0-41c2-bd2f-a7046a771b2b service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:19.918937 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1468/2922] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:23:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:23:21.296566 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437cf86-2e8b-4e90-80e3-b08ba25c8890 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:21.297095 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437cf86-2e8b-4e90-80e3-b08ba25c8890 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:21.297464 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437cf86-2e8b-4e90-80e3-b08ba25c8890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:21.317472 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-7437cf86-2e8b-4e90-80e3-b08ba25c8890 None None] MFA Rules not processed for user `c6b4d16d7af4479eb46dd25e6d0a1ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:23:21.318686 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-7437cf86-2e8b-4e90-80e3-b08ba25c8890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:21.325706 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1455/2923] 10.222.0.11 () {58 vars in 957 bytes} [Wed May 4 22:23:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:23:39.010974 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee7112-76d0-41c2-bd2f-a7046a771b2b service nova] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:39.012658 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-49ee7112-76d0-41c2-bd2f-a7046a771b2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:39.071026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee7112-76d0-41c2-bd2f-a7046a771b2b service nova] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:39.074962 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f719b-beba-486a-9678-f98948ca27cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:39.075680 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f719b-beba-486a-9678-f98948ca27cb service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:39.075966 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f719b-beba-486a-9678-f98948ca27cb service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:39.076244 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f719b-beba-486a-9678-f98948ca27cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:39.078615 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-703f719b-beba-486a-9678-f98948ca27cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:39.089186 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f719b-beba-486a-9678-f98948ca27cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:39.090631 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f719b-beba-486a-9678-f98948ca27cb service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:39.099555 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1469/2924] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:23:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:23:51.723310 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437cf86-2e8b-4e90-80e3-b08ba25c8890 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:23:51.724837 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-7437cf86-2e8b-4e90-80e3-b08ba25c8890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:23:51.737329 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437cf86-2e8b-4e90-80e3-b08ba25c8890 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:23:51.741211 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd574f1-8a2a-4d2b-bb2a-3c17c8f34aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:23:51.741853 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd574f1-8a2a-4d2b-bb2a-3c17c8f34aeb service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:23:51.742136 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd574f1-8a2a-4d2b-bb2a-3c17c8f34aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:23:51.742407 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd574f1-8a2a-4d2b-bb2a-3c17c8f34aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:23:51.752406 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd574f1-8a2a-4d2b-bb2a-3c17c8f34aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:23:51.753832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd574f1-8a2a-4d2b-bb2a-3c17c8f34aeb service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:23:51.763676 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1456/2925] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:23:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:25:48.992428 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f719b-beba-486a-9678-f98948ca27cb service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:25:49.001510 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f719b-beba-486a-9678-f98948ca27cb service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:25:49.005667 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1edab6-e17f-4bce-8778-d4ec35e093ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:25:49.006321 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1edab6-e17f-4bce-8778-d4ec35e093ed service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:25:49.006610 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1edab6-e17f-4bce-8778-d4ec35e093ed service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:25:49.006889 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1edab6-e17f-4bce-8778-d4ec35e093ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:25:49.009036 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-0a1edab6-e17f-4bce-8778-d4ec35e093ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:25:49.028155 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1edab6-e17f-4bce-8778-d4ec35e093ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:25:49.029613 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1edab6-e17f-4bce-8778-d4ec35e093ed service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:25:49.042159 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1470/2926] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:25:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:25:50.228702 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd574f1-8a2a-4d2b-bb2a-3c17c8f34aeb service neutron] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:25:50.240304 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd574f1-8a2a-4d2b-bb2a-3c17c8f34aeb service neutron] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:25:50.244954 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db32cfc-6602-4109-b8c4-7a3cfaa04906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:25:50.245603 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db32cfc-6602-4109-b8c4-7a3cfaa04906 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:25:50.245870 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db32cfc-6602-4109-b8c4-7a3cfaa04906 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:25:50.246147 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db32cfc-6602-4109-b8c4-7a3cfaa04906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:25:50.248186 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-0db32cfc-6602-4109-b8c4-7a3cfaa04906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:25:50.262237 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db32cfc-6602-4109-b8c4-7a3cfaa04906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:25:50.263754 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db32cfc-6602-4109-b8c4-7a3cfaa04906 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:25:50.275505 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1457/2927] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:25:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:26:01.404170 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1edab6-e17f-4bce-8778-d4ec35e093ed service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:26:01.405605 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-0a1edab6-e17f-4bce-8778-d4ec35e093ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:26:01.473679 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1edab6-e17f-4bce-8778-d4ec35e093ed service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:26:01.478642 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc5254-ec2b-4ba8-b8db-16e3eda41602 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e203d7077af54930a640b2334a1d8fa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:26:01.479334 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc5254-ec2b-4ba8-b8db-16e3eda41602 service placement] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:26:01.479621 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc5254-ec2b-4ba8-b8db-16e3eda41602 service placement] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:26:01.479902 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc5254-ec2b-4ba8-b8db-16e3eda41602 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:26:01.481677 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-d3bc5254-ec2b-4ba8-b8db-16e3eda41602 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:26:01.493738 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc5254-ec2b-4ba8-b8db-16e3eda41602 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:26:01.495350 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc5254-ec2b-4ba8-b8db-16e3eda41602 service placement] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:26:01.506022 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1471/2928] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:26:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 22:26:02.373668 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec2756-849c-4abb-a70c-0588a888770c None None] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:26:02.374290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec2756-849c-4abb-a70c-0588a888770c None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:26:02.374290 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec2756-849c-4abb-a70c-0588a888770c None None] PATH_INFO: `/` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:26:02.376027 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1458/2929] 10.222.0.11 () {54 vars in 921 bytes} [Wed May 4 22:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 22:26:02.382285 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38790b-974c-4c2e-a5d5-6bb15004eb17 None None] REQUEST_METHOD: `POST` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:26:02.382690 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38790b-974c-4c2e-a5d5-6bb15004eb17 None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:26:02.383315 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38790b-974c-4c2e-a5d5-6bb15004eb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:26:02.446289 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.auth.core [None req-5c38790b-974c-4c2e-a5d5-6bb15004eb17 None None] MFA Rules not processed for user `e4e5d4fe283447c59672398a26dea225`. Rule list: `[]` (Enabled: `True`). {{(pid=86613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:26:02.447528 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-5c38790b-974c-4c2e-a5d5-6bb15004eb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:26:02.454751 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1472/2930] 10.222.0.11 () {58 vars in 1018 bytes} [Wed May 4 22:26:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:26:02.468048 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec2756-849c-4abb-a70c-0588a888770c None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:26:02.479270 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec2756-849c-4abb-a70c-0588a888770c None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:26:02.483370 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36835daf-1bab-4753-93b1-2dc7f451fec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:26:02.484019 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36835daf-1bab-4753-93b1-2dc7f451fec5 service neutron] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:26:02.484298 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36835daf-1bab-4753-93b1-2dc7f451fec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:26:02.484571 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36835daf-1bab-4753-93b1-2dc7f451fec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:26:02.491890 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36835daf-1bab-4753-93b1-2dc7f451fec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:26:02.493312 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36835daf-1bab-4753-93b1-2dc7f451fec5 service neutron] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:26:02.501016 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1459/2931] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:26:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:26:02.585150 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c273b1-677c-4de5-a3fe-537d0bff2f2e None None] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:26:02.585872 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c273b1-677c-4de5-a3fe-537d0bff2f2e None None] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:26:02.585872 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c273b1-677c-4de5-a3fe-537d0bff2f2e None None] PATH_INFO: `/` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:26:02.587026 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1473/2932] 10.222.0.11 () {54 vars in 921 bytes} [Wed May 4 22:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 22:26:02.595528 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6f3e-e5e9-4d41-8fc1-41e7bd4d2b52 None None] REQUEST_METHOD: `POST` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:26:02.595814 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6f3e-e5e9-4d41-8fc1-41e7bd4d2b52 None None] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:26:02.596151 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6f3e-e5e9-4d41-8fc1-41e7bd4d2b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:26:02.645200 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.auth.core [None req-742f6f3e-e5e9-4d41-8fc1-41e7bd4d2b52 None None] MFA Rules not processed for user `f4f207481ccb4cfcbbcffd9df73d2985`. Rule list: `[]` (Enabled: `True`). {{(pid=86614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 22:26:02.647223 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-742f6f3e-e5e9-4d41-8fc1-41e7bd4d2b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:26:02.661529 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1460/2933] 10.222.0.11 () {58 vars in 1018 bytes} [Wed May 4 22:26:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 22:26:02.672520 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c273b1-677c-4de5-a3fe-537d0bff2f2e None None] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:26:02.687801 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c273b1-677c-4de5-a3fe-537d0bff2f2e None None] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:26:02.692496 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299e896-d1ef-4591-a085-da61fef334a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4e5d4fe283447c59672398a26dea225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:26:02.693160 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299e896-d1ef-4591-a085-da61fef334a4 service neutron] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:26:02.693436 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299e896-d1ef-4591-a085-da61fef334a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:26:02.693709 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299e896-d1ef-4591-a085-da61fef334a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:26:02.705546 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299e896-d1ef-4591-a085-da61fef334a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:26:02.707092 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299e896-d1ef-4591-a085-da61fef334a4 service neutron] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:26:02.718219 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1474/2934] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:26:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:27:28.331287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f6f3e-e5e9-4d41-8fc1-41e7bd4d2b52 None None] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:27:28.332672 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-742f6f3e-e5e9-4d41-8fc1-41e7bd4d2b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:27:28.348594 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f6f3e-e5e9-4d41-8fc1-41e7bd4d2b52 None None] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:27:28.356207 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9335e51-5242-4a2d-b104-e6b69309acc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:27:28.356942 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9335e51-5242-4a2d-b104-e6b69309acc3 service nova] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:27:28.357287 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9335e51-5242-4a2d-b104-e6b69309acc3 service nova] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:27:28.357596 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9335e51-5242-4a2d-b104-e6b69309acc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:27:28.359605 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e9335e51-5242-4a2d-b104-e6b69309acc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:27:28.372115 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9335e51-5242-4a2d-b104-e6b69309acc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:27:28.373784 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9335e51-5242-4a2d-b104-e6b69309acc3 service nova] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:27:28.384663 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1461/2935] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:27:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:27:30.463303 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299e896-d1ef-4591-a085-da61fef334a4 service neutron] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:27:30.475966 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299e896-d1ef-4591-a085-da61fef334a4 service neutron] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:27:30.482611 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4ddf8-7ff3-420b-9f1b-abcd0ab782c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f207481ccb4cfcbbcffd9df73d2985', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:27:30.483301 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4ddf8-7ff3-420b-9f1b-abcd0ab782c7 service nova] REQUEST_METHOD: `GET` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:27:30.483593 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4ddf8-7ff3-420b-9f1b-abcd0ab782c7 service nova] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:27:30.483868 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4ddf8-7ff3-420b-9f1b-abcd0ab782c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:27:30.485688 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-19b4ddf8-7ff3-420b-9f1b-abcd0ab782c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:27:30.498848 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4ddf8-7ff3-420b-9f1b-abcd0ab782c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:27:30.500514 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4ddf8-7ff3-420b-9f1b-abcd0ab782c7 service nova] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:27:30.512015 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1475/2936] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:27:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 22:27:38.517177 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9335e51-5242-4a2d-b104-e6b69309acc3 service nova] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:27:38.580358 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9335e51-5242-4a2d-b104-e6b69309acc3 service nova] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:27:38.586006 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784cf27-7483-4961-835e-f4fa9ec588bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:27:38.586940 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784cf27-7483-4961-835e-f4fa9ec588bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:27:38.587246 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784cf27-7483-4961-835e-f4fa9ec588bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:27:38.587517 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784cf27-7483-4961-835e-f4fa9ec588bf admin admin] PATH_INFO: `/v3/users/c6b4d16d7af4479eb46dd25e6d0a1ed3` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:27:38.588733 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784cf27-7483-4961-835e-f4fa9ec588bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6b4d16d7af4479eb46dd25e6d0a1ed3)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:27:38.590663 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784cf27-7483-4961-835e-f4fa9ec588bf admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:27:38.647003 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8784cf27-7483-4961-835e-f4fa9ec588bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6b4d16d7af4479eb46dd25e6d0a1ed3'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:27:38.658035 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8784cf27-7483-4961-835e-f4fa9ec588bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6b4d16d7af4479eb46dd25e6d0a1ed3'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:27:38.664996 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8784cf27-7483-4961-835e-f4fa9ec588bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6b4d16d7af4479eb46dd25e6d0a1ed3'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:27:38.665640 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8784cf27-7483-4961-835e-f4fa9ec588bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6b4d16d7af4479eb46dd25e6d0a1ed3'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:27:38.666278 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-8784cf27-7483-4961-835e-f4fa9ec588bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6b4d16d7af4479eb46dd25e6d0a1ed3'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:27:38.683219 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1462/2937] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:27:38 2022] DELETE /identity/v3/users/c6b4d16d7af4479eb46dd25e6d0a1ed3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:27:38.859459 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4ddf8-7ff3-420b-9f1b-abcd0ab782c7 service nova] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:27:38.870534 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4ddf8-7ff3-420b-9f1b-abcd0ab782c7 service nova] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:27:38.925286 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af236b91-348f-4758-865e-420beb683741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:27:38.926161 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af236b91-348f-4758-865e-420beb683741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:27:38.926448 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af236b91-348f-4758-865e-420beb683741 admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:27:38.926728 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af236b91-348f-4758-865e-420beb683741 admin admin] PATH_INFO: `/v3/projects/1547efc676354a919b6fddfb7d649fd2` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:27:38.927949 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af236b91-348f-4758-865e-420beb683741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1547efc676354a919b6fddfb7d649fd2)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:27:38.929886 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af236b91-348f-4758-865e-420beb683741 admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:27:38.982800 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-af236b91-348f-4758-865e-420beb683741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1547efc676354a919b6fddfb7d649fd2', 'request_id': 'req-af236b91-348f-4758-865e-420beb683741'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:27:38.992405 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-af236b91-348f-4758-865e-420beb683741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1547efc676354a919b6fddfb7d649fd2', 'request_id': 'req-af236b91-348f-4758-865e-420beb683741'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:27:38.999758 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-af236b91-348f-4758-865e-420beb683741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1547efc676354a919b6fddfb7d649fd2', 'request_id': 'req-af236b91-348f-4758-865e-420beb683741'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:27:39.011893 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-af236b91-348f-4758-865e-420beb683741 admin admin] The token cache is being invalidate because project 1547efc676354a919b6fddfb7d649fd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:27:39.012180 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-af236b91-348f-4758-865e-420beb683741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:27:39.012936 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-af236b91-348f-4758-865e-420beb683741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:27:39.014599 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1476/2938] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:27:38 2022] DELETE /identity/v3/projects/1547efc676354a919b6fddfb7d649fd2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:27:39.018957 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784cf27-7483-4961-835e-f4fa9ec588bf admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:27:39.020578 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-8784cf27-7483-4961-835e-f4fa9ec588bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:27:39.034411 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784cf27-7483-4961-835e-f4fa9ec588bf admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:27:39.093172 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4995f8-2451-4688-b913-2f686139a1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:27:39.094242 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4995f8-2451-4688-b913-2f686139a1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:27:39.094641 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4995f8-2451-4688-b913-2f686139a1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:27:39.095023 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4995f8-2451-4688-b913-2f686139a1b4 admin admin] PATH_INFO: `/v3/users/95bed94414c946e2b7ac938691fae16f` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:27:39.096655 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4995f8-2451-4688-b913-2f686139a1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95bed94414c946e2b7ac938691fae16f)` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:27:39.098992 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4995f8-2451-4688-b913-2f686139a1b4 admin admin] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:27:39.153045 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-9d4995f8-2451-4688-b913-2f686139a1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95bed94414c946e2b7ac938691fae16f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:27:39.161074 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-9d4995f8-2451-4688-b913-2f686139a1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95bed94414c946e2b7ac938691fae16f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:27:39.167858 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-9d4995f8-2451-4688-b913-2f686139a1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95bed94414c946e2b7ac938691fae16f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:27:39.168511 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-9d4995f8-2451-4688-b913-2f686139a1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95bed94414c946e2b7ac938691fae16f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:27:39.169117 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.notifications [None req-9d4995f8-2451-4688-b913-2f686139a1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95bed94414c946e2b7ac938691fae16f'} {{(pid=86614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:27:39.187020 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1463/2939] 10.222.0.11 () {58 vars in 1223 bytes} [Wed May 4 22:27:39 2022] DELETE /identity/v3/users/95bed94414c946e2b7ac938691fae16f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:27:39.370573 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af236b91-348f-4758-865e-420beb683741 admin admin] Authenticating user token {{(pid=86613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:27:39.372113 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.fernet_utils [None req-af236b91-348f-4758-865e-420beb683741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:27:39.385605 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af236b91-348f-4758-865e-420beb683741 admin admin] Validating token access rules against request {{(pid=86613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:27:39.448228 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87612457-0530-4ac0-8542-c3f88a3ae54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8799b046633442a48a4bc8f6f80a2cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf7f12f74dbe44d39ddca7448ef132f4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:27:39.449096 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87612457-0530-4ac0-8542-c3f88a3ae54f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:27:39.449378 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87612457-0530-4ac0-8542-c3f88a3ae54f admin admin] SCRIPT_NAME: `/identity` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:27:39.449621 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87612457-0530-4ac0-8542-c3f88a3ae54f admin admin] PATH_INFO: `/v3/projects/2847d64080ae4eda8dc5774f4bed4eab` {{(pid=86613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:27:39.451305 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87612457-0530-4ac0-8542-c3f88a3ae54f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2847d64080ae4eda8dc5774f4bed4eab)` {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:27:39.453219 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87612457-0530-4ac0-8542-c3f88a3ae54f admin admin] RBAC: Authorization granted {{(pid=86613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:27:39.512249 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-87612457-0530-4ac0-8542-c3f88a3ae54f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2847d64080ae4eda8dc5774f4bed4eab', 'request_id': 'req-87612457-0530-4ac0-8542-c3f88a3ae54f'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:27:39.520884 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-87612457-0530-4ac0-8542-c3f88a3ae54f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2847d64080ae4eda8dc5774f4bed4eab', 'request_id': 'req-87612457-0530-4ac0-8542-c3f88a3ae54f'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:27:39.527311 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-87612457-0530-4ac0-8542-c3f88a3ae54f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2847d64080ae4eda8dc5774f4bed4eab', 'request_id': 'req-87612457-0530-4ac0-8542-c3f88a3ae54f'} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:27:39.538145 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-87612457-0530-4ac0-8542-c3f88a3ae54f admin admin] The token cache is being invalidate because project 2847d64080ae4eda8dc5774f4bed4eab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 22:27:39.538426 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-87612457-0530-4ac0-8542-c3f88a3ae54f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:27:39.539179 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: DEBUG keystone.notifications [None req-87612457-0530-4ac0-8542-c3f88a3ae54f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 22:27:39.541347 dv-cinder-839793-8-iscsi devstack@keystone.service[86613]: [pid: 86613|app: 0|req: 1477/2940] 10.222.0.11 () {58 vars in 1232 bytes} [Wed May 4 22:27:39 2022] DELETE /identity/v3/projects/2847d64080ae4eda8dc5774f4bed4eab => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:31:07.150166 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4995f8-2451-4688-b913-2f686139a1b4 admin admin] Authenticating user token {{(pid=86614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:31:07.151770 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-9d4995f8-2451-4688-b913-2f686139a1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:31:07.277986 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4995f8-2451-4688-b913-2f686139a1b4 admin admin] Validating token access rules against request {{(pid=86614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:31:07.339167 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f00529-0682-47ea-8dd8-ddd08db2b4bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e203d7077af54930a640b2334a1d8fa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3acb142d1aa34e18a018d3fdee8d7038', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:31:07.339832 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f00529-0682-47ea-8dd8-ddd08db2b4bf service placement] REQUEST_METHOD: `GET` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:31:07.340120 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f00529-0682-47ea-8dd8-ddd08db2b4bf service placement] SCRIPT_NAME: `/identity` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:31:07.340395 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f00529-0682-47ea-8dd8-ddd08db2b4bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:31:07.343080 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.fernet_utils [None req-e1f00529-0682-47ea-8dd8-ddd08db2b4bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:31:07.355415 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f00529-0682-47ea-8dd8-ddd08db2b4bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:31:07.357010 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f00529-0682-47ea-8dd8-ddd08db2b4bf service placement] RBAC: Authorization granted {{(pid=86614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:31:07.368105 dv-cinder-839793-8-iscsi devstack@keystone.service[86614]: [pid: 86614|app: 0|req: 1464/2941] 10.222.0.11 () {60 vars in 1365 bytes} [Wed May 4 22:31:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)